-- Logs begin at Thu 2022-06-16 13:40:44 UTC, end at Thu 2022-06-16 15:00:43 UTC. -- Jun 16 14:25:06.541695 n-d-836830-4 systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 14:25:06.551133 n-d-836830-4 devstack@n-api.service[104209]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 14:25:06 2022] *** Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: nodename: n-d-836830-4 Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: machine: x86_64 Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: clock source: unix Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: pcre jit disabled Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: detected number of CPU cores: 4 Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: current working directory: / Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: detected binary path: /usr/bin/uwsgi-core Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: your processes number limit is 47680 Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: your memory page size is 4096 bytes Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: detected max file descriptor number: 2048 Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: lock engine: pthread robust mutexes Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: thunder lock: enabled Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 14:25:06.554435 n-d-836830-4 devstack@n-api.service[104209]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 14:25:06.600237 n-d-836830-4 devstack@n-api.service[104209]: Python main interpreter initialized at 0x5588d84369c0 Jun 16 14:25:06.600237 n-d-836830-4 devstack@n-api.service[104209]: python threads support enabled Jun 16 14:25:06.600237 n-d-836830-4 devstack@n-api.service[104209]: your server socket listen backlog is limited to 100 connections Jun 16 14:25:06.600237 n-d-836830-4 devstack@n-api.service[104209]: your mercy for graceful operations on workers is 90 seconds Jun 16 14:25:06.601300 n-d-836830-4 devstack@n-api.service[104209]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 14:25:06.601300 n-d-836830-4 devstack@n-api.service[104209]: *** Operational MODE: preforking *** Jun 16 14:25:06.601571 n-d-836830-4 devstack@n-api.service[104209]: *** uWSGI is running in multiple interpreter mode *** Jun 16 14:25:06.601571 n-d-836830-4 devstack@n-api.service[104209]: spawned uWSGI master process (pid: 104209) Jun 16 14:25:06.601713 n-d-836830-4 systemd[1]: Started Devstack devstack@n-api.service. Jun 16 14:25:06.602620 n-d-836830-4 devstack@n-api.service[104209]: spawned uWSGI worker 1 (pid: 104210, cores: 1) Jun 16 14:25:06.602735 n-d-836830-4 devstack@n-api.service[104209]: spawned uWSGI worker 2 (pid: 104211, cores: 1) Jun 16 14:25:06.603245 n-d-836830-4 devstack@n-api.service[104209]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 14:25:07.310941 n-d-836830-4 devstack@n-api.service[104210]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 14:25:07.320049 n-d-836830-4 devstack@n-api.service[104211]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 14:25:08.561780 n-d-836830-4 devstack@n-api.service[104210]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:25:08.561780 n-d-836830-4 devstack@n-api.service[104210]: from cryptography.utils import int_from_bytes Jun 16 14:25:08.562447 n-d-836830-4 devstack@n-api.service[104210]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:25:08.562447 n-d-836830-4 devstack@n-api.service[104210]: from cryptography.utils import int_from_bytes Jun 16 14:25:08.563474 n-d-836830-4 devstack@n-api.service[104211]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:25:08.563474 n-d-836830-4 devstack@n-api.service[104211]: from cryptography.utils import int_from_bytes Jun 16 14:25:08.563927 n-d-836830-4 devstack@n-api.service[104211]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:25:08.563927 n-d-836830-4 devstack@n-api.service[104211]: from cryptography.utils import int_from_bytes Jun 16 14:25:11.257525 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:25:11.258304 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:25:11.258304 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:25:11.258691 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:25:11.258948 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:25:11.259290 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:25:11.259668 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.259753 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:25:11.259830 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.259960 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.260093 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:25:11.260276 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.260464 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:25:11.260606 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.260725 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:25:11.260917 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.261119 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.261245 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.261450 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.261556 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.261778 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.261885 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.262098 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.262223 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.262460 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.262582 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.262772 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.262873 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-4 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.263093 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.263177 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.263402 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.263497 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.263711 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.263857 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.263984 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.264075 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.264298 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.264397 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.264624 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-4 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.264713 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.264925 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.265016 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.265252 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.265438 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.265615 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.265885 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.266032 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.266189 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.266303 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.266531 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.266662 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.266840 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.266966 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.267175 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.267373 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.267581 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.267731 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.267948 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.268095 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.268306 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.269000 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.269301 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.269301 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.269614 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.269799 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-4 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.270089 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.270278 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.270521 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.270672 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.270848 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.271079 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.271265 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.271265 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.271663 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.271663 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.272042 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.272294 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.272450 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-4 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.272630 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.272804 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.272942 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.273066 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.273221 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.273343 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.273472 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.273600 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.273723 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.273881 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.274008 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.274113 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.274241 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.274373 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.274535 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.274656 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.274789 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.274921 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.275044 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.275201 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.275325 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.275446 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.275567 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.275706 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.275814 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.275814 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.276069 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.276192 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.276312 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.276441 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.276581 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.276704 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.276824 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.277023 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.277163 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.277285 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.277419 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.277548 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.277680 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.277837 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.277996 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.278121 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.278251 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.278560 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.278757 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.278911 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.279041 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.279177 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.279301 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.279433 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.279556 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.279694 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.279857 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.280003 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.280126 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.280257 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.280389 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.280512 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.280634 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.280810 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.280949 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.281133 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.281276 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.281445 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.281586 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.281757 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.281884 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.282069 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.282204 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.282466 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.282593 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.282716 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.282836 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.283029 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.283166 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.283378 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.283503 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.283700 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.283825 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.284065 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.284198 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.284527 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.284660 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.285507 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.285692 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.285861 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.285986 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.286116 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.286302 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.286492 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.286638 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.286825 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.286952 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.287143 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.287268 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.287471 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.287598 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.287733 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.287864 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.288014 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.288140 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.288322 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.288448 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.288645 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.288771 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.288953 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.289079 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.289262 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.289406 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.289570 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.289703 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.289869 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.289994 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.290176 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.290319 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.290517 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.290655 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.290803 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.290929 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.291111 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.291254 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.291418 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.291543 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.291729 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.291854 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.292033 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.292181 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.292347 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.292579 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.292714 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.292845 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.292982 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.293111 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.293246 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.293369 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.293546 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.293673 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.293854 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.293973 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.294164 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.294291 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.294499 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.294628 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.294832 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.294968 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.295117 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.295243 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.295421 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.295553 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.295738 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.295863 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.296044 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.296167 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.296348 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.296474 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.296657 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.296791 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.296961 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.297084 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.297299 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.297425 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.297555 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.297677 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.297864 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.297989 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.298170 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.298296 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.298500 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.298633 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.298806 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.298930 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.299113 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.299245 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.299417 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.299543 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.299748 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.299877 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.300055 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.300196 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.300361 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.300495 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.300663 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.300788 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.300966 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.301101 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.301266 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.301392 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.301571 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.301696 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.301963 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.302114 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.302246 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.302369 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.302513 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.302735 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.302861 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.303000 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.303123 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.303253 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.303376 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.303497 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.303690 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.303824 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.304015 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.304141 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.304331 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.304467 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.304644 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.304771 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.304952 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.305078 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.305277 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:25:11.305412 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.305626 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.305812 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.305943 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.306064 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.306257 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.306441 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.306588 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.306705 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.306903 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.307030 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.307209 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.307332 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.307525 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.307637 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.307846 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.307965 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.308272 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.308488 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.308624 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.308748 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.308871 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.308982 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.309118 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.309273 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.309398 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.309523 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.309759 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.309904 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.310036 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.310174 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.310338 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.310498 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.310718 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.310850 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.311009 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.311165 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.311356 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.311468 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.311673 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.311785 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.311996 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.312172 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.312304 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.312437 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.312619 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.312875 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.313012 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.313168 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.313293 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.313415 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.313538 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.313659 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.313849 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.313976 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.314160 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.314518 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.314625 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.314729 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.314860 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.314992 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.315115 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.315777 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.315950 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.316076 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.316262 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.316399 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.316572 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.316736 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.316915 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.317126 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.317256 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.317384 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.317533 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.317658 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.317844 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.317986 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.318160 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.318294 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.318486 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.318609 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.318792 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.318930 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.319104 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.319229 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.319487 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.319698 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.319825 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.319958 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.320083 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.320214 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.320348 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.320479 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.320602 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.320757 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.320884 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.321074 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.321202 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.321391 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.321526 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.321702 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.321829 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.322013 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.322148 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.322325 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.322484 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.322678 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.322813 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.323040 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.323175 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.323298 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.323433 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.323619 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.323750 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.323926 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.324050 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.324231 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.324400 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.324606 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.324795 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.324987 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.325194 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.325410 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.325619 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.325821 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.326228 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.326228 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.326559 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.326714 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.326823 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.326952 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.327087 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.327201 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.327308 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.327422 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.327536 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.327717 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.327844 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.328028 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.328154 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.328356 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.328483 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.328665 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.328791 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.328975 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.329095 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.329314 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.329437 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.329612 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.329746 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.329926 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.330059 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.330240 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.330365 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.330588 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.330712 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.330932 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.334130 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.334309 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.334309 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.334802 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.334930 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.335082 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.335218 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.335341 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.335478 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.335601 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.335725 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.335856 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.335980 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.336102 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.336232 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.336354 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.336484 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.336615 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.336746 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.336874 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.336996 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.337118 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.337240 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.337371 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.337502 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.337615 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.337735 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.337859 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.337981 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.338117 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.338240 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.338395 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.338546 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.338670 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.338816 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.338950 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.339074 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.339196 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.339317 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.339446 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.339567 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.339689 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.339818 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.339941 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.340062 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.340190 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.340326 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.340449 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.340578 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.340767 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.340899 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.341033 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.341214 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.341341 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.341463 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.341585 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.341706 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.341870 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.342002 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.342124 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.342246 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.342246 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.342535 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.342671 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.342795 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.342918 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.343040 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.343163 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.343285 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.343420 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.343543 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.343673 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.343808 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.343932 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.344062 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.344298 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.344432 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.344564 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.344695 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.344816 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.344949 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.345073 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.345195 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.345329 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.345451 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.345573 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.345707 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.345831 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.345953 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.346075 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.346198 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.346319 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.346469 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.346669 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.346794 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.346935 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.347181 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.347340 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.347537 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.347537 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.347736 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.347849 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.347959 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.348080 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.348210 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.348343 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.348474 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.348596 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.348718 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.348848 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.348971 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.349092 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.349221 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.349346 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.349468 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.349603 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.349716 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.349898 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.350024 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.350214 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.350349 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.350534 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.350657 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.351334 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.351498 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.351633 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.351756 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.351892 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.352015 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.352137 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.352258 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.352379 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.352510 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.352691 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.352869 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.353061 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.353274 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.353411 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.353546 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.353670 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.353801 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.353925 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.354047 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.354170 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.354317 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.354578 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.354715 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.354846 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.354959 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.355086 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.355223 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.355358 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.355481 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.355603 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.355726 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.355858 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.355981 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.356103 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.356225 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.356347 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.356469 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.356600 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.356725 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.356854 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.356977 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.357132 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.357260 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.357439 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.357568 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.357747 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.357875 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.358052 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.358178 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.358474 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.358608 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.358742 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.358856 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.359048 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.359183 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.359369 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.359502 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.359694 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.359814 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.360006 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.360141 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.360325 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.360458 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.360639 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.360771 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.360947 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.361081 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.361257 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.361384 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.361580 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.361722 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.361893 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.362029 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.362235 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.362369 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.362618 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.362726 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.362874 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.362997 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.363191 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.363340 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.363506 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.363631 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.363817 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.363949 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.364130 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.364261 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.364438 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.364577 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.364805 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.364931 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.365042 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.365154 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.365459 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.365599 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.365736 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.365935 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.366062 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.366269 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.366422 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.366610 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.366746 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.367041 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.367180 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.367295 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.367562 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.367817 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.367952 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.368083 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.368206 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.368330 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.368460 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.368591 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.368722 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.368854 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.369021 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.369148 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.369360 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.369487 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.369684 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.369810 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.369996 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.370130 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.370301 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.370490 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.370662 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.370789 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.371004 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.371128 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.371317 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.371555 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.371691 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.372207 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.372361 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.372496 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.372628 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.372751 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.373003 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.373142 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.373251 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.373518 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.373638 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.373743 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.373847 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.373965 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.374079 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.374184 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.374288 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.374544 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.374679 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.374806 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.375017 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.375127 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.375239 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.375344 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.375457 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.375575 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.375679 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.375831 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.375945 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.376152 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.376275 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.376463 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.376586 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.376783 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.376895 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.377090 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.377203 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.377419 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.377533 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.378294 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.378459 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.378622 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.378796 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.378968 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.379151 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.379350 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.379466 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.379582 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.379686 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.379892 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.380008 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.380220 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.380334 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.380538 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.380670 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.380852 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.380985 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.381165 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.381300 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.381477 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.381603 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.381789 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.381920 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.382102 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.382235 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.382443 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.382588 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.382725 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.382848 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.383047 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.383183 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.383364 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.383492 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.383674 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.383801 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.383985 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.384119 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.384300 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.384441 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.384652 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.384777 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.384969 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.385223 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.385372 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.385525 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.385649 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.385772 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.385904 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.386028 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.386174 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.386299 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.386512 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.386638 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.386823 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.386948 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.387131 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.387264 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.387437 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.387563 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.387751 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.387875 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.388061 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.388189 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.388368 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.388501 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.388674 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.388800 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.388986 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.389112 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.389291 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.389425 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.389594 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.389728 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.389903 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.390104 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.390224 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.390346 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.390549 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.390675 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.390849 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.390983 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.391160 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.391310 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.391486 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.391645 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.391802 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.391962 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.392136 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.392315 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.392488 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.392657 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.392833 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.393001 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.393181 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.393380 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.393578 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.393763 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.393763 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.394055 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.394212 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.394359 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.394533 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.394668 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.394792 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.394914 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.395050 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.395175 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.395456 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.395586 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.395709 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.395847 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.395980 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.396087 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.396208 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.396382 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.396510 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.396691 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.396826 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.397002 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.397129 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.397310 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.397439 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.397642 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.397777 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.397956 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.398088 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.398302 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.398449 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.398593 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.398704 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.398887 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.399014 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.399207 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.399342 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.399519 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.399651 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.399832 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.399958 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.400136 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.400822 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.400935 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.401067 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.401267 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.401394 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.401584 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.401721 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.401897 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.402024 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.402222 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.402349 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.402557 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.402699 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.402883 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.403011 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.403202 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.403329 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.403514 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.403652 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.403823 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.403950 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.404131 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.404256 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.404442 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.404569 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.404751 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.404876 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.405063 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.405189 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.405377 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.405659 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.405794 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.405916 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.406046 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.406169 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.406310 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.406537 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.406664 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.406786 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.406908 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.407031 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.407197 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.407333 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.407503 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.407630 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.407846 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.407991 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.408149 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.408278 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.408455 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.408589 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.408762 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.408895 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.409136 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.409271 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.409469 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.409669 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.409805 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.409994 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.410317 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.410504 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.410659 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.410771 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.411040 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.411321 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.411321 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.411561 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.411693 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.411855 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.412018 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.412184 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.412313 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.412443 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.412567 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.412696 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.412871 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.413043 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.413220 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.413361 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.413514 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.413800 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.413943 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.414109 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.414234 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.414446 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.414578 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.414753 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.414904 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.415066 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.415194 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.415401 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.415563 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.415840 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.415974 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.416096 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.416228 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.416349 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.416470 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.416601 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.416746 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.416872 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.417066 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.417200 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.417386 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.417596 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.417722 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.417911 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.418036 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.418216 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.418349 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.418632 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.418760 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.418961 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.419086 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.419271 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.419405 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.419581 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.419708 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.419889 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.420024 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.420213 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.420348 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.420519 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.420648 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.420839 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.420965 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.421151 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.421279 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.421476 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.421602 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.421809 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.421943 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.422124 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.422284 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.422519 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.422658 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.422791 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.422937 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.423064 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.423266 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.423393 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.423596 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.423722 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.423927 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.424066 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.424331 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.424471 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.424700 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.424953 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.425081 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.425386 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.425514 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.425721 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.425994 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.426122 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.426255 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.426410 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.426579 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.426714 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.426846 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.426971 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.427166 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.427294 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.427497 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.427638 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.427821 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.427948 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.428154 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.428279 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.428467 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.428595 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.428778 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.428912 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.429088 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.429226 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.429394 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.429520 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.429680 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.429845 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.430002 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.430137 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.430306 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.430518 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.430643 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.430784 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.430960 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.431087 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.431285 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.431406 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.431608 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.431737 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.431918 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.432054 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.432244 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.432370 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.432554 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.432688 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.432857 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.432997 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.433164 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.433291 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.433465 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.433600 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.433808 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.433942 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.434112 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.434237 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.434459 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.434589 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.434784 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.434928 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.435114 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.435242 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.435427 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.435611 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.435749 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.435873 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.436132 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.436254 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.436360 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.436472 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.436678 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.436811 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.437005 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.437123 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.437311 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.437434 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.437615 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.437730 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.437928 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.438041 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.438234 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.438348 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.438571 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.438695 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.438878 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.439000 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.439311 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.439511 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.439640 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.439764 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.439889 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.439994 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.440116 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.440819 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.440940 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.441152 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.441288 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.441485 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.441609 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.441797 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.441919 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.442105 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.442240 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.442444 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.442573 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.442749 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.442877 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.443058 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.443192 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.443367 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.443509 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.443682 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.443809 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.443990 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.444117 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.444300 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.444436 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.444610 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.444736 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.444943 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.445069 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.445253 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.445393 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.445575 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.445761 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.445895 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.446018 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.446194 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.446417 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.446546 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.446667 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.446831 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.447018 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.447166 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.447300 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.447426 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.447549 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.447736 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.447865 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.448053 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.448201 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.448388 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.448526 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.448677 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.448888 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.449215 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.449333 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.449566 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.449696 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.449883 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.449999 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.450198 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.450323 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.450539 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.450654 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.451099 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.451235 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.451420 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.451533 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.451731 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.451854 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.452043 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.452166 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.452359 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.452472 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.452669 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.452783 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.453002 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.453124 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.453328 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.453467 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.453658 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.453904 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.454047 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.454241 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.454370 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.454588 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.454716 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.454909 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.455051 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.455228 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.455365 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.455552 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.455680 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.455938 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.456699 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.456824 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.456949 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.457080 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.457239 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.457450 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.457576 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.457698 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.457872 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.458008 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.458192 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.458328 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.458565 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.458695 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.459018 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.459325 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.459613 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.459749 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.459875 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.459998 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.460121 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.460244 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.460376 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.460502 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.460626 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.460758 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.460893 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.461024 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.461157 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.461297 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.461413 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.461537 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.461667 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.461803 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.461929 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.462108 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.462239 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.462450 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.462771 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.462917 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.463090 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.463210 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.463448 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.463568 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.463721 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.463858 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.464039 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.464166 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.464358 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.464485 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.464678 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.464807 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.465006 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.465137 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.465314 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.465440 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.465623 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.465751 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.465974 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.466114 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.466260 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.466423 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.466594 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.466869 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.466998 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.467181 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.467307 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.467504 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.467639 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.467825 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.467950 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.468140 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.468264 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.468478 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.468708 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.468834 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.469060 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.469193 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.469382 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.469519 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.469714 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.469840 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.470024 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.470156 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.470342 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.470550 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.470684 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.470807 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.470976 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.471110 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.471288 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.471454 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.471583 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.471715 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.471900 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.472054 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.472262 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.472428 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.472579 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.472721 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.473086 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.473209 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.473516 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.473683 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.473998 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.474111 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.474217 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.474366 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.474556 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.474674 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.474785 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.474892 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.475051 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.475248 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.475370 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.475478 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.475653 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.475785 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.475970 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.476108 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.476286 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.476414 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.476591 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.476718 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.476910 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.477102 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.477234 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.477363 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.477490 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.477615 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.477811 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.477940 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.478141 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.478424 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.478582 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.478735 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.478884 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.479032 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.479182 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.479352 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.479506 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.479651 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.479798 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.479967 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.480112 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.480299 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.480444 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.480611 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.480771 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.480921 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.481060 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.481215 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.481360 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.481500 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.481658 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.481796 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.481933 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.482111 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.482255 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.482457 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.482618 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.482757 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.482893 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.483073 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.483235 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.483386 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.483524 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.483684 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.484045 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.484189 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.484384 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.484540 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.484680 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.484817 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.484990 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.485134 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.485313 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.485467 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.485629 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.485773 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.485956 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.486100 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.486267 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.486459 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.486606 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.486751 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.486984 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.487257 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.487488 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.487640 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.487786 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.487924 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.488076 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.488274 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.488424 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.488570 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.488746 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.488893 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.489036 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.489174 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.489319 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.489468 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.489605 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.489741 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.489878 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.490023 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.490160 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.490296 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.490522 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.490668 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.490813 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.490965 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.491104 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.491242 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.491393 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.491537 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.491681 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.491827 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.491965 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.492139 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.492284 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.492465 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.492623 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.492775 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.492919 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.493058 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.493204 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.493371 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.493524 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.493670 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.493807 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.493981 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.494126 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.494314 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.494510 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.494650 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.494787 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.494959 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.495104 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.495367 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.495520 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.495691 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.495835 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.496012 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.496156 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.496333 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.496483 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.496643 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.496812 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.496953 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.497089 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.497278 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.497532 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.497739 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.497885 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.498022 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.498160 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.498321 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.498577 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.498577 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.498859 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.498996 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.499237 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.499237 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.499517 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.499662 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.499821 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.500013 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.500185 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.500326 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.500462 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.500601 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.500737 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.500874 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.501020 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.501159 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.501306 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.501445 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.501588 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.501734 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.501871 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.502008 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.502151 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.502306 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.502476 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.503179 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.503356 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.504115 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.504266 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.504414 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.504547 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.504692 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.504825 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.504825 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.505078 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.505209 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.505352 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.505484 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.505582 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.505705 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.505846 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.506061 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.506303 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.506483 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.506693 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.506876 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.507033 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.507288 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.507454 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.507742 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.507892 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.508076 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.508222 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.508474 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.508610 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.508833 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.509013 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.509231 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.509472 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.509667 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.509819 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.510021 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.510113 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.510430 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.510565 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.510756 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.511078 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.511166 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.511389 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.511618 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.511706 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.512023 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.512142 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.512337 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.512630 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.512718 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.512952 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.513181 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.513275 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.513562 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.513709 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.513893 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.514236 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.514326 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.514564 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.514808 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.514895 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.515202 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.515354 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.515534 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.515807 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.515911 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.516150 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.516321 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.516498 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.516640 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.516782 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.517022 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.517169 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.517350 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.517499 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.517680 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.517894 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.518041 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.518350 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.519249 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.519249 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.521019 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.521121 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.521307 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.521432 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.521701 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.521847 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.521992 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.522097 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.522168 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.522240 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.522319 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.522460 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.522534 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.522601 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.522666 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.522747 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.522817 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.522892 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.522960 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.523026 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.523098 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.523173 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.523241 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.523315 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.523383 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.523449 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.523651 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.523740 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.523904 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:25:11.524038 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.524373 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.524686 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.525020 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.525345 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.525675 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.526076 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.526498 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.526842 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.527163 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.527525 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.527865 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.528185 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.528506 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.528829 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.529152 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.529487 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.529820 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.530137 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.530498 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.530895 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.531283 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.531672 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.532029 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.532369 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.532690 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.533011 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.533325 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:25:11.533573 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:25:11.588024 n-d-836830-4 devstack@n-api.service[104211]: INFO dbcounter [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] Registered counter for database nova_api Jun 16 14:25:11.601167 n-d-836830-4 devstack@n-api.service[104210]: INFO dbcounter [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] Registered counter for database nova_api Jun 16 14:25:11.613169 n-d-836830-4 devstack@n-api.service[104211]: DEBUG oslo_db.sqlalchemy.engines [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:25:11.621730 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_db.sqlalchemy.engines [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:25:11.623439 n-d-836830-4 devstack@n-api.service[104211]: DEBUG dbcounter [-] [104211] Writer thread running {{(pid=104211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:25:11.629705 n-d-836830-4 devstack@n-api.service[104210]: DEBUG dbcounter [-] [104210] Writer thread running {{(pid=104210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:25:11.683585 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.context [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f79e34c-a163-4b02-a0e0-fa1420b72299(cell1) {{(pid=104211) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 14:25:11.687866 n-d-836830-4 devstack@n-api.service[104211]: DEBUG oslo_concurrency.lockutils [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:25:11.689565 n-d-836830-4 devstack@n-api.service[104211]: DEBUG oslo_concurrency.lockutils [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:25:11.691169 n-d-836830-4 devstack@n-api.service[104211]: DEBUG oslo_concurrency.lockutils [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:25:11.692490 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.context [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f79e34c-a163-4b02-a0e0-fa1420b72299(cell1) {{(pid=104210) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 14:25:11.693205 n-d-836830-4 devstack@n-api.service[104211]: DEBUG oslo_concurrency.lockutils [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:25:11.695258 n-d-836830-4 devstack@n-api.service[104211]: INFO dbcounter [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] Registered counter for database nova_cell0 Jun 16 14:25:11.696679 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_concurrency.lockutils [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:25:11.698290 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_concurrency.lockutils [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:25:11.699202 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_concurrency.lockutils [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:25:11.699326 n-d-836830-4 devstack@n-api.service[104211]: INFO dbcounter [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] Registered counter for database nova_cell1 Jun 16 14:25:11.701383 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_concurrency.lockutils [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:25:11.703513 n-d-836830-4 devstack@n-api.service[104210]: INFO dbcounter [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] Registered counter for database nova_cell0 Jun 16 14:25:11.707818 n-d-836830-4 devstack@n-api.service[104211]: DEBUG oslo_db.sqlalchemy.engines [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:25:11.708243 n-d-836830-4 devstack@n-api.service[104210]: INFO dbcounter [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] Registered counter for database nova_cell1 Jun 16 14:25:11.711495 n-d-836830-4 devstack@n-api.service[104211]: DEBUG oslo_db.sqlalchemy.engines [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:25:11.716060 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_db.sqlalchemy.engines [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:25:11.718032 n-d-836830-4 devstack@n-api.service[104211]: DEBUG dbcounter [-] [104211] Writer thread running {{(pid=104211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:25:11.718330 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_db.sqlalchemy.engines [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:25:11.723122 n-d-836830-4 devstack@n-api.service[104210]: DEBUG dbcounter [-] [104210] Writer thread running {{(pid=104210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:25:11.725000 n-d-836830-4 devstack@n-api.service[104211]: DEBUG dbcounter [-] [104211] Writer thread running {{(pid=104211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:25:11.872157 n-d-836830-4 devstack@n-api.service[104210]: DEBUG dbcounter [-] [104210] Writer thread running {{(pid=104210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:25:11.882796 n-d-836830-4 devstack@n-api.service[104210]: INFO dbcounter [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] Registered counter for database nova_cell0 Jun 16 14:25:11.884521 n-d-836830-4 devstack@n-api.service[104211]: INFO dbcounter [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] Registered counter for database nova_cell0 Jun 16 14:25:11.893702 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_db.sqlalchemy.engines [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:25:11.899267 n-d-836830-4 devstack@n-api.service[104210]: DEBUG dbcounter [-] [104210] Writer thread running {{(pid=104210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:25:11.899678 n-d-836830-4 devstack@n-api.service[104211]: DEBUG oslo_db.sqlalchemy.engines [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:25:11.904304 n-d-836830-4 devstack@n-api.service[104211]: DEBUG dbcounter [-] [104211] Writer thread running {{(pid=104211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:25:12.245890 n-d-836830-4 devstack@n-api.service[104210]: WARNING keystonemiddleware.auth_token [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:25:12.253429 n-d-836830-4 devstack@n-api.service[104211]: WARNING keystonemiddleware.auth_token [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:25:12.254002 n-d-836830-4 devstack@n-api.service[104210]: WARNING keystonemiddleware.auth_token [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:25:12.261032 n-d-836830-4 devstack@n-api.service[104211]: WARNING keystonemiddleware.auth_token [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:25:12.610563 n-d-836830-4 devstack@n-api.service[104211]: WARNING keystonemiddleware.auth_token [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:25:12.610814 n-d-836830-4 devstack@n-api.service[104210]: WARNING keystonemiddleware.auth_token [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:25:12.617577 n-d-836830-4 devstack@n-api.service[104211]: WARNING keystonemiddleware.auth_token [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:25:12.617853 n-d-836830-4 devstack@n-api.service[104210]: WARNING keystonemiddleware.auth_token [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:25:12.622903 n-d-836830-4 devstack@n-api.service[104211]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5588d84369c0 pid: 104211 (default app) Jun 16 14:25:12.623251 n-d-836830-4 devstack@n-api.service[104210]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5588d84369c0 pid: 104210 (default app) Jun 16 14:25:12.625062 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:25:12.626274 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-fea6bef5-45fa-44b2-97cd-b9350706334a None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001838 Jun 16 14:25:12.626717 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Thu Jun 16 14:25:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:26:37.576818 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:26:37.578923 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005073 Jun 16 14:26:37.579925 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 16 14:26:37 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:26:37.617026 n-d-836830-4 devstack@n-api.service[104211]: DEBUG dbcounter [-] [104211] Writing DB stats nova_api:SELECT=3 {{(pid=104211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:26:37.619092 n-d-836830-4 devstack@n-api.service[104211]: DEBUG dbcounter [-] [104211] Writing DB stats nova_cell0:SELECT=3 {{(pid=104211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:26:37.621277 n-d-836830-4 devstack@n-api.service[104211]: DEBUG dbcounter [-] [104211] Writing DB stats nova_cell1:SELECT=3 {{(pid=104211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:26:37.623214 n-d-836830-4 devstack@n-api.service[104211]: DEBUG dbcounter [-] [104211] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:26:38.122743 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-dea137cc-546d-446f-a9dc-96239e81473c admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:26:38.156222 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-dea137cc-546d-446f-a9dc-96239e81473c admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.565245 Jun 16 14:26:38.157362 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 2/3] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jun 16 14:26:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:26:40.642161 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:26:40.643750 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-b833e17e-aef4-4b79-846f-a36abe665ff8 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002507 Jun 16 14:26:40.644170 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 2/4] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 16 14:26:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:26:40.720767 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-a8b0992d-3a82-45f6-8167-2d88317f74ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "swap": 0, "ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:26:40.739633 n-d-836830-4 devstack@n-api.service[104211]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:26:40.739633 n-d-836830-4 devstack@n-api.service[104211]: warnings.warn(msg) Jun 16 14:26:40.774451 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-a8b0992d-3a82-45f6-8167-2d88317f74ce admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.123127 Jun 16 14:26:40.775483 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 3/5] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 16 14:26:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:26:40.795167 n-d-836830-4 devstack@n-api.service[104210]: DEBUG dbcounter [-] [104210] Writing DB stats nova_api:SELECT=3 {{(pid=104210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:26:40.797339 n-d-836830-4 devstack@n-api.service[104210]: DEBUG dbcounter [-] [104210] Writing DB stats nova_cell0:SELECT=3 {{(pid=104210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:26:40.798840 n-d-836830-4 devstack@n-api.service[104210]: DEBUG dbcounter [-] [104210] Writing DB stats nova_cell1:SELECT=3 {{(pid=104210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:26:40.799774 n-d-836830-4 devstack@n-api.service[104210]: DEBUG dbcounter [-] [104210] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:26:41.017414 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-a45c8c2a-b686-4e32-8c31-dbdaf1e03727 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:26:41.020211 n-d-836830-4 devstack@n-api.service[104210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:26:41.020211 n-d-836830-4 devstack@n-api.service[104210]: warnings.warn(msg) Jun 16 14:26:41.124760 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-a45c8c2a-b686-4e32-8c31-dbdaf1e03727 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.335708 Jun 16 14:26:41.126283 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 3/6] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jun 16 14:26:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:26:43.537974 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-a8b0992d-3a82-45f6-8167-2d88317f74ce admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:26:43.544582 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-a8b0992d-3a82-45f6-8167-2d88317f74ce admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jun 16 14:26:43.544582 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 4/7] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 16 14:26:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:26:43.673014 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-2ca37adc-cdf9-4529-ba70-e3523cd6ca7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "ram": 512, "vcpus": 1, "swap": 0, "disk": 5, "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:26:43.691489 n-d-836830-4 devstack@n-api.service[104210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:26:43.691489 n-d-836830-4 devstack@n-api.service[104210]: warnings.warn(msg) Jun 16 14:26:43.713723 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-2ca37adc-cdf9-4529-ba70-e3523cd6ca7e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.167073 Jun 16 14:26:43.718473 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 4/8] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 16 14:26:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:26:43.726584 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-8b903400-b530-4a13-92e7-d68ea950e064 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:26:43.728096 n-d-836830-4 devstack@n-api.service[104211]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:26:43.728096 n-d-836830-4 devstack@n-api.service[104211]: warnings.warn(msg) Jun 16 14:26:43.760517 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-8b903400-b530-4a13-92e7-d68ea950e064 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038319 Jun 16 14:26:43.761114 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 5/9] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jun 16 14:26:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:26:46.125179 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-2ca37adc-cdf9-4529-ba70-e3523cd6ca7e admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:26:46.126357 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-2ca37adc-cdf9-4529-ba70-e3523cd6ca7e admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 16 14:26:46.126788 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 16 14:26:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:26:46.207791 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-dbdc37fb-ca12-4c4c-8d8c-e4a58dcaf252 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:26:46.231720 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-dbdc37fb-ca12-4c4c-8d8c-e4a58dcaf252 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.097387 Jun 16 14:26:46.243190 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 6/11] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 16 14:26:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:26:46.259514 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-98f11b27-7840-4b2f-a6e6-c738e2c066de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:26:46.290854 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-98f11b27-7840-4b2f-a6e6-c738e2c066de admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043491 Jun 16 14:26:46.291944 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 6/12] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jun 16 14:26:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:26:49.142134 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-dbdc37fb-ca12-4c4c-8d8c-e4a58dcaf252 admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:26:49.144893 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-dbdc37fb-ca12-4c4c-8d8c-e4a58dcaf252 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002724 Jun 16 14:26:49.150985 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 7/13] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 16 14:26:49 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:26:49.221530 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-7297a763-f4f2-431e-84a4-8f2e0c575495 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "swap": 0, "id": "d3", "ram": 2048, "rxtx_factor": 1.0}} {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:26:49.246755 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-7297a763-f4f2-431e-84a4-8f2e0c575495 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.094266 Jun 16 14:26:49.247810 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 7/14] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 16 14:26:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:26:49.261483 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-1998d1eb-00eb-41ca-a0e7-fd79bcbbc142 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:26:49.291468 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-1998d1eb-00eb-41ca-a0e7-fd79bcbbc142 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034138 Jun 16 14:26:49.293246 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 8/15] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jun 16 14:26:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:26:51.845374 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-7297a763-f4f2-431e-84a4-8f2e0c575495 admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:26:51.848402 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-7297a763-f4f2-431e-84a4-8f2e0c575495 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003550 Jun 16 14:26:51.848981 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 8/16] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 16 14:26:51 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:26:51.920480 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-1c3b0c24-8e5a-40ad-a966-fdada6dd2e73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:26:51.943663 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-1c3b0c24-8e5a-40ad-a966-fdada6dd2e73 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087925 Jun 16 14:26:51.944236 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 9/17] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 16 14:26:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:26:51.956553 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-3373986c-8e80-4ad5-9e62-7379370ed0c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:26:51.985250 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-3373986c-8e80-4ad5-9e62-7379370ed0c5 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032295 Jun 16 14:26:51.998409 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 9/18] 10.222.0.57 () {64 vars in 1335 bytes} [Thu Jun 16 14:26:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:26:54.380464 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-1c3b0c24-8e5a-40ad-a966-fdada6dd2e73 admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:26:54.381646 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-1c3b0c24-8e5a-40ad-a966-fdada6dd2e73 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Jun 16 14:26:54.382321 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 10/19] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 16 14:26:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:26:54.469222 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-3d048d5c-55f1-465f-855a-3c331b97439a admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:26:54.500341 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-3d048d5c-55f1-465f-855a-3c331b97439a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.110726 Jun 16 14:26:54.501323 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 10/20] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jun 16 14:26:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:26:57.080940 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-1c3b0c24-8e5a-40ad-a966-fdada6dd2e73 admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:26:57.083073 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-1c3b0c24-8e5a-40ad-a966-fdada6dd2e73 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002723 Jun 16 14:26:57.096557 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 11/21] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 16 14:26:57 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:26:57.190999 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-9cc897ed-60ca-47f2-8332-af3c03901e81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "id": "1", "swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:26:57.214105 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-9cc897ed-60ca-47f2-8332-af3c03901e81 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.122422 Jun 16 14:26:57.226878 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 11/22] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 16 14:26:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:26:57.228528 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-90ddfea5-a211-4cae-bcfd-1a58726a35fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:26:57.257564 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-90ddfea5-a211-4cae-bcfd-1a58726a35fd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033118 Jun 16 14:26:57.271653 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 12/23] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jun 16 14:26:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:26:59.869661 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-9cc897ed-60ca-47f2-8332-af3c03901e81 admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:26:59.872627 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-9cc897ed-60ca-47f2-8332-af3c03901e81 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003582 Jun 16 14:26:59.890148 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 12/24] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 16 14:26:59 2022] GET /compute/v2.1 => generated 388 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:26:59.967761 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-7ac5ee1e-8613-44fd-b9cf-c91a4fafb092 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true}} {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:26:59.993308 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-7ac5ee1e-8613-44fd-b9cf-c91a4fafb092 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.109786 Jun 16 14:27:00.008436 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-dbbc58d7-7420-4eaf-8c4f-742195342623 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:27:00.013651 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 13/25] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 16 14:26:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:27:00.043332 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-dbbc58d7-7420-4eaf-8c4f-742195342623 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038953 Jun 16 14:27:00.047111 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 13/26] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jun 16 14:27:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:27:02.771068 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-7ac5ee1e-8613-44fd-b9cf-c91a4fafb092 admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:02.772446 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-7ac5ee1e-8613-44fd-b9cf-c91a4fafb092 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001973 Jun 16 14:27:02.773324 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 14/27] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 16 14:27:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:27:02.862217 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-51b75658-54f3-476a-a94c-ebecb9206668 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "id": "3", "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:27:02.886164 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-51b75658-54f3-476a-a94c-ebecb9206668 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.105828 Jun 16 14:27:02.886865 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 14/28] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 16 14:27:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:27:02.901732 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-444801db-02cc-4685-9898-5cbd8399960e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:27:02.929109 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-444801db-02cc-4685-9898-5cbd8399960e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031631 Jun 16 14:27:02.929706 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 15/29] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jun 16 14:27:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:27:05.320985 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-51b75658-54f3-476a-a94c-ebecb9206668 admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:05.322390 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-51b75658-54f3-476a-a94c-ebecb9206668 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001940 Jun 16 14:27:05.322881 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 15/30] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 16 14:27:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:27:05.396611 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-005815f8-bb77-462d-8ae7-0cf6f2086521 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0, "id": "4", "swap": 0, "vcpus": 4}} {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:27:05.419232 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-005815f8-bb77-462d-8ae7-0cf6f2086521 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088078 Jun 16 14:27:05.420176 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 16/31] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 16 14:27:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:27:05.435605 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-d4642116-7e31-40c3-850e-28170e77db2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:27:05.468742 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-d4642116-7e31-40c3-850e-28170e77db2f admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036752 Jun 16 14:27:05.468742 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 16/32] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jun 16 14:27:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:27:08.289257 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-005815f8-bb77-462d-8ae7-0cf6f2086521 admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:08.290273 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-005815f8-bb77-462d-8ae7-0cf6f2086521 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 16 14:27:08.290780 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 17/33] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 16 14:27:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:27:08.367410 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-6fe920a7-0ea0-4bcc-a7d5-0a49bf810d48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "id": "5", "rxtx_factor": 1.0}} {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:27:08.389248 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-6fe920a7-0ea0-4bcc-a7d5-0a49bf810d48 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.091456 Jun 16 14:27:08.389826 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 17/34] 10.222.0.57 () {64 vars in 1282 bytes} [Thu Jun 16 14:27:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:27:08.402131 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-4488c432-9866-4a0b-a64a-52b6c093c703 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:27:08.407577 n-d-836830-4 devstack@n-api.service[104211]: DEBUG dbcounter [-] [104211] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:27:08.435296 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-4488c432-9866-4a0b-a64a-52b6c093c703 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036875 Jun 16 14:27:08.436190 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 18/35] 10.222.0.57 () {64 vars in 1332 bytes} [Thu Jun 16 14:27:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:27:38.898343 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-6fe920a7-0ea0-4bcc-a7d5-0a49bf810d48 admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:38.899566 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-6fe920a7-0ea0-4bcc-a7d5-0a49bf810d48 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 Jun 16 14:27:38.900044 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 18/36] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 16 14:27:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:27:38.911921 n-d-836830-4 devstack@n-api.service[104211]: DEBUG dbcounter [-] [104211] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=104211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:27:38.969174 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-5555698d-d098-4bb7-9f89-5f7236c618e4 admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:38.987655 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-5555698d-d098-4bb7-9f89-5f7236c618e4 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.080621 Jun 16 14:27:38.988113 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 19/37] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jun 16 14:27:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:27:40.041596 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-6fe920a7-0ea0-4bcc-a7d5-0a49bf810d48 admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:40.042662 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-6fe920a7-0ea0-4bcc-a7d5-0a49bf810d48 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 16 14:27:40.043075 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 19/38] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 16 14:27:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:27:40.274734 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-546a8dde-fb31-41e0-ba66-002f20b8b478 admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:40.280487 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.wsgi [None req-546a8dde-fb31-41e0-ba66-002f20b8b478 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-546a8dde-fb31-41e0-ba66-002f20b8b478 admin admin] Request method failure captured: Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: Accept: application/json Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: Accept-Encoding: gzip, deflate Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: Connection: keep-alive Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: Content-Length: 0 Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: Host: 10.222.0.57 Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: Openstack-Api-Version: compute 2.90 Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: Openstack-System-Scope: None Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: User-Agent: python-novaclient Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: X-Auth-Token: gAAAAABiqz3c1VuAT59EL5OiPIyv8RJ0CGq6o7jx1SV_stj2yYAyKQNJ-BEv7HBMmwzzwHnWaYWKoO_90Et4AOUDirY6A_cRrxSdVqg7mdmWAHxkF1ZGBMpzehAihi84vmZ6myYCEsiZTEHg-PUQiPD4LR69rhKyenkFlf0kLzvUpD2gorD3FXw Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: X-Domain-Id: None Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: X-Domain-Name: None Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: X-Identity-Status: Confirmed Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: X-Is-Admin-Project: True Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: X-Project-Domain-Id: default Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: X-Project-Domain-Name: Default Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: X-Project-Id: 279a6742008146e89b6bb238eebf0023 Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: X-Project-Name: admin Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: X-Role: admin,member,reader Jun 16 14:27:40.283802 n-d-836830-4 devstack@n-api.service[104211]: X-Roles: admin,member,reader Jun 16 14:27:40.285424 n-d-836830-4 devstack@n-api.service[104211]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_279a6742008146e89b6bb238eebf0023", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/279a6742008146e89b6bb238eebf0023"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/279a6742008146e89b6bb238eebf0023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/279a6742008146e89b6bb238eebf0023"}]}] Jun 16 14:27:40.285424 n-d-836830-4 devstack@n-api.service[104211]: X-Tenant: admin Jun 16 14:27:40.285424 n-d-836830-4 devstack@n-api.service[104211]: X-Tenant-Id: 279a6742008146e89b6bb238eebf0023 Jun 16 14:27:40.285424 n-d-836830-4 devstack@n-api.service[104211]: X-Tenant-Name: admin Jun 16 14:27:40.285424 n-d-836830-4 devstack@n-api.service[104211]: X-User: admin Jun 16 14:27:40.285424 n-d-836830-4 devstack@n-api.service[104211]: X-User-Domain-Id: default Jun 16 14:27:40.285424 n-d-836830-4 devstack@n-api.service[104211]: X-User-Domain-Name: Default Jun 16 14:27:40.285424 n-d-836830-4 devstack@n-api.service[104211]: X-User-Id: 304c12575b584ac8a3ccec056e156f39 Jun 16 14:27:40.285424 n-d-836830-4 devstack@n-api.service[104211]: X-User-Name: admin Jun 16 14:27:40.285424 n-d-836830-4 devstack@n-api.service[104211]: method: > Jun 16 14:27:40.285424 n-d-836830-4 devstack@n-api.service[104211]: exception: Flavor 42 could not be found. Jun 16 14:27:40.285424 n-d-836830-4 devstack@n-api.service[104211]: action_args: {'id': '42'} Jun 16 14:27:40.285424 n-d-836830-4 devstack@n-api.service[104211]: {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:27:40.285424 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:27:40.287406 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Jun 16 14:27:40.288766 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-546a8dde-fb31-41e0-ba66-002f20b8b478 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:27:40.289850 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-546a8dde-fb31-41e0-ba66-002f20b8b478 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.082042 Jun 16 14:27:40.289850 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 20/39] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 16 14:27:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:27:40.295409 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-bc48f8d9-ce47-4406-807c-39a45b3f5349 admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:40.298581 n-d-836830-4 devstack@n-api.service[104210]: DEBUG dbcounter [-] [104210] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:27:40.321553 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-bc48f8d9-ce47-4406-807c-39a45b3f5349 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029680 Jun 16 14:27:40.322161 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 20/40] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jun 16 14:27:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:27:40.341561 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-3f6e5b59-59b5-4e56-89a6-9d66d8553302 admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:40.365228 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-3f6e5b59-59b5-4e56-89a6-9d66d8553302 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027573 Jun 16 14:27:40.365623 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 21/41] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jun 16 14:27:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:27:40.376587 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-50052f31-024f-4701-8954-75e2bde16ad7 admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:40.385330 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.wsgi [None req-50052f31-024f-4701-8954-75e2bde16ad7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-50052f31-024f-4701-8954-75e2bde16ad7 admin admin] Request method failure captured: Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: Accept: application/json Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: Accept-Encoding: gzip, deflate Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: Connection: keep-alive Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: Content-Length: 0 Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: Host: 10.222.0.57 Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: Openstack-Api-Version: compute 2.90 Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: Openstack-System-Scope: None Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: User-Agent: python-novaclient Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: X-Auth-Token: gAAAAABiqz3c1VuAT59EL5OiPIyv8RJ0CGq6o7jx1SV_stj2yYAyKQNJ-BEv7HBMmwzzwHnWaYWKoO_90Et4AOUDirY6A_cRrxSdVqg7mdmWAHxkF1ZGBMpzehAihi84vmZ6myYCEsiZTEHg-PUQiPD4LR69rhKyenkFlf0kLzvUpD2gorD3FXw Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: X-Domain-Id: None Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: X-Domain-Name: None Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: X-Identity-Status: Confirmed Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: X-Is-Admin-Project: True Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: X-Project-Domain-Id: default Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: X-Project-Domain-Name: Default Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: X-Project-Id: 279a6742008146e89b6bb238eebf0023 Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: X-Project-Name: admin Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: X-Role: admin,member,reader Jun 16 14:27:40.388648 n-d-836830-4 devstack@n-api.service[104210]: X-Roles: admin,member,reader Jun 16 14:27:40.390168 n-d-836830-4 devstack@n-api.service[104210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_279a6742008146e89b6bb238eebf0023", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/279a6742008146e89b6bb238eebf0023"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/279a6742008146e89b6bb238eebf0023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/279a6742008146e89b6bb238eebf0023"}]}] Jun 16 14:27:40.390168 n-d-836830-4 devstack@n-api.service[104210]: X-Tenant: admin Jun 16 14:27:40.390168 n-d-836830-4 devstack@n-api.service[104210]: X-Tenant-Id: 279a6742008146e89b6bb238eebf0023 Jun 16 14:27:40.390168 n-d-836830-4 devstack@n-api.service[104210]: X-Tenant-Name: admin Jun 16 14:27:40.390168 n-d-836830-4 devstack@n-api.service[104210]: X-User: admin Jun 16 14:27:40.390168 n-d-836830-4 devstack@n-api.service[104210]: X-User-Domain-Id: default Jun 16 14:27:40.390168 n-d-836830-4 devstack@n-api.service[104210]: X-User-Domain-Name: Default Jun 16 14:27:40.390168 n-d-836830-4 devstack@n-api.service[104210]: X-User-Id: 304c12575b584ac8a3ccec056e156f39 Jun 16 14:27:40.390168 n-d-836830-4 devstack@n-api.service[104210]: X-User-Name: admin Jun 16 14:27:40.390168 n-d-836830-4 devstack@n-api.service[104210]: method: > Jun 16 14:27:40.390168 n-d-836830-4 devstack@n-api.service[104210]: exception: Flavor 42 could not be found. Jun 16 14:27:40.390168 n-d-836830-4 devstack@n-api.service[104210]: action_args: {'id': '42'} Jun 16 14:27:40.390168 n-d-836830-4 devstack@n-api.service[104210]: {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:27:40.390168 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:27:40.391026 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Jun 16 14:27:40.392257 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-50052f31-024f-4701-8954-75e2bde16ad7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:27:40.393478 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-50052f31-024f-4701-8954-75e2bde16ad7 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017106 Jun 16 14:27:40.393478 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 21/42] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 16 14:27:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:27:41.309971 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-3f6e5b59-59b5-4e56-89a6-9d66d8553302 admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:41.311020 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-3f6e5b59-59b5-4e56-89a6-9d66d8553302 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 16 14:27:41.311411 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 22/43] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 16 14:27:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:27:41.508545 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-b27ae9ca-38cb-459b-91a6-997df663b47c admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:41.513967 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.wsgi [None req-b27ae9ca-38cb-459b-91a6-997df663b47c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-b27ae9ca-38cb-459b-91a6-997df663b47c admin admin] Request method failure captured: Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: Accept: application/json Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: Accept-Encoding: gzip, deflate Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: Connection: keep-alive Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: Content-Length: 0 Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: Host: 10.222.0.57 Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: Openstack-Api-Version: compute 2.90 Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: Openstack-System-Scope: None Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: User-Agent: python-novaclient Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: X-Auth-Token: gAAAAABiqz3dFYj5Ps3U-aSfFDi3GMDQAjpAM0GndBFH5B8_Cws_0yMnagJAF0PiE_hA0C8LaxsDSwCMPeNgiUdeD3rX8HEnebviubWwiClC59yTUU28MypybJqMDIu4F22pOprsEWrEGvbFx_YhwQ3V3YOGDpVweXuEVuf-BimfpFQ9rI6z-9g Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: X-Domain-Id: None Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: X-Domain-Name: None Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: X-Identity-Status: Confirmed Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: X-Is-Admin-Project: True Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: X-Project-Domain-Id: default Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: X-Project-Domain-Name: Default Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: X-Project-Id: 279a6742008146e89b6bb238eebf0023 Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: X-Project-Name: admin Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: X-Role: admin,member,reader Jun 16 14:27:41.515512 n-d-836830-4 devstack@n-api.service[104210]: X-Roles: admin,member,reader Jun 16 14:27:41.517117 n-d-836830-4 devstack@n-api.service[104210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_279a6742008146e89b6bb238eebf0023", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/279a6742008146e89b6bb238eebf0023"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/279a6742008146e89b6bb238eebf0023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/279a6742008146e89b6bb238eebf0023"}]}] Jun 16 14:27:41.517117 n-d-836830-4 devstack@n-api.service[104210]: X-Tenant: admin Jun 16 14:27:41.517117 n-d-836830-4 devstack@n-api.service[104210]: X-Tenant-Id: 279a6742008146e89b6bb238eebf0023 Jun 16 14:27:41.517117 n-d-836830-4 devstack@n-api.service[104210]: X-Tenant-Name: admin Jun 16 14:27:41.517117 n-d-836830-4 devstack@n-api.service[104210]: X-User: admin Jun 16 14:27:41.517117 n-d-836830-4 devstack@n-api.service[104210]: X-User-Domain-Id: default Jun 16 14:27:41.517117 n-d-836830-4 devstack@n-api.service[104210]: X-User-Domain-Name: Default Jun 16 14:27:41.517117 n-d-836830-4 devstack@n-api.service[104210]: X-User-Id: 304c12575b584ac8a3ccec056e156f39 Jun 16 14:27:41.517117 n-d-836830-4 devstack@n-api.service[104210]: X-User-Name: admin Jun 16 14:27:41.517117 n-d-836830-4 devstack@n-api.service[104210]: method: > Jun 16 14:27:41.517117 n-d-836830-4 devstack@n-api.service[104210]: exception: Flavor 84 could not be found. Jun 16 14:27:41.517117 n-d-836830-4 devstack@n-api.service[104210]: action_args: {'id': '84'} Jun 16 14:27:41.517117 n-d-836830-4 devstack@n-api.service[104210]: {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:27:41.517117 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:27:41.518995 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Jun 16 14:27:41.520288 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-b27ae9ca-38cb-459b-91a6-997df663b47c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:27:41.521816 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-b27ae9ca-38cb-459b-91a6-997df663b47c admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063357 Jun 16 14:27:41.521816 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 22/44] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 16 14:27:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:27:41.527607 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-d52bcfae-8ede-4d06-a8d3-06f5b0608968 admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:41.542156 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-d52bcfae-8ede-4d06-a8d3-06f5b0608968 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018035 Jun 16 14:27:41.542763 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 23/45] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jun 16 14:27:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:27:41.553743 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-3dcb9eb5-8320-4314-b68c-e30a9bd9bc27 admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:41.571659 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-3dcb9eb5-8320-4314-b68c-e30a9bd9bc27 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022011 Jun 16 14:27:41.571998 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 23/46] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jun 16 14:27:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:27:41.582589 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-78f42cd0-1664-4206-960b-2d3913c6aca2 admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:41.589679 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.wsgi [None req-78f42cd0-1664-4206-960b-2d3913c6aca2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-78f42cd0-1664-4206-960b-2d3913c6aca2 admin admin] Request method failure captured: Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: Accept: application/json Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: Accept-Encoding: gzip, deflate Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: Connection: keep-alive Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: Content-Length: 0 Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: Host: 10.222.0.57 Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: Openstack-Api-Version: compute 2.90 Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: Openstack-System-Scope: None Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: User-Agent: python-novaclient Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: X-Auth-Token: gAAAAABiqz3dFYj5Ps3U-aSfFDi3GMDQAjpAM0GndBFH5B8_Cws_0yMnagJAF0PiE_hA0C8LaxsDSwCMPeNgiUdeD3rX8HEnebviubWwiClC59yTUU28MypybJqMDIu4F22pOprsEWrEGvbFx_YhwQ3V3YOGDpVweXuEVuf-BimfpFQ9rI6z-9g Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: X-Domain-Id: None Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: X-Domain-Name: None Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: X-Identity-Status: Confirmed Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: X-Is-Admin-Project: True Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: X-Project-Domain-Id: default Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: X-Project-Domain-Name: Default Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: X-Project-Id: 279a6742008146e89b6bb238eebf0023 Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: X-Project-Name: admin Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: X-Role: admin,member,reader Jun 16 14:27:41.591278 n-d-836830-4 devstack@n-api.service[104211]: X-Roles: admin,member,reader Jun 16 14:27:41.592852 n-d-836830-4 devstack@n-api.service[104211]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_279a6742008146e89b6bb238eebf0023", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/279a6742008146e89b6bb238eebf0023"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/279a6742008146e89b6bb238eebf0023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/279a6742008146e89b6bb238eebf0023"}]}] Jun 16 14:27:41.592852 n-d-836830-4 devstack@n-api.service[104211]: X-Tenant: admin Jun 16 14:27:41.592852 n-d-836830-4 devstack@n-api.service[104211]: X-Tenant-Id: 279a6742008146e89b6bb238eebf0023 Jun 16 14:27:41.592852 n-d-836830-4 devstack@n-api.service[104211]: X-Tenant-Name: admin Jun 16 14:27:41.592852 n-d-836830-4 devstack@n-api.service[104211]: X-User: admin Jun 16 14:27:41.592852 n-d-836830-4 devstack@n-api.service[104211]: X-User-Domain-Id: default Jun 16 14:27:41.592852 n-d-836830-4 devstack@n-api.service[104211]: X-User-Domain-Name: Default Jun 16 14:27:41.592852 n-d-836830-4 devstack@n-api.service[104211]: X-User-Id: 304c12575b584ac8a3ccec056e156f39 Jun 16 14:27:41.592852 n-d-836830-4 devstack@n-api.service[104211]: X-User-Name: admin Jun 16 14:27:41.592852 n-d-836830-4 devstack@n-api.service[104211]: method: > Jun 16 14:27:41.592852 n-d-836830-4 devstack@n-api.service[104211]: exception: Flavor 84 could not be found. Jun 16 14:27:41.592852 n-d-836830-4 devstack@n-api.service[104211]: action_args: {'id': '84'} Jun 16 14:27:41.592852 n-d-836830-4 devstack@n-api.service[104211]: {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:27:41.592852 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:27:41.593909 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Jun 16 14:27:41.595297 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-78f42cd0-1664-4206-960b-2d3913c6aca2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:27:41.596682 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-78f42cd0-1664-4206-960b-2d3913c6aca2 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013880 Jun 16 14:27:41.596682 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 24/47] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 16 14:27:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 14:27:42.504018 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-3dcb9eb5-8320-4314-b68c-e30a9bd9bc27 admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:42.505028 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-3dcb9eb5-8320-4314-b68c-e30a9bd9bc27 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 16 14:27:42.505474 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 24/48] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 16 14:27:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:27:42.706077 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-7ead04ac-eb55-4cb2-bc7d-0246f273162b admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:42.712132 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.wsgi [None req-7ead04ac-eb55-4cb2-bc7d-0246f273162b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-7ead04ac-eb55-4cb2-bc7d-0246f273162b admin admin] Request method failure captured: Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: Accept: application/json Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: Accept-Encoding: gzip, deflate Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: Connection: keep-alive Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: Content-Length: 0 Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: Host: 10.222.0.57 Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: Openstack-Api-Version: compute 2.90 Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: Openstack-System-Scope: None Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: User-Agent: python-novaclient Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: X-Auth-Token: gAAAAABiqz3eQQx9D1SXzwLAT9Ltdmijm2VIij7gEPCFYMPCgXFg9mCK0c7_ZnIW4Q0s2fltfUO8cpfAmoaReewrrRTyQVOBegDCSAxAjPnHZv6o9fagEDiko1HSjlc2JVBxz0arHDJ_8kphdGaeUSAqxJwKe35-UTWD1VnEQ-zIqvO7t661hxY Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: X-Domain-Id: None Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: X-Domain-Name: None Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: X-Identity-Status: Confirmed Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: X-Is-Admin-Project: True Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: X-Project-Domain-Id: default Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: X-Project-Domain-Name: Default Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: X-Project-Id: 279a6742008146e89b6bb238eebf0023 Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: X-Project-Name: admin Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: X-Role: admin,member,reader Jun 16 14:27:42.713669 n-d-836830-4 devstack@n-api.service[104211]: X-Roles: admin,member,reader Jun 16 14:27:42.715327 n-d-836830-4 devstack@n-api.service[104211]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_279a6742008146e89b6bb238eebf0023", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/279a6742008146e89b6bb238eebf0023"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/279a6742008146e89b6bb238eebf0023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/279a6742008146e89b6bb238eebf0023"}]}] Jun 16 14:27:42.715327 n-d-836830-4 devstack@n-api.service[104211]: X-Tenant: admin Jun 16 14:27:42.715327 n-d-836830-4 devstack@n-api.service[104211]: X-Tenant-Id: 279a6742008146e89b6bb238eebf0023 Jun 16 14:27:42.715327 n-d-836830-4 devstack@n-api.service[104211]: X-Tenant-Name: admin Jun 16 14:27:42.715327 n-d-836830-4 devstack@n-api.service[104211]: X-User: admin Jun 16 14:27:42.715327 n-d-836830-4 devstack@n-api.service[104211]: X-User-Domain-Id: default Jun 16 14:27:42.715327 n-d-836830-4 devstack@n-api.service[104211]: X-User-Domain-Name: Default Jun 16 14:27:42.715327 n-d-836830-4 devstack@n-api.service[104211]: X-User-Id: 304c12575b584ac8a3ccec056e156f39 Jun 16 14:27:42.715327 n-d-836830-4 devstack@n-api.service[104211]: X-User-Name: admin Jun 16 14:27:42.715327 n-d-836830-4 devstack@n-api.service[104211]: method: > Jun 16 14:27:42.715327 n-d-836830-4 devstack@n-api.service[104211]: exception: Flavor 451 could not be found. Jun 16 14:27:42.715327 n-d-836830-4 devstack@n-api.service[104211]: action_args: {'id': '451'} Jun 16 14:27:42.715327 n-d-836830-4 devstack@n-api.service[104211]: {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:27:42.715327 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:27:42.716239 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: ERROR nova.api.openstack.wsgi Jun 16 14:27:42.717286 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-7ead04ac-eb55-4cb2-bc7d-0246f273162b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:27:42.718325 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-7ead04ac-eb55-4cb2-bc7d-0246f273162b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.065073 Jun 16 14:27:42.718325 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 25/49] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 16 14:27:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:27:42.725158 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-a62290ba-dbfd-40a5-954d-e9b8781ceb64 admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:42.740381 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-a62290ba-dbfd-40a5-954d-e9b8781ceb64 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018474 Jun 16 14:27:42.741012 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 25/50] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jun 16 14:27:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:27:42.753872 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-c6ecabb6-6f55-42a0-a77c-c95f3dce96cd admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:42.767870 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-c6ecabb6-6f55-42a0-a77c-c95f3dce96cd admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017755 Jun 16 14:27:42.768460 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 26/51] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jun 16 14:27:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:27:42.778643 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-683bcac6-edfa-4fea-85bb-cdf938a0de2e admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:42.784110 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.wsgi [None req-683bcac6-edfa-4fea-85bb-cdf938a0de2e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-683bcac6-edfa-4fea-85bb-cdf938a0de2e admin admin] Request method failure captured: Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: Accept: application/json Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: Accept-Encoding: gzip, deflate Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: Connection: keep-alive Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: Content-Length: 0 Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: Host: 10.222.0.57 Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: Openstack-Api-Version: compute 2.90 Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: Openstack-System-Scope: None Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: User-Agent: python-novaclient Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: X-Auth-Token: gAAAAABiqz3eQQx9D1SXzwLAT9Ltdmijm2VIij7gEPCFYMPCgXFg9mCK0c7_ZnIW4Q0s2fltfUO8cpfAmoaReewrrRTyQVOBegDCSAxAjPnHZv6o9fagEDiko1HSjlc2JVBxz0arHDJ_8kphdGaeUSAqxJwKe35-UTWD1VnEQ-zIqvO7t661hxY Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: X-Domain-Id: None Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: X-Domain-Name: None Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: X-Identity-Status: Confirmed Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: X-Is-Admin-Project: True Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: X-Project-Domain-Id: default Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: X-Project-Domain-Name: Default Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: X-Project-Id: 279a6742008146e89b6bb238eebf0023 Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: X-Project-Name: admin Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: X-Role: admin,member,reader Jun 16 14:27:42.785629 n-d-836830-4 devstack@n-api.service[104210]: X-Roles: admin,member,reader Jun 16 14:27:42.787545 n-d-836830-4 devstack@n-api.service[104210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_279a6742008146e89b6bb238eebf0023", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/279a6742008146e89b6bb238eebf0023"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/279a6742008146e89b6bb238eebf0023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/279a6742008146e89b6bb238eebf0023"}]}] Jun 16 14:27:42.787545 n-d-836830-4 devstack@n-api.service[104210]: X-Tenant: admin Jun 16 14:27:42.787545 n-d-836830-4 devstack@n-api.service[104210]: X-Tenant-Id: 279a6742008146e89b6bb238eebf0023 Jun 16 14:27:42.787545 n-d-836830-4 devstack@n-api.service[104210]: X-Tenant-Name: admin Jun 16 14:27:42.787545 n-d-836830-4 devstack@n-api.service[104210]: X-User: admin Jun 16 14:27:42.787545 n-d-836830-4 devstack@n-api.service[104210]: X-User-Domain-Id: default Jun 16 14:27:42.787545 n-d-836830-4 devstack@n-api.service[104210]: X-User-Domain-Name: Default Jun 16 14:27:42.787545 n-d-836830-4 devstack@n-api.service[104210]: X-User-Id: 304c12575b584ac8a3ccec056e156f39 Jun 16 14:27:42.787545 n-d-836830-4 devstack@n-api.service[104210]: X-User-Name: admin Jun 16 14:27:42.787545 n-d-836830-4 devstack@n-api.service[104210]: method: > Jun 16 14:27:42.787545 n-d-836830-4 devstack@n-api.service[104210]: exception: Flavor 451 could not be found. Jun 16 14:27:42.787545 n-d-836830-4 devstack@n-api.service[104210]: action_args: {'id': '451'} Jun 16 14:27:42.787545 n-d-836830-4 devstack@n-api.service[104210]: {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:27:42.787545 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:27:42.788503 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: ERROR nova.api.openstack.wsgi Jun 16 14:27:42.789596 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-683bcac6-edfa-4fea-85bb-cdf938a0de2e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:27:42.790703 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-683bcac6-edfa-4fea-85bb-cdf938a0de2e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012732 Jun 16 14:27:42.790703 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 26/52] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 16 14:27:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:27:43.679632 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-c6ecabb6-6f55-42a0-a77c-c95f3dce96cd admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:43.680663 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-c6ecabb6-6f55-42a0-a77c-c95f3dce96cd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 16 14:27:43.681096 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 27/53] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 16 14:27:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:27:43.876708 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-5db27e83-653f-43dc-81a3-d0198c627632 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:27:43.896604 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-5db27e83-653f-43dc-81a3-d0198c627632 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.073892 Jun 16 14:27:43.897146 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 27/54] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jun 16 14:27:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:27:44.784668 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-c6ecabb6-6f55-42a0-a77c-c95f3dce96cd admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:44.785669 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-c6ecabb6-6f55-42a0-a77c-c95f3dce96cd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 16 14:27:44.787011 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 28/55] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 16 14:27:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:27:44.992810 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-fe77a0f4-2c93-4c2d-8637-eaddb9588a13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:27:45.012223 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-fe77a0f4-2c93-4c2d-8637-eaddb9588a13 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.082107 Jun 16 14:27:45.012783 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 28/56] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jun 16 14:27:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:27:45.922684 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-c6ecabb6-6f55-42a0-a77c-c95f3dce96cd admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:45.923821 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-c6ecabb6-6f55-42a0-a77c-c95f3dce96cd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Jun 16 14:27:45.924181 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 29/57] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 16 14:27:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:27:46.136813 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-e7446f04-46d0-422c-9fb8-76dfef3673b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:27:46.154812 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-e7446f04-46d0-422c-9fb8-76dfef3673b2 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075269 Jun 16 14:27:46.155374 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 29/58] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jun 16 14:27:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:27:47.056160 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-c6ecabb6-6f55-42a0-a77c-c95f3dce96cd admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:47.057651 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-c6ecabb6-6f55-42a0-a77c-c95f3dce96cd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002512 Jun 16 14:27:47.058056 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 30/59] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 16 14:27:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:27:47.254999 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-ca5cd72c-7ec6-4055-bc08-a818bdd4ff2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:27:47.274546 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-ca5cd72c-7ec6-4055-bc08-a818bdd4ff2d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.075275 Jun 16 14:27:47.275023 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 30/60] 10.222.0.57 () {64 vars in 1235 bytes} [Thu Jun 16 14:27:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:27:48.160653 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-c6ecabb6-6f55-42a0-a77c-c95f3dce96cd admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:48.161691 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-c6ecabb6-6f55-42a0-a77c-c95f3dce96cd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jun 16 14:27:48.162082 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 31/61] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 16 14:27:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:27:48.357865 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-ef6b1ddc-30c7-4e22-ac2d-8929a5d70bb7 admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:27:48.379064 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-ef6b1ddc-30c7-4e22-ac2d-8929a5d70bb7 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.079060 Jun 16 14:27:48.380543 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 31/62] 10.222.0.57 () {60 vars in 1202 bytes} [Thu Jun 16 14:27:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:28:38.045616 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-c6ecabb6-6f55-42a0-a77c-c95f3dce96cd admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:28:38.046720 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-c6ecabb6-6f55-42a0-a77c-c95f3dce96cd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 16 14:28:38.047092 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 32/63] 10.222.0.57 () {54 vars in 930 bytes} [Thu Jun 16 14:28:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:28:38.057944 n-d-836830-4 devstack@n-api.service[104210]: DEBUG dbcounter [-] [104210] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:28:38.111430 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-42772995-d84e-494d-842e-177bf2d3ebfe admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:28:38.131226 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-42772995-d84e-494d-842e-177bf2d3ebfe admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077835 Jun 16 14:28:38.133874 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 32/64] 10.222.0.57 () {60 vars in 1291 bytes} [Thu Jun 16 14:28:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:28:38.156871 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-5067bf77-c27d-4e3f-9ed2-657d57c5499a admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:28:38.160405 n-d-836830-4 devstack@n-api.service[104211]: DEBUG dbcounter [-] [104211] Writing DB stats nova_api:SELECT=14 {{(pid=104211) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:28:38.166326 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-5067bf77-c27d-4e3f-9ed2-657d57c5499a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013058 Jun 16 14:28:38.166933 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 33/65] 10.222.0.57 () {60 vars in 1282 bytes} [Thu Jun 16 14:28:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:28:38.179319 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-0c88eb1a-8b88-4b01-bce3-8292a6876bcd admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:28:38.187316 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-0c88eb1a-8b88-4b01-bce3-8292a6876bcd admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011968 Jun 16 14:28:38.188124 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 33/66] 10.222.0.57 () {60 vars in 1285 bytes} [Thu Jun 16 14:28:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:28:38.200693 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-886faccc-b760-4f97-97df-2cd97fbccc27 admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:28:38.209241 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-886faccc-b760-4f97-97df-2cd97fbccc27 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012115 Jun 16 14:28:38.210369 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 34/67] 10.222.0.57 () {60 vars in 1285 bytes} [Thu Jun 16 14:28:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:28:38.222579 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-52d64ebd-d46c-4e8c-8619-d2ff3dedcbee admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:28:38.230882 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-52d64ebd-d46c-4e8c-8619-d2ff3dedcbee admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011713 Jun 16 14:28:38.231202 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 34/68] 10.222.0.57 () {60 vars in 1282 bytes} [Thu Jun 16 14:28:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:34:36.819507 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-886faccc-b760-4f97-97df-2cd97fbccc27 admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:34:36.820683 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-886faccc-b760-4f97-97df-2cd97fbccc27 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 Jun 16 14:34:36.821157 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 35/69] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 16 14:34:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:34:37.030496 n-d-836830-4 devstack@n-api.service[104210]: DEBUG dbcounter [-] [104210] Writing DB stats nova_api:SELECT=6 {{(pid=104210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:34:37.191589 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-320e5d0d-db09-43a1-b1ae-2429261fbb53 admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:34:37.192954 n-d-836830-4 devstack@n-api.service[104210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:34:37.192954 n-d-836830-4 devstack@n-api.service[104210]: warnings.warn(msg) Jun 16 14:34:37.194693 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_concurrency.lockutils [None req-320e5d0d-db09-43a1-b1ae-2429261fbb53 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:34:37.195265 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_concurrency.lockutils [None req-320e5d0d-db09-43a1-b1ae-2429261fbb53 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:34:37.196170 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_concurrency.lockutils [None req-320e5d0d-db09-43a1-b1ae-2429261fbb53 admin admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:34:37.196707 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_concurrency.lockutils [None req-320e5d0d-db09-43a1-b1ae-2429261fbb53 admin admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:34:37.248296 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-320e5d0d-db09-43a1-b1ae-2429261fbb53 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.220353 Jun 16 14:34:37.248896 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 35/70] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 16 14:34:37 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:34:38.345076 n-d-836830-4 devstack@n-api.service[104211]: DEBUG nova.api.openstack.wsgi [None req-886faccc-b760-4f97-97df-2cd97fbccc27 admin admin] Calling method '>' {{(pid=104211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:34:38.346782 n-d-836830-4 devstack@n-api.service[104211]: INFO nova.api.openstack.requestlog [None req-886faccc-b760-4f97-97df-2cd97fbccc27 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002393 Jun 16 14:34:38.347656 n-d-836830-4 devstack@n-api.service[104211]: [pid: 104211|app: 0|req: 36/71] 10.222.0.57 () {56 vars in 1074 bytes} [Thu Jun 16 14:34:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:34:38.682013 n-d-836830-4 devstack@n-api.service[104210]: DEBUG nova.api.openstack.wsgi [None req-e8cbe2e9-ff58-4bb2-a061-b75b6c50e121 admin admin] Calling method '>' {{(pid=104210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:34:38.683389 n-d-836830-4 devstack@n-api.service[104210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:34:38.683389 n-d-836830-4 devstack@n-api.service[104210]: warnings.warn(msg) Jun 16 14:34:38.685315 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_concurrency.lockutils [None req-e8cbe2e9-ff58-4bb2-a061-b75b6c50e121 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:34:38.685756 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_concurrency.lockutils [None req-e8cbe2e9-ff58-4bb2-a061-b75b6c50e121 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:34:38.686592 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_concurrency.lockutils [None req-e8cbe2e9-ff58-4bb2-a061-b75b6c50e121 admin admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:34:38.687014 n-d-836830-4 devstack@n-api.service[104210]: DEBUG oslo_concurrency.lockutils [None req-e8cbe2e9-ff58-4bb2-a061-b75b6c50e121 admin admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:34:38.712470 n-d-836830-4 devstack@n-api.service[104210]: INFO nova.api.openstack.requestlog [None req-e8cbe2e9-ff58-4bb2-a061-b75b6c50e121 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.095942 Jun 16 14:34:38.713115 n-d-836830-4 devstack@n-api.service[104210]: [pid: 104210|app: 0|req: 36/72] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 16 14:34:38 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:35:27.067308 n-d-836830-4 systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 14:35:27.070157 n-d-836830-4 devstack@n-api.service[104209]: Thu Jun 16 14:35:27 2022 - graceful shutdown triggered... Jun 16 14:35:27.070721 n-d-836830-4 devstack@n-api.service[104210]: Gracefully killing worker 1 (pid: 104210)... Jun 16 14:35:27.071725 n-d-836830-4 devstack@n-api.service[104211]: Gracefully killing worker 2 (pid: 104211)... Jun 16 14:35:28.068778 n-d-836830-4 devstack@n-api.service[104209]: worker 1 buried after 1 seconds Jun 16 14:35:28.068778 n-d-836830-4 devstack@n-api.service[104209]: worker 2 buried after 1 seconds Jun 16 14:35:28.068778 n-d-836830-4 devstack@n-api.service[104209]: goodbye to uWSGI. Jun 16 14:35:28.070509 n-d-836830-4 systemd[1]: devstack@n-api.service: Succeeded. Jun 16 14:35:28.071330 n-d-836830-4 systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 14:35:28.075673 n-d-836830-4 systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 14:35:28.095210 n-d-836830-4 devstack@n-api.service[125854]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 14:35:28.112015 n-d-836830-4 devstack@n-api.service[125854]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 14:35:28 2022] *** Jun 16 14:35:28.112015 n-d-836830-4 devstack@n-api.service[125854]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 14:35:28.112015 n-d-836830-4 devstack@n-api.service[125854]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 14:35:28.112015 n-d-836830-4 devstack@n-api.service[125854]: nodename: n-d-836830-4 Jun 16 14:35:28.112015 n-d-836830-4 devstack@n-api.service[125854]: machine: x86_64 Jun 16 14:35:28.112015 n-d-836830-4 devstack@n-api.service[125854]: clock source: unix Jun 16 14:35:28.112015 n-d-836830-4 devstack@n-api.service[125854]: pcre jit disabled Jun 16 14:35:28.112015 n-d-836830-4 devstack@n-api.service[125854]: detected number of CPU cores: 4 Jun 16 14:35:28.112015 n-d-836830-4 devstack@n-api.service[125854]: current working directory: / Jun 16 14:35:28.112015 n-d-836830-4 devstack@n-api.service[125854]: detected binary path: /usr/bin/uwsgi-core Jun 16 14:35:28.112015 n-d-836830-4 devstack@n-api.service[125854]: your processes number limit is 47680 Jun 16 14:35:28.112015 n-d-836830-4 devstack@n-api.service[125854]: your memory page size is 4096 bytes Jun 16 14:35:28.112015 n-d-836830-4 devstack@n-api.service[125854]: detected max file descriptor number: 2048 Jun 16 14:35:28.112015 n-d-836830-4 devstack@n-api.service[125854]: lock engine: pthread robust mutexes Jun 16 14:35:28.113155 n-d-836830-4 devstack@n-api.service[125854]: thunder lock: enabled Jun 16 14:35:28.113155 n-d-836830-4 devstack@n-api.service[125854]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 14:35:28.113155 n-d-836830-4 devstack@n-api.service[125854]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 14:35:28.163050 n-d-836830-4 devstack@n-api.service[125854]: Python main interpreter initialized at 0x556172f6a9c0 Jun 16 14:35:28.163050 n-d-836830-4 devstack@n-api.service[125854]: python threads support enabled Jun 16 14:35:28.163050 n-d-836830-4 devstack@n-api.service[125854]: your server socket listen backlog is limited to 100 connections Jun 16 14:35:28.163050 n-d-836830-4 devstack@n-api.service[125854]: your mercy for graceful operations on workers is 90 seconds Jun 16 14:35:28.163665 n-d-836830-4 devstack@n-api.service[125854]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 14:35:28.163665 n-d-836830-4 devstack@n-api.service[125854]: *** Operational MODE: preforking *** Jun 16 14:35:28.163896 n-d-836830-4 devstack@n-api.service[125854]: *** uWSGI is running in multiple interpreter mode *** Jun 16 14:35:28.163896 n-d-836830-4 devstack@n-api.service[125854]: spawned uWSGI master process (pid: 125854) Jun 16 14:35:28.164070 n-d-836830-4 systemd[1]: Started Devstack devstack@n-api.service. Jun 16 14:35:28.166353 n-d-836830-4 devstack@n-api.service[125854]: spawned uWSGI worker 1 (pid: 125862, cores: 1) Jun 16 14:35:28.166353 n-d-836830-4 devstack@n-api.service[125854]: spawned uWSGI worker 2 (pid: 125863, cores: 1) Jun 16 14:35:28.166353 n-d-836830-4 devstack@n-api.service[125854]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 14:35:28.886576 n-d-836830-4 devstack@n-api.service[125863]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 14:35:28.967519 n-d-836830-4 devstack@n-api.service[125862]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 14:35:30.352635 n-d-836830-4 devstack@n-api.service[125863]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:35:30.352635 n-d-836830-4 devstack@n-api.service[125863]: from cryptography.utils import int_from_bytes Jun 16 14:35:30.353327 n-d-836830-4 devstack@n-api.service[125863]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:35:30.353327 n-d-836830-4 devstack@n-api.service[125863]: from cryptography.utils import int_from_bytes Jun 16 14:35:30.356198 n-d-836830-4 devstack@n-api.service[125862]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:35:30.356198 n-d-836830-4 devstack@n-api.service[125862]: from cryptography.utils import int_from_bytes Jun 16 14:35:30.357065 n-d-836830-4 devstack@n-api.service[125862]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:35:30.357065 n-d-836830-4 devstack@n-api.service[125862]: from cryptography.utils import int_from_bytes Jun 16 14:35:32.913812 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:35:32.914529 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:35:32.914653 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:35:32.915248 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:35:32.915479 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:35:32.916025 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.916607 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.917341 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.917994 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.918526 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.918996 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.919554 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.920046 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.920530 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.920974 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.921303 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.921634 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-4 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.921964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.922306 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.922630 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.923215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.923527 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.923854 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.924163 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.924667 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.925410 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.925974 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.926455 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.926970 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.927457 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.927939 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.928267 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.928745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.929241 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.929562 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.929976 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-4 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.930320 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.930653 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.930971 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.931559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.931880 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.932774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.933213 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.933517 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.933978 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.934507 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.934827 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.935324 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.935656 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.935965 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.936280 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.936599 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.936921 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.937235 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.937536 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.937961 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.938458 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.938952 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.939440 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.939934 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.940184 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.940602 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.940918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.941405 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.941720 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.942036 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.942349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.942683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.942993 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.943311 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.943620 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.943933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.944267 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.944576 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.944904 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.945209 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.945712 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.946145 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.946419 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.946929 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.947280 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.947609 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.948744 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.948909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.949094 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.949734 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.950200 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.950714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.951030 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.951745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.951918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.952122 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.952590 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.952909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.953233 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.953547 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.953860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.954174 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.954494 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.954811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.955091 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.955410 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.955723 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.956038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.956472 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.956735 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.956973 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.958243 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.958243 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.958243 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.958243 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.959319 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.959319 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.959319 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.960174 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.960174 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.960174 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.960764 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.960764 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.961070 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.961298 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.961557 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.961789 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.962796 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.962796 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.962796 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.964077 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.964077 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.964527 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.964762 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.965014 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.966676 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.966676 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.966676 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.966676 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.966676 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.968223 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.968223 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.968223 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.968223 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.968223 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.969415 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:32.969415 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.969415 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.969415 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.970335 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.970335 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.970335 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.971128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.971128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.971605 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.971605 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.972066 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.974049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.974049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.974049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.974049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.974049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.974049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.974049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.976002 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.976002 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.976002 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.976002 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.976002 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.976002 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.977573 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.977573 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.977573 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.977573 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.977573 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.979756 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.979756 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.979756 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.979756 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.979756 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.980736 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.980736 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.981193 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.981193 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.981933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.981933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.982437 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.982437 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.984476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.984476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.984476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.984476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.984476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.984476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.985512 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.985512 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.985512 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.985512 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.989683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.989683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.989683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.989683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.989683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.989683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.989683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.989683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.992509 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.992509 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.992509 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.992509 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.992509 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.992509 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.992509 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.992509 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.995019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.995019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.995019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.995019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.995019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.995019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.995019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.995019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.999092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.999092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.999092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.999092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.999092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.999092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.999092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:32.999092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.005719 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.005719 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.005719 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.005719 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.005719 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.005719 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.005719 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.005719 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.008685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.008685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.008685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.008685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.008685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.008685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.008685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.008685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.011018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.011018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.011018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.011018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.011018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.011018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.011018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.011018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.013082 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.013082 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.013082 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.013082 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.013082 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.013082 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.013082 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.013082 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.014944 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.014944 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.014944 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.014944 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.014944 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.014944 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.014944 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.014944 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.018947 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.018947 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.018947 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.018947 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.018947 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.018947 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.018947 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.018947 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.023860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.023860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.023860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.023860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.023860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.023860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.023860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.023860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.025811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.025811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.025811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.025811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.025811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.025811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.025811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.025811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.030189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.030189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.030189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.030189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.030189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.030189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.030189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.030189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.031940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.031940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.031940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.031940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.031940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.031940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.031940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.031940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.034256 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.034256 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.034256 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.034256 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.034256 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.034256 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.034256 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.034256 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.036050 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.036050 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.036050 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.036050 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.036050 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.036050 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.036050 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.036050 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.038010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.038010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.038010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.038010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.038010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.038010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.038010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.038010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.043860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.043860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.043860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.043860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.043860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.043860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.043860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.043860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.045964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.045964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.045964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.045964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.045964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.045964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.045964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.045964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.048089 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.048089 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.048089 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.048089 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.048089 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.048089 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.048089 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.048089 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.049949 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.049949 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.049949 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.049949 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.049949 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.049949 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.049949 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.049949 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.053737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.053737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.053737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.053737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.053737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.053737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.053737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.053737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.056454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.056454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.056454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.056454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.056454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.056454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.056454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.056454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.058759 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.058759 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.058759 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.058759 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.058759 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.058759 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.058759 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.058759 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.062820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.062820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.062820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.062820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.062820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.062820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.062820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.062820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.064983 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.064983 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.064983 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.064983 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.064983 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.064983 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.064983 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.064983 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.066979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.066979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.066979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.066979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.066979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.066979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.066979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.066979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.069309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.069309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.069309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.069309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.069309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.069309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.069309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.069309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.072816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.072816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.072816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.072816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.072816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.072816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.072816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.072816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.076285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.076285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.076285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.076285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.076285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.076285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.076285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.076285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.078967 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.078967 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.078967 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.078967 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.078967 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.078967 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.078967 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.078967 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.082577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.082577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.082577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.082577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.082577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.082577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.082577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.082577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.085800 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.085800 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.085800 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.085800 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.085800 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.085800 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.085800 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.085800 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.087911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.087911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.087911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.087911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.087911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.087911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.087911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.087911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.090625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.090625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.090625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.090625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.090625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.090625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.090625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.090625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.094218 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.094218 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.094218 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.094218 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.094218 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.094218 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.094218 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.094218 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.096411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.096411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.096411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.096411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.096411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.096411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.096411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.096411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.098625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.098625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.098625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.098625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.098625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.098625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.098625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.098625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.100553 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.100553 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.100553 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.100553 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.100553 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.100553 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.100553 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.100553 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.103813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.103813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.103813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.103813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.103813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.103813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.103813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.103813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.106989 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.106989 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.106989 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.106989 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.106989 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.106989 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.106989 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.106989 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.110629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.110629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.110629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.110629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.110629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.110629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.110629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.110629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.113635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.113635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.113635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.113635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.113635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.113635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.113635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.113635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.116767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.116767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.116767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.116767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.116767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.116767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.116767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.116767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.118974 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.118974 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.118974 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.118974 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.118974 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.118974 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.118974 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.118974 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.123855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.123855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.123855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.123855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.123855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.123855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.123855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.123855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.125870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.125870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.125870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.125870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.125870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.125870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.125870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.125870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.128191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.128191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.128191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.128191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.128191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.128191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.128191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.128191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.130456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.130456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.130456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.130456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.130456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.130456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.130456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.130456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.132591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.132591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.132591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.132591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.132591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.132591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.132591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.132591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.135816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.135816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.135816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.135816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.135816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.135816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.135816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.135816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.138181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.138181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.138181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.138181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.138181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.138181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.138181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.138181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.140493 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.140493 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.140493 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.140493 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.140493 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.140493 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.140493 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.142251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.142251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.142251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.142251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.142251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.142251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.142251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.142251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.145322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.145322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.145322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.145322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.145322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.145322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.145322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.145322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.147227 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.147227 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.147227 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.147227 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.147227 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.147227 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.147227 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.147227 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.149476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.149476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.149476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.149476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.149476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.149476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.149476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.149476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.153594 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.153594 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.153594 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.153594 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.153594 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.153594 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.153594 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.153594 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.155703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.155703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.155703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.155703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.155703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.155703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.155703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.155703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.160849 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.160849 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.160849 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.160849 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.160849 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.160849 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.160849 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.160849 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.164318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.164318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.164318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.164318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.164318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.164318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.164318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.164318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.166304 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.166304 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.166304 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.166304 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.166304 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.166304 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.166304 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.166304 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.168521 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.168521 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.168521 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.168521 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.168521 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.168521 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.168521 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.168521 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.173290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.173290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.173290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.173290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.173290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.173290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.173290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.173290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.176294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.176294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.176294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.176294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.176294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.176294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.176294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.176294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.178138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.178138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.178138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.178138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.178138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.178138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.178138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.178138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.184337 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.184337 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.184337 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.184337 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.184337 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.184337 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.184337 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.184337 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.186255 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.186255 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.186255 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.186255 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.186255 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.186255 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.186255 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.186255 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.188197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.188197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.188197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.188197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.188197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.188197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.188197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.188197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.190061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.190061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.190061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.190061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.190061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.190061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.190061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.190061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.194029 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.194029 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.194029 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.194029 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.194029 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.194029 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.194029 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.194029 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.195900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.195900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.195900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.195900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.195900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.195900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.195900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.195900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.198220 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.198220 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.198220 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.198220 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.198220 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.198220 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.198220 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.198220 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.200449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.200449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.200449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.200449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.200449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.200449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.200449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.200449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.203061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.203061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.203061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.203061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.203061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.203061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.203061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.203061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.204141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.204141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.204141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.204141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.204141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.204141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.204141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.204141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.205235 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.205235 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.205235 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.205235 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.205235 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.205235 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.205235 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.205235 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.206231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.206231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.206231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.206231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.206231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.206231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.206231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.206231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.207292 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.207292 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.207292 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:33.207292 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:35:33.265917 n-d-836830-4 devstack@n-api.service[125862]: INFO dbcounter [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] Registered counter for database nova_api Jun 16 14:35:33.288649 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_db.sqlalchemy.engines [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:35:33.298355 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writer thread running {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:35:33.367039 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.context [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f79e34c-a163-4b02-a0e0-fa1420b72299(cell1) {{(pid=125862) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 14:35:33.373436 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:35:33.375318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:35:33.376212 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:35:33.378278 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:35:33.380538 n-d-836830-4 devstack@n-api.service[125862]: INFO dbcounter [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] Registered counter for database nova_cell0 Jun 16 14:35:33.384939 n-d-836830-4 devstack@n-api.service[125862]: INFO dbcounter [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] Registered counter for database nova_cell1 Jun 16 14:35:33.397149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_db.sqlalchemy.engines [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:35:33.402845 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_db.sqlalchemy.engines [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:35:33.409666 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writer thread running {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:35:33.415434 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writer thread running {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:35:33.607020 n-d-836830-4 devstack@n-api.service[125862]: INFO dbcounter [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] Registered counter for database nova_cell0 Jun 16 14:35:33.619121 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_db.sqlalchemy.engines [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:35:33.626065 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writer thread running {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:35:33.998061 n-d-836830-4 devstack@n-api.service[125862]: WARNING keystonemiddleware.auth_token [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:35:34.005932 n-d-836830-4 devstack@n-api.service[125862]: WARNING keystonemiddleware.auth_token [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:35:34.402750 n-d-836830-4 devstack@n-api.service[125862]: WARNING keystonemiddleware.auth_token [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:35:34.409780 n-d-836830-4 devstack@n-api.service[125862]: WARNING keystonemiddleware.auth_token [None req-d2c310dd-1f3f-4b5a-950f-22e81dadc1e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:35:34.415464 n-d-836830-4 devstack@n-api.service[125862]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556172f6a9c0 pid: 125862 (default app) Jun 16 14:35:34.732037 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:35:34.732790 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:35:34.732942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:35:34.733212 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:35:34.733470 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:35:34.733969 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.734323 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.734571 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.734898 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.735244 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.735570 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.735903 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.736228 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.736562 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.736831 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.737153 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.737481 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-4 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.737807 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.738121 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.738467 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.738801 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.739117 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.739446 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.739759 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.740278 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.740657 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.740890 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.741231 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.741556 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.741873 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.742182 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.742612 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.742932 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.743265 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.743579 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.743997 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-4 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.744317 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.745306 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.745657 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.746234 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.746605 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.746924 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.747253 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.747584 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.747899 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.748248 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.748574 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.748900 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.749224 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.749530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.749845 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.750159 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.750512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.750826 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.751136 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.751392 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.751704 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.752030 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.752353 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.752682 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.752937 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.753194 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.753518 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.753841 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.754152 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.754491 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.754804 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.755113 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.755423 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.755737 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.756046 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.756354 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.756680 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.756998 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.757324 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.757637 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.757959 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.758415 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.758654 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.758967 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.759314 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.759633 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.759946 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.760663 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.760663 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.761306 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.761306 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.761712 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.761867 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.762187 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.762527 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.762784 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.763090 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.763399 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.763723 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.764033 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.764343 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.764649 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.764952 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.765263 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.765577 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.765887 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.766194 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.766530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.766839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.767147 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.767455 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.767760 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.768092 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.768411 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.768721 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.769028 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.769393 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.769702 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.770028 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.770334 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.770681 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.771010 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.771322 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.771632 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.771954 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.772264 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.772572 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.772894 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.773201 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.773509 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.773832 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.774195 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.774592 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.774822 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.775075 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.775382 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.775689 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.776288 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.776473 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.776617 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.776943 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.777270 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.777585 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.777896 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.778203 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.778560 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:35:34.778905 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.779243 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.779591 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.779912 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.780250 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.780585 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.780908 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.781225 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.781544 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.781876 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.782190 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.782537 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.782851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.783174 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.783500 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.784735 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.784735 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.784735 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.785141 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.785141 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.785397 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.785757 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.786088 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.786426 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.786785 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.787142 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.787464 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.787794 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.788267 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.788444 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.788763 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.789079 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.789410 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.789757 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.790074 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.790415 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.790738 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.791128 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.792006 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.792785 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.792785 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.793063 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.793333 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.793658 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.793975 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.794296 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.794650 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.794968 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.795295 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.795642 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.795957 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.796277 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.796593 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.796908 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.797237 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.797574 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.798147 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.798517 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.798835 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.799151 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.799464 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.799789 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.800095 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.800415 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.800733 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.801042 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.801379 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.801691 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.802002 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.802336 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.802671 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.802985 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.803303 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.803620 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.803933 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.804247 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.804560 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.804896 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.805217 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.805530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.805872 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.806208 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.806547 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.806874 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.807983 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.808131 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.808605 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.808742 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.808982 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.809290 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.809597 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.809917 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.810220 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.810557 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.810863 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.811169 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.811475 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.811807 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.812121 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.812430 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.812746 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.813053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.813403 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.813712 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.814061 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.814421 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.814758 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.815085 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.815410 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.815734 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.816029 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.816342 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.816656 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.816967 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.817289 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.817602 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.817925 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.818239 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.818600 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.818917 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.819243 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.819552 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.819872 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.820219 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.820556 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.820877 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.821204 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.821519 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.821844 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.822152 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.822495 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.822989 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.823242 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.823470 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.823760 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.824074 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.824384 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.824722 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.825027 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.825354 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.825669 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.825983 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.826404 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.826764 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.827078 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.827392 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.827718 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.828035 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.828348 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.828666 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.828970 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.829279 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.829611 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.829951 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.830232 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.830579 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.830892 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.831217 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.831524 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.831847 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.832137 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.832452 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.832781 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.833095 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.833421 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.833746 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.834066 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.834411 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.834724 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.835037 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.835344 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.835651 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.835958 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.836306 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.836620 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.836933 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.837250 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.837572 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.837886 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.838204 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.838955 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.839278 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.839607 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.839928 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.840245 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.840567 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.840881 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.841197 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.841511 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.841839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.842160 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.842520 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.842812 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.843238 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.843484 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.843770 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.844376 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.844714 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.845034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.845358 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.845682 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.846004 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.846343 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.846701 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.847049 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.847357 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.847671 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.847979 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.848287 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.848603 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.848910 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.849218 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.849525 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.849837 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.850148 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.850478 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.850789 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.851097 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.851418 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.851727 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.852043 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.852366 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.852683 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.852996 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.853311 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.853617 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.854931 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.854931 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.855395 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.855655 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.856047 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.856293 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.856610 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.856920 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.857267 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.857557 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.857871 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.858181 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.858525 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.858837 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.859149 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.859466 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.859776 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.860090 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.860575 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.860820 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.861011 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.861358 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.861630 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.861942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.862246 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.862577 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.862982 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.863295 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.863697 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.863913 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.864222 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.864541 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.864861 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.865172 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.865480 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.865797 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.866106 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.866521 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.866864 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.867185 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.867497 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.867806 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.868119 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.868425 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.868731 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.869044 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.869367 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.870333 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.870678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.870999 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.871307 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.871612 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.871922 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.872235 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.872542 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.872852 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.873156 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.873459 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.873876 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.874271 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.874623 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.874942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.875271 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.875570 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.875897 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.876206 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.876722 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.876892 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.877260 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.877611 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.877979 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.878294 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.878643 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.878954 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.879275 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.879592 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.879910 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.880219 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.880528 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.880866 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.881178 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.881492 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.881817 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.882146 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.882498 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.882807 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.883123 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.883437 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.883748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.884065 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.884377 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.885143 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.885143 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.886041 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.886041 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.886041 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.886469 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.886599 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.886938 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.887179 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.887572 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.887856 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.888169 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.888479 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.888795 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.889110 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.889415 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.889868 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.890184 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.890553 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.890835 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.891149 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.891464 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.891784 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.892105 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.892416 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.892852 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.893170 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.893491 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.893801 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.894120 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.894460 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.894779 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.895107 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.895421 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.895735 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.897118 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.897566 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.897896 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.898124 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.898720 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.899005 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.899329 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.899763 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.900087 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.900408 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.900828 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.901203 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.901667 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.901982 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.902305 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.902657 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.902991 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.903325 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.903647 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.903974 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.904297 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.904636 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.904973 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.905292 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.905623 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.906062 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.906416 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.906739 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.907067 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.907404 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.907716 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.908028 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.908349 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.908661 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.908972 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.909303 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.909615 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.909934 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.910247 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.910589 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.910901 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.911213 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.911543 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.911857 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.912247 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.912643 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.912915 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.913246 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.913561 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.913892 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.914206 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.914559 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.914875 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.915187 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.915610 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.915926 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.916321 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.917197 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.917544 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.917873 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.918278 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.918626 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.919031 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.919359 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.919754 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.920051 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.920341 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.920667 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.920981 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.921436 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.921743 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.922136 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.922359 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.922706 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.923280 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.923603 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.923914 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.924242 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.924798 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.925778 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.925778 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.925778 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.925778 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.926465 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.926620 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.926909 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.927164 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.927493 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.927809 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.928223 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.928557 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.928863 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.929183 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.929504 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.929824 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.930217 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.930630 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.930951 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.931272 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.931593 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.931925 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.933306 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.933785 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.934455 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.934901 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.935445 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.935896 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.936310 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.936813 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.937187 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.937652 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.938162 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.938678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.939100 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.939618 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.940116 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.940498 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.940916 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.941346 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.941763 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.942609 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.943088 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.943668 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.944152 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.944608 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.945235 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.945776 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.946344 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.946851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.947454 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.948408 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.948951 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.949326 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.949702 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.950089 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.950532 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.950922 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.951347 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.951780 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.952214 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.953155 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.953615 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.954155 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.954746 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.955187 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.955619 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.956052 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.956481 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.956890 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.957308 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.957963 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.958558 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.959219 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.959699 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.960148 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.960561 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.960993 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.961511 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.962357 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.962840 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.963265 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.964502 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.965059 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.965496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.965907 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.966413 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.966855 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.967302 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.967743 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.968264 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.968766 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.969300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.969749 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.970198 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.970649 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.971040 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.971521 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.971988 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.972395 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.972809 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.973286 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.973809 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.974563 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.975141 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.975655 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.976171 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.976719 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.977265 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.977819 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.978411 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.979528 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.980717 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.981185 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.981751 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.982469 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.982946 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.983474 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.984070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.984801 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.985358 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.985915 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.986352 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.986981 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.987411 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.988121 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.988577 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.990271 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.990271 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.990945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.991223 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.991678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.992114 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.992496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.992787 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.993461 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.993995 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.994593 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.996525 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.997075 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.997552 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.997985 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.998419 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.998870 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.999394 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:34.999868 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.000349 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.000887 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.001421 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.002006 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.002436 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.002831 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.003249 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.003681 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.004110 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.004691 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.005142 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.005663 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.006188 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.006653 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.007080 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.007634 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.008082 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.008545 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.009061 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.009504 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.009945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.011325 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.012292 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.012745 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.013174 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.013619 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.014082 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.014596 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.015040 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.015553 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.016035 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.016658 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.017088 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.017522 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.017938 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.018349 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.018788 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.019305 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.019725 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.020144 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.020605 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.021018 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.022499 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.022499 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.022852 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.023083 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.024127 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.024127 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.024588 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.026049 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.026049 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.027654 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.028098 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.028548 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.028990 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.029546 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.030045 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.030585 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.031048 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.031552 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.032017 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.034437 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.034437 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.034437 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.034437 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.035038 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.035484 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.035990 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.036507 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.036965 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.037401 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.037833 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.038264 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.038748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.039191 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.039693 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.040132 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.040570 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.041007 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.041584 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.042597 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.043090 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.043816 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.044134 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.044657 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.045084 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.045514 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.045949 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.046429 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.046910 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.047346 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.048012 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.048452 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.048903 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.049361 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.049854 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.050315 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.051028 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.051510 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.052228 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.052643 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:35:35.052848 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:35:35.130816 n-d-836830-4 devstack@n-api.service[125863]: INFO dbcounter [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] Registered counter for database nova_api Jun 16 14:35:35.155728 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_db.sqlalchemy.engines [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:35:35.166524 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writer thread running {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:35:35.262354 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.context [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f79e34c-a163-4b02-a0e0-fa1420b72299(cell1) {{(pid=125863) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 14:35:35.270857 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:35:35.274435 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:35:35.276808 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:35:35.280997 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:35:35.285065 n-d-836830-4 devstack@n-api.service[125863]: INFO dbcounter [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] Registered counter for database nova_cell0 Jun 16 14:35:35.294590 n-d-836830-4 devstack@n-api.service[125863]: INFO dbcounter [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] Registered counter for database nova_cell1 Jun 16 14:35:35.308232 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_db.sqlalchemy.engines [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:35:35.310453 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_db.sqlalchemy.engines [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:35:35.322009 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writer thread running {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:35:35.331589 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writer thread running {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:35:35.604806 n-d-836830-4 devstack@n-api.service[125863]: INFO dbcounter [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] Registered counter for database nova_cell0 Jun 16 14:35:35.613975 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_db.sqlalchemy.engines [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:35:35.618996 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writer thread running {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:35:35.960150 n-d-836830-4 devstack@n-api.service[125863]: WARNING keystonemiddleware.auth_token [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:35:35.968745 n-d-836830-4 devstack@n-api.service[125863]: WARNING keystonemiddleware.auth_token [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:35:36.325311 n-d-836830-4 devstack@n-api.service[125863]: WARNING keystonemiddleware.auth_token [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:35:36.331632 n-d-836830-4 devstack@n-api.service[125863]: WARNING keystonemiddleware.auth_token [None req-5226f552-dc27-4372-978e-fd86792fc8e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:35:36.337475 n-d-836830-4 devstack@n-api.service[125863]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x556172f6a9c0 pid: 125863 (default app) Jun 16 14:36:26.192428 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=3 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:26.194266 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=3 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:26.196419 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=3 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:26.198256 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=3 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:28.330904 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-535f2125-5f0a-4ac6-818d-d90c0bb8ca04 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Calling method '.version_select at 0x7fdf0e8ed0d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:28.333390 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:28.333390 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:28.340787 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-535f2125-5f0a-4ac6-818d-d90c0bb8ca04 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f79e34c-a163-4b02-a0e0-fa1420b72299(cell1) {{(pid=125862) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 16 14:36:28.341732 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-535f2125-5f0a-4ac6-818d-d90c0bb8ca04 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:28.342187 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-535f2125-5f0a-4ac6-818d-d90c0bb8ca04 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:28.376744 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-535f2125-5f0a-4ac6-818d-d90c0bb8ca04 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:28.377409 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-535f2125-5f0a-4ac6-818d-d90c0bb8ca04 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:28.394253 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-535f2125-5f0a-4ac6-818d-d90c0bb8ca04 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:28.394981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-535f2125-5f0a-4ac6-818d-d90c0bb8ca04 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:28.419047 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-535f2125-5f0a-4ac6-818d-d90c0bb8ca04 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 2.238904 Jun 16 14:36:28.422549 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1207 bytes} [Thu Jun 16 14:36:26 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 2244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:36:28.708736 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-be261b82-95e0-4c64-b4d0-62fbac3dab31 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2067562469"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:28.728071 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:28.728071 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:28.729461 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.aggregate [None req-be261b82-95e0-4c64-b4d0-62fbac3dab31 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Generated uuid 193f16cc-5fc3-40db-ac02-01a98c16033e for aggregate {{(pid=125863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:36:28.740333 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=3 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:28.741524 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=3 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:28.742826 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=3 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:28.743813 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=3 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:28.855714 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-be261b82-95e0-4c64-b4d0-62fbac3dab31 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.415431 Jun 16 14:36:28.862933 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1/2] 10.222.0.57 () {62 vars in 1204 bytes} [Thu Jun 16 14:36:28 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:36:28.867900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f5122fbd-c20e-4b8e-9b71-d1ac0666bf21 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2146908094"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:28.957411 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:28.957411 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:29.115327 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f5122fbd-c20e-4b8e-9b71-d1ac0666bf21 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.250245 Jun 16 14:36:29.116950 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 2/3] 10.222.0.57 () {62 vars in 1209 bytes} [Thu Jun 16 14:36:28 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:36:29.139483 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d76e9e84-34f0-40c3-b340-3c9ddaa2a635 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:29.141832 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:29.141832 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:29.188803 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d76e9e84-34f0-40c3-b340-3c9ddaa2a635 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.061939 Jun 16 14:36:29.203933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2e3040b7-a218-45c5-9482-9d20e5d8743f tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-4"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:29.205533 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:29.205533 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:29.207557 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 2/4] 10.222.0.57 () {60 vars in 1189 bytes} [Thu Jun 16 14:36:29 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:36:29.225219 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2e3040b7-a218-45c5-9482-9d20e5d8743f tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:29.226855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2e3040b7-a218-45c5-9482-9d20e5d8743f tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:31.858323 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2e3040b7-a218-45c5-9482-9d20e5d8743f tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 2.657759 Jun 16 14:36:31.861437 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 3/5] 10.222.0.57 () {62 vars in 1231 bytes} [Thu Jun 16 14:36:29 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 2663 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:36:31.871677 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2e3040b7-a218-45c5-9482-9d20e5d8743f tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:31.873576 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2e3040b7-a218-45c5-9482-9d20e5d8743f tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] 10.222.0.57 "GET /compute//" status: 200 len: 377 microversion: - time: 0.010449 Jun 16 14:36:31.874156 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 4/6] 10.222.0.57 () {56 vars in 885 bytes} [Thu Jun 16 14:36:31 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 16 14:36:32.018704 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-22386306-aaba-4510-9038-80e382b30c27 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '.version_select at 0x7fdf0f120790>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:32.021231 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:32.021231 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:32.041154 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-22386306-aaba-4510-9038-80e382b30c27 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f79e34c-a163-4b02-a0e0-fa1420b72299(cell1) {{(pid=125863) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 16 14:36:32.048984 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-22386306-aaba-4510-9038-80e382b30c27 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:32.052269 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-22386306-aaba-4510-9038-80e382b30c27 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:32.139188 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-22386306-aaba-4510-9038-80e382b30c27 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:32.140515 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-22386306-aaba-4510-9038-80e382b30c27 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:32.169513 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-22386306-aaba-4510-9038-80e382b30c27 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:32.170938 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-22386306-aaba-4510-9038-80e382b30c27 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:32.184914 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-22386306-aaba-4510-9038-80e382b30c27 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.544364 Jun 16 14:36:32.199139 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 3/7] 10.222.0.57 () {58 vars in 1166 bytes} [Thu Jun 16 14:36:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:36:32.676650 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1488b21c-abad-47fc-97d2-2328a2851d8b tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:32.679247 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:32.679247 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:32.682249 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1488b21c-abad-47fc-97d2-2328a2851d8b tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:32.683393 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1488b21c-abad-47fc-97d2-2328a2851d8b tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:32.686323 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1488b21c-abad-47fc-97d2-2328a2851d8b tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:32.687258 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1488b21c-abad-47fc-97d2-2328a2851d8b tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:32.771185 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1488b21c-abad-47fc-97d2-2328a2851d8b tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.886967 Jun 16 14:36:32.772013 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1175 bytes} [Thu Jun 16 14:36:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:32.817906 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-152084852", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:33.281192 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fe2b4093-d621-4746-90d5-9adcd19aa284 tempest-FlavorsV255TestJSON-773160644 tempest-FlavorsV255TestJSON-773160644-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1050741182", "id": 783687842, "os-flavor-access:is_public": "True"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:33.336767 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:33.336767 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:33.406945 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fe2b4093-d621-4746-90d5-9adcd19aa284 tempest-FlavorsV255TestJSON-773160644 tempest-FlavorsV255TestJSON-773160644-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.632646 Jun 16 14:36:33.409088 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 6/9] 10.222.0.57 () {62 vars in 1187 bytes} [Thu Jun 16 14:36:32 2022] POST /compute/v2.1/flavors => generated 446 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:36:33.433683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fdd899e6-d5ea-4141-9d57-5d3cf3b8a0d5 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-4"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:33.436918 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:33.436918 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:33.459000 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fdd899e6-d5ea-4141-9d57-5d3cf3b8a0d5 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:33.460738 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fdd899e6-d5ea-4141-9d57-5d3cf3b8a0d5 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:33.687386 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fdd899e6-d5ea-4141-9d57-5d3cf3b8a0d5 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.274794 Jun 16 14:36:33.688600 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 7/10] 10.222.0.57 () {62 vars in 1231 bytes} [Thu Jun 16 14:36:33 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:36:34.253433 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:36:34.294575 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-afa62901-c191-43b2-be0b-8691234711a6 tempest-FlavorsV255TestJSON-39243438 tempest-FlavorsV255TestJSON-39243438-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:34.398461 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-afa62901-c191-43b2-be0b-8691234711a6 tempest-FlavorsV255TestJSON-39243438 tempest-FlavorsV255TestJSON-39243438-project] 10.222.0.57 "GET /compute/v2.1/flavors/783687842" status: 200 len: 446 microversion: 2.55 time: 0.708118 Jun 16 14:36:34.405419 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 8/11] 10.222.0.57 () {60 vars in 1195 bytes} [Thu Jun 16 14:36:33 2022] GET /compute/v2.1/flavors/783687842 => generated 446 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:36:34.419742 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9356ac32-e06b-4856-a6af-a48eff4eb108 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:34.421297 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:34.421297 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:34.500449 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9356ac32-e06b-4856-a6af-a48eff4eb108 tempest-AggregatesAdminTestV241-118436027 tempest-AggregatesAdminTestV241-118436027-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.092400 Jun 16 14:36:34.510991 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 9/12] 10.222.0.57 () {60 vars in 1192 bytes} [Thu Jun 16 14:36:34 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:34.533336 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-daf99bf7-b4e1-4bdb-adb4-93457553b652 tempest-FlavorsV255TestJSON-773160644 tempest-FlavorsV255TestJSON-773160644-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0eca3f70>, body: {"flavor": {"description": "new"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:34.565477 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:34.565477 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:34.720582 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-daf99bf7-b4e1-4bdb-adb4-93457553b652 tempest-FlavorsV255TestJSON-773160644 tempest-FlavorsV255TestJSON-773160644-project-admin] 10.222.0.57 "PUT /compute/v2.1/flavors/783687842" status: 200 len: 447 microversion: 2.55 time: 0.205481 Jun 16 14:36:34.725558 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 10/13] 10.222.0.57 () {62 vars in 1215 bytes} [Thu Jun 16 14:36:34 2022] PUT /compute/v2.1/flavors/783687842 => generated 447 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:36:34.749820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1e8b4caf-3d60-479a-8589-1f1ac63c8f17 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-257796857"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:34.753713 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:34.753713 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:34.760203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.aggregate [None req-1e8b4caf-3d60-479a-8589-1f1ac63c8f17 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Generated uuid 41179dbc-04d0-44a5-a1af-4197a07e5d0d for aggregate {{(pid=125862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:36:34.858254 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1e8b4caf-3d60-479a-8589-1f1ac63c8f17 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.129334 Jun 16 14:36:34.860991 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 11/14] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:36:34 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:34.866672 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9efdd4f1-238f-4b94-861a-5ccd657306e7 tempest-FlavorsV255TestJSON-39243438 tempest-FlavorsV255TestJSON-39243438-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:34.955732 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:36:34.956750 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:36:34.958529 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:36:34.959738 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:36:34.960723 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:36:34.961461 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9efdd4f1-238f-4b94-861a-5ccd657306e7 tempest-FlavorsV255TestJSON-39243438 tempest-FlavorsV255TestJSON-39243438-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.097702 Jun 16 14:36:34.962125 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 12/15] 10.222.0.57 () {60 vars in 1186 bytes} [Thu Jun 16 14:36:34 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:36:34.988481 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cd415391-6939-4bfe-ada8-caf3a3ba8982 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-4"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:34.991002 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:34.991002 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:35.003937 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:35.004679 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:35.010599 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:35.011950 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:35.016739 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd415391-6939-4bfe-ada8-caf3a3ba8982 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:35.017396 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd415391-6939-4bfe-ada8-caf3a3ba8982 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:35.099601 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Getting quotas for project 8fdb8fc855c04708902f51318244b201. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:36:35.110080 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Getting quotas for user 6304cd29462244fc8559b2be905480c5 and project 8fdb8fc855c04708902f51318244b201. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:36:35.137493 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:36:35.141226 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:36:35.261531 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a9e993de-115e-463f-80af-56ddcf5fb734 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.060135 Jun 16 14:36:35.267906 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 4/16] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:36:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:36:35.277424 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-70fc615b-8ec0-4bb6-90b1-a8b4fdd244c5 tempest-FlavorsV255TestJSON-39243438 tempest-FlavorsV255TestJSON-39243438-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:35.316704 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cd415391-6939-4bfe-ada8-caf3a3ba8982 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.341139 Jun 16 14:36:35.318211 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 13/17] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 16 14:36:34 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:35.497430 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-70fc615b-8ec0-4bb6-90b1-a8b4fdd244c5 tempest-FlavorsV255TestJSON-39243438 tempest-FlavorsV255TestJSON-39243438-project] 10.222.0.57 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.228042 Jun 16 14:36:35.499966 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 5/18] 10.222.0.57 () {60 vars in 1165 bytes} [Thu Jun 16 14:36:35 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:36:35.512894 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b97004ae-1e0e-47ee-878f-63d1b832ac3b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:35.518942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b97004ae-1e0e-47ee-878f-63d1b832ac3b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:35.756200 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b97004ae-1e0e-47ee-878f-63d1b832ac3b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:35.796539 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b97004ae-1e0e-47ee-878f-63d1b832ac3b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1219 microversion: 2.1 time: 0.295281 Jun 16 14:36:35.797416 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 6/19] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:35 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1219 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:35.814188 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cbd27e3b-a99a-4b0a-bcce-c1d35a82440c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-4"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:35.817326 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:35.817326 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:35.842243 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cbd27e3b-a99a-4b0a-bcce-c1d35a82440c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:35.847202 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cbd27e3b-a99a-4b0a-bcce-c1d35a82440c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:35.939845 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-cbd27e3b-a99a-4b0a-bcce-c1d35a82440c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h2-836830-4. Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cbd27e3b-a99a-4b0a-bcce-c1d35a82440c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Request method failure captured: Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 39 Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_uTJYc_qiCMobHgBUvUm2R5ccoChJxTyUqlw1Vvch5jqGntOJSnaX7PKCzD4NERKeGCs-i6ok73XFMNjvEvMCbXhsbb1s8bWgYdVLVldtBKPpJJg1I10ymbbpmr_5y5IVBiUlMwLXFau970NrOLmGv0qlA2KLBrh7OTruRmkMCvuE Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:36:35.962798 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:36:35.966170 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f1eddbbee64342f2b7ec96646902faf2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f1eddbbee64342f2b7ec96646902faf2"}]}] Jun 16 14:36:35.966170 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:35.966170 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:36:35.966170 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:35.966170 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:36:35.966170 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:36:35.966170 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:36:35.966170 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 980421e03edd4f6db8f2414f1bc307cb Jun 16 14:36:35.966170 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:36:35.966170 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:36:35.966170 n-d-836830-4 devstack@n-api.service[125863]: {"add_host": {"host": "n-h2-836830-4"}} Jun 16 14:36:35.966170 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:36:35.966170 n-d-836830-4 devstack@n-api.service[125863]: exception: Aggregate 2 already has host n-h2-836830-4. Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-836830-4'}}} Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result.read() Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:36:35.970088 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-836830-4-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi session.flush() Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 14:36:35.974321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 14:36:35.979594 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:36:35.987487 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result.read() Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-836830-4-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 16, 14, 36, 35, 899554), 'updated_at': None, 'host': 'n-h2-836830-4', 'aggregate_id': 2}] Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:35.994031 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h2-836830-4. Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:35.998187 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h2-836830-4. Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:36:36.002148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:36:36.006367 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h2-836830-4. Jun 16 14:36:36.006367 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:36.006367 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cbd27e3b-a99a-4b0a-bcce-c1d35a82440c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Returning 409 to user: Aggregate 2 already has host n-h2-836830-4. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:36.006367 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cbd27e3b-a99a-4b0a-bcce-c1d35a82440c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.156328 Jun 16 14:36:36.006367 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 7/20] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 16 14:36:35 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jun 16 14:36:36.006367 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cd81ab31-0c88-4b43-b7b5-1b4d96ab7b1e tempest-FlavorsV255TestJSON-773160644 tempest-FlavorsV255TestJSON-773160644-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:36.006367 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:36.006367 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:36.023783 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cd81ab31-0c88-4b43-b7b5-1b4d96ab7b1e tempest-FlavorsV255TestJSON-773160644 tempest-FlavorsV255TestJSON-773160644-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/783687842" status: 202 len: 0 microversion: 2.55 time: 0.050509 Jun 16 14:36:36.024784 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 8/21] 10.222.0.57 () {60 vars in 1198 bytes} [Thu Jun 16 14:36:35 2022] DELETE /compute/v2.1/flavors/783687842 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:36:36.041288 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-60d56028-ae18-4181-b87c-7e17d0374e6f tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-4"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:36.043614 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:36.043614 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:36.054507 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-60d56028-ae18-4181-b87c-7e17d0374e6f tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:36.054967 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-60d56028-ae18-4181-b87c-7e17d0374e6f tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:36.304564 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a71118e1-edcc-4488-999c-daabc320618d tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-547308485", "id": 214162832, "os-flavor-access:is_public": "True"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:36.306730 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:36.306730 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:36.341491 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a71118e1-edcc-4488-999c-daabc320618d tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 1.020540 Jun 16 14:36:36.345101 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 14/22] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:36:35 2022] POST /compute/v2.1/flavors => generated 426 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:36.358596 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c0877a67-e109-49c5-9842-e2ca544d229e tempest-FlavorsV255TestJSON-773160644 tempest-FlavorsV255TestJSON-773160644-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:36.431880 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c0877a67-e109-49c5-9842-e2ca544d229e tempest-FlavorsV255TestJSON-773160644 tempest-FlavorsV255TestJSON-773160644-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.082661 Jun 16 14:36:36.434942 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 15/23] 10.222.0.57 () {60 vars in 1186 bytes} [Thu Jun 16 14:36:36 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:36:36.459262 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a4b2c5da-9421-4e44-b2fa-7e07b690b166 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:36.462282 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:36.462282 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:36.538900 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a4b2c5da-9421-4e44-b2fa-7e07b690b166 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/214162832" status: 202 len: 0 microversion: 2.1 time: 0.101726 Jun 16 14:36:36.543660 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 16/24] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:36:36 2022] DELETE /compute/v2.1/flavors/214162832 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:36:36.554957 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1a74ddc7-22d8-4c62-a38a-63f578b1d4eb tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:36.658137 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1a74ddc7-22d8-4c62-a38a-63f578b1d4eb tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.108128 Jun 16 14:36:36.658813 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 17/25] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:36:36.679692 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-03ceaf84-ebf0-4568-9eac-7a3b1b88d8fa tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-17549955", "id": 1191128621, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:36.718211 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-03ceaf84-ebf0-4568-9eac-7a3b1b88d8fa tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.043848 Jun 16 14:36:36.718986 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 18/26] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:36:36 2022] POST /compute/v2.1/flavors => generated 415 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 16 14:36:36.740735 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-99bfa938-7de9-4c9b-862b-c498d1fdb7ca tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:36.795551 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-99bfa938-7de9-4c9b-862b-c498d1fdb7ca tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.068389 Jun 16 14:36:36.796784 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 19/27] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:36 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:36.815128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d45c815a-b73e-4da0-85aa-b523411663f3 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:36.865919 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d45c815a-b73e-4da0-85aa-b523411663f3 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1191128621" status: 202 len: 0 microversion: 2.1 time: 0.057848 Jun 16 14:36:36.867238 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 20/28] 10.222.0.57 () {58 vars in 1160 bytes} [Thu Jun 16 14:36:36 2022] DELETE /compute/v2.1/flavors/1191128621 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:36:36.874210 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4f692549-be6f-4f63-8e61-d4fdc5f4ef33 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:36.876760 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4f692549-be6f-4f63-8e61-d4fdc5f4ef33 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:36.981520 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-60d56028-ae18-4181-b87c-7e17d0374e6f tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.941876 Jun 16 14:36:36.983143 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 9/29] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 16 14:36:36 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:36.994617 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d551db20-8c80-4e55-af20-cd36771927de tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:37.034024 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d551db20-8c80-4e55-af20-cd36771927de tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048721 Jun 16 14:36:37.039775 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 10/30] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:37.051729 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e702e602-d23b-44f3-a825-edd9667b19c2 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:37.053021 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:37.053021 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:37.136243 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e702e602-d23b-44f3-a825-edd9667b19c2 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.094443 Jun 16 14:36:37.137888 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 11/31] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:36:37 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:36:37.142925 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-401b4001-a22c-4e96-ae40-687eb2609fa1 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1515476838", "id": 1687080461, "os-flavor-access:is_public": "True"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:37.145445 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:37.145445 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:37.185110 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-401b4001-a22c-4e96-ae40-687eb2609fa1 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.045879 Jun 16 14:36:37.186439 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 12/32] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:36:37 2022] POST /compute/v2.1/flavors => generated 429 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:37.191345 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e467a6fd-9103-4aa9-b80c-3f7520770174 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1538827837"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:37.192711 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:37.192711 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:37.193781 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.aggregate [None req-e467a6fd-9103-4aa9-b80c-3f7520770174 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Generated uuid 4bd57a18-b5b5-45fc-9f49-12b3ba541c37 for aggregate {{(pid=125863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:36:37.232054 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e467a6fd-9103-4aa9-b80c-3f7520770174 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044613 Jun 16 14:36:37.240851 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 13/33] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:36:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:37.240851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-028e6589-1644-4ce7-86dc-b69abdc6869f tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2084315349", "name": "tempest-test_aggregate-988198115"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:37.263836 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:37.263836 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:37.264958 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.aggregate [None req-028e6589-1644-4ce7-86dc-b69abdc6869f tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Generated uuid 60b90cbc-de43-44ef-8704-b4fc00490f79 for aggregate {{(pid=125863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:36:37.313565 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-028e6589-1644-4ce7-86dc-b69abdc6869f tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.078965 Jun 16 14:36:37.319663 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 14/34] 10.222.0.57 () {60 vars in 1164 bytes} [Thu Jun 16 14:36:37 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:37.327744 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-11761011-1566-4110-b8b2-1670d5404f91 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:37.329456 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:37.329456 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:37.379331 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-11761011-1566-4110-b8b2-1670d5404f91 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1687080461" status: 202 len: 0 microversion: 2.1 time: 0.061154 Jun 16 14:36:37.380617 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 15/35] 10.222.0.57 () {58 vars in 1160 bytes} [Thu Jun 16 14:36:37 2022] DELETE /compute/v2.1/flavors/1687080461 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:36:38.560467 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-04c5fa48-22c1-49af-b347-6e0c8f6fcd43 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-4"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:38.562258 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:38.562258 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:38.563536 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-04c5fa48-22c1-49af-b347-6e0c8f6fcd43 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'd23610eb709a411cb92d15207c43a1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda8cac04b8b413cabeda47214d22b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-04c5fa48-22c1-49af-b347-6e0c8f6fcd43 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Request method failure captured: Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 39 Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_qVvHjMCXYTg8L6nABQZUCRTUlkcLFE2lbj9ArH8Pxqzra1e4-pJ5Z1GG39CLdRSqqwhmLxQJ5qMxxMwZIaORMZvsd5yodGQ11l-ewZ8xunBrxwlWAZ_4kDd-H89Hc77pgfBRrR9WnKLptFY3KVSCEields_4VKGFbvcm1IH3yqCU Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: eda8cac04b8b413cabeda47214d22b48 Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:36:38.571201 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:36:38.573418 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eda8cac04b8b413cabeda47214d22b48", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eda8cac04b8b413cabeda47214d22b48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eda8cac04b8b413cabeda47214d22b48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eda8cac04b8b413cabeda47214d22b48"}]}] Jun 16 14:36:38.573418 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:36:38.573418 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: eda8cac04b8b413cabeda47214d22b48 Jun 16 14:36:38.573418 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:36:38.573418 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1262169702-project Jun 16 14:36:38.573418 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:36:38.573418 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:36:38.573418 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: d23610eb709a411cb92d15207c43a1cd Jun 16 14:36:38.573418 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702-project Jun 16 14:36:38.573418 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:36:38.573418 n-d-836830-4 devstack@n-api.service[125863]: {"add_host": {"host": "n-h2-836830-4"}} Jun 16 14:36:38.573418 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:36:38.573418 n-d-836830-4 devstack@n-api.service[125863]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h2-836830-4'}}} Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:38.575689 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 16 14:36:38.577564 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:38.579406 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-04c5fa48-22c1-49af-b347-6e0c8f6fcd43 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:38.579406 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-04c5fa48-22c1-49af-b347-6e0c8f6fcd43 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] 10.222.0.57 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 1.190635 Jun 16 14:36:38.581503 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 16/36] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 16 14:36:37 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 1198 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:36:38.594530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ff171930-44fa-4ef6-b052-cadab99299bb tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:38.595900 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:38.595900 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:38.633461 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ff171930-44fa-4ef6-b052-cadab99299bb tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates" status: 200 len: 516 microversion: 2.1 time: 0.051070 Jun 16 14:36:38.635810 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 17/37] 10.222.0.57 () {58 vars in 1142 bytes} [Thu Jun 16 14:36:38 2022] GET /compute/v2.1/os-aggregates => generated 516 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:38.644737 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fdd990c0-74dc-4b94-9b06-f599eb815457 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:38.695569 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fdd990c0-74dc-4b94-9b06-f599eb815457 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057391 Jun 16 14:36:38.706574 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 18/38] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:38.713798 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-52ba5c3e-9160-4a25-9538-f8cbdeed7ebe tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:38.716760 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:38.716760 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:38.769695 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-52ba5c3e-9160-4a25-9538-f8cbdeed7ebe tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.070373 Jun 16 14:36:38.770788 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 19/39] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:36:38 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:36:38.779607 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8f5944e7-747d-4906-ae94-90870d85aa6c tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-4"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:38.781376 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:38.781376 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:38.807837 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8f5944e7-747d-4906-ae94-90870d85aa6c tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:38.812238 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8f5944e7-747d-4906-ae94-90870d85aa6c tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:38.846656 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9,nova_api:DELETE=11 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:39.209287 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8f5944e7-747d-4906-ae94-90870d85aa6c tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 314 microversion: 2.1 time: 0.436577 Jun 16 14:36:39.209926 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 20/40] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 16 14:36:38 2022] POST /compute/v2.1/os-aggregates/4/action => generated 314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:39.227710 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8d911624-d413-4031-bfd9-6236dfcfe588 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2038436722", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:39.230059 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:39.230059 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:39.271206 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8d911624-d413-4031-bfd9-6236dfcfe588 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.060024 Jun 16 14:36:39.290459 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 21/41] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:36:39 2022] POST /compute/v2.1/flavors => generated 507 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:39.310768 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6591fbde-9297-42fe-a293-2719acc296ff tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2010025607"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:39.313550 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:39.313550 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:39.315424 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.aggregate [None req-6591fbde-9297-42fe-a293-2719acc296ff tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Generated uuid 4e7392e7-bd75-4957-9bca-085fc9453651 for aggregate {{(pid=125863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:36:39.370761 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6591fbde-9297-42fe-a293-2719acc296ff tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.071853 Jun 16 14:36:39.374344 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:36:39 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:39.392629 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-011be62b-f1cb-4cad-8a6b-351d83146dcb tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:39.398668 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:39.398668 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:39.476411 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-011be62b-f1cb-4cad-8a6b-351d83146dcb tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/71b9a875-1e5a-43f7-8bb4-9175dbf2356c" status: 202 len: 0 microversion: 2.1 time: 0.099794 Jun 16 14:36:39.477895 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 23/43] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:36:39 2022] DELETE /compute/v2.1/flavors/71b9a875-1e5a-43f7-8bb4-9175dbf2356c => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:36:39.495179 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c323520c-3c51-4499-9cf5-ddd085507b81 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-902365268"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:39.503519 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:39.503519 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:39.538710 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c323520c-3c51-4499-9cf5-ddd085507b81 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:39.542462 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c323520c-3c51-4499-9cf5-ddd085507b81 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:39.630184 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c323520c-3c51-4499-9cf5-ddd085507b81 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:39.633186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c323520c-3c51-4499-9cf5-ddd085507b81 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:39.688957 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-c323520c-3c51-4499-9cf5-ddd085507b81 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-902365268 could not be found. Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c323520c-3c51-4499-9cf5-ddd085507b81 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Request method failure captured: Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 57 Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_uTJYc_qiCMobHgBUvUm2R5ccoChJxTyUqlw1Vvch5jqGntOJSnaX7PKCzD4NERKeGCs-i6ok73XFMNjvEvMCbXhsbb1s8bWgYdVLVldtBKPpJJg1I10ymbbpmr_5y5IVBiUlMwLXFau970NrOLmGv0qlA2KLBrh7OTruRmkMCvuE Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:36:39.709701 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:36:39.711942 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f1eddbbee64342f2b7ec96646902faf2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f1eddbbee64342f2b7ec96646902faf2"}]}] Jun 16 14:36:39.711942 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:39.711942 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:36:39.711942 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:39.711942 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:36:39.711942 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:36:39.711942 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:36:39.711942 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 980421e03edd4f6db8f2414f1bc307cb Jun 16 14:36:39.711942 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:36:39.711942 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:36:39.711942 n-d-836830-4 devstack@n-api.service[125863]: {"add_host": {"host": "tempest-nonexist_host-902365268"}} Jun 16 14:36:39.711942 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:36:39.711942 n-d-836830-4 devstack@n-api.service[125863]: exception: Compute host tempest-nonexist_host-902365268 could not be found. Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-902365268'}}} Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-902365268' is not mapped to any cell Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:39.713221 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jun 16 14:36:39.715591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-902365268 could not be found. Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-902365268 could not be found. Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:39.717577 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:39.724799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:39.724799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:39.724799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:39.724799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:36:39.724799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:36:39.724799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-902365268 could not be found. Jun 16 14:36:39.724799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:39.724799 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c323520c-3c51-4499-9cf5-ddd085507b81 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-902365268 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:39.724799 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c323520c-3c51-4499-9cf5-ddd085507b81 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 110 microversion: 2.1 time: 0.242233 Jun 16 14:36:39.724799 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 24/44] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 16 14:36:39 2022] POST /compute/v2.1/os-aggregates/5/action => generated 110 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:36:39.739591 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-68043b0f-b411-4aee-8558-b617e0b7e0f3 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:39.783958 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-68043b0f-b411-4aee-8558-b617e0b7e0f3 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057500 Jun 16 14:36:39.804475 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 25/45] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:39.814708 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-4f692549-be6f-4f63-8e61-d4fdc5f4ef33 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:39.815762 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-43c53d42-4105-44b1-b0ed-d50aa62ed534 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:39.816924 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:39.816924 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:39.878167 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-43c53d42-4105-44b1-b0ed-d50aa62ed534 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.071707 Jun 16 14:36:39.881552 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 26/46] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:36:39 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:36:39.915421 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4f692549-be6f-4f63-8e61-d4fdc5f4ef33 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1219 microversion: 2.1 time: 3.045162 Jun 16 14:36:39.923925 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 21/47] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:36 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1219 bytes in 3056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:39.948844 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-67c3b29c-7a97-41b4-8b91-eb86f61aeb27 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2099538241", "id": "618882b5-4711-410c-9c70-e681f3677e10", "os-flavor-access:is_public": "True"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:39.967410 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:39.967410 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:40.049338 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-67c3b29c-7a97-41b4-8b91-eb86f61aeb27 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.123107 Jun 16 14:36:40.054916 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 22/48] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:36:39 2022] POST /compute/v2.1/flavors => generated 507 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:40.077846 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1caf69cf-c7d0-4639-bf94-5dd8ae0bef90 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1caf69cf-c7d0-4639-bf94-5dd8ae0bef90 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Request method failure captured: Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 283 Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_uTJYc_qiCMobHgBUvUm2R5ccoChJxTyUqlw1Vvch5jqGntOJSnaX7PKCzD4NERKeGCs-i6ok73XFMNjvEvMCbXhsbb1s8bWgYdVLVldtBKPpJJg1I10ymbbpmr_5y5IVBiUlMwLXFau970NrOLmGv0qlA2KLBrh7OTruRmkMCvuE Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:36:40.111610 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:36:40.113702 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f1eddbbee64342f2b7ec96646902faf2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f1eddbbee64342f2b7ec96646902faf2"}]}] Jun 16 14:36:40.113702 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:40.113702 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:36:40.113702 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:40.113702 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:36:40.113702 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:40.113702 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:40.113702 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 980421e03edd4f6db8f2414f1bc307cb Jun 16 14:36:40.113702 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:36:40.113702 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:36:40.113702 n-d-836830-4 devstack@n-api.service[125862]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 16 14:36:40.114809 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:36:40.114809 n-d-836830-4 devstack@n-api.service[125862]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 14:36:40.114809 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 16 14:36:40.114809 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:40.114809 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:40.114809 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:36:40.114809 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:36:40.114809 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:36:40.114809 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:36:40.114809 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 14:36:40.114809 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:36:40.115918 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:36:40.119388 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:36:40.119388 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:36:40.119388 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:36:40.119388 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:36:40.119388 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 14:36:40.119388 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.119388 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:40.119388 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.119388 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:40.119388 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:40.119388 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:40.119388 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:36:40.119388 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:36:40.124106 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 14:36:40.124106 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.124106 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1caf69cf-c7d0-4639-bf94-5dd8ae0bef90 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:40.124106 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1caf69cf-c7d0-4639-bf94-5dd8ae0bef90 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.058557 Jun 16 14:36:40.124798 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 23/49] 10.222.0.57 () {60 vars in 1164 bytes} [Thu Jun 16 14:36:40 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:36:40.157043 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-beb823f9-af73-469a-bfaa-88989f4310e6 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:40.169713 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:40.169713 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:40.190807 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:40.272410 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-beb823f9-af73-469a-bfaa-88989f4310e6 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/618882b5-4711-410c-9c70-e681f3677e10" status: 202 len: 0 microversion: 2.1 time: 0.151755 Jun 16 14:36:40.274292 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 24/50] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:36:40 2022] DELETE /compute/v2.1/flavors/618882b5-4711-410c-9c70-e681f3677e10 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:36:40.293447 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b2340a14-3cf3-4f44-b6c6-a3e5a9398e1e tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b2340a14-3cf3-4f44-b6c6-a3e5a9398e1e tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Request method failure captured: Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 27 Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_uTJYc_qiCMobHgBUvUm2R5ccoChJxTyUqlw1Vvch5jqGntOJSnaX7PKCzD4NERKeGCs-i6ok73XFMNjvEvMCbXhsbb1s8bWgYdVLVldtBKPpJJg1I10ymbbpmr_5y5IVBiUlMwLXFau970NrOLmGv0qlA2KLBrh7OTruRmkMCvuE Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:36:40.309418 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:36:40.311629 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f1eddbbee64342f2b7ec96646902faf2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f1eddbbee64342f2b7ec96646902faf2"}]}] Jun 16 14:36:40.311629 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:40.311629 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:36:40.311629 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:40.311629 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:36:40.311629 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:40.311629 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:40.311629 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 980421e03edd4f6db8f2414f1bc307cb Jun 16 14:36:40.311629 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:36:40.311629 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:36:40.311629 n-d-836830-4 devstack@n-api.service[125862]: {"aggregate": {"name": ""}} Jun 16 14:36:40.311629 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:36:40.311629 n-d-836830-4 devstack@n-api.service[125862]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'body': {'aggregate': {'name': ''}}} Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi '' Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:40.312885 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 16 14:36:40.315094 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.319946 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b2340a14-3cf3-4f44-b6c6-a3e5a9398e1e tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:40.321913 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b2340a14-3cf3-4f44-b6c6-a3e5a9398e1e tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.045192 Jun 16 14:36:40.323174 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:36:40 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:36:40.346448 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6b8cfb80-a951-42d3-9ede-4a1ab20e1438 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:40.384891 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6b8cfb80-a951-42d3-9ede-4a1ab20e1438 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059823 Jun 16 14:36:40.389184 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 26/52] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:40.413778 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-40e762f8-aae4-4ea5-8026-34ac1efba49b tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1729118612"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:40.415500 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:40.415500 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:40.419687 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-40e762f8-aae4-4ea5-8026-34ac1efba49b tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'd23610eb709a411cb92d15207c43a1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda8cac04b8b413cabeda47214d22b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-40e762f8-aae4-4ea5-8026-34ac1efba49b tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Request method failure captured: Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 60 Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_qVvHjMCXYTg8L6nABQZUCRTUlkcLFE2lbj9ArH8Pxqzra1e4-pJ5Z1GG39CLdRSqqwhmLxQJ5qMxxMwZIaORMZvsd5yodGQ11l-ewZ8xunBrxwlWAZ_4kDd-H89Hc77pgfBRrR9WnKLptFY3KVSCEields_4VKGFbvcm1IH3yqCU Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: eda8cac04b8b413cabeda47214d22b48 Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:36:40.428758 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:36:40.429869 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eda8cac04b8b413cabeda47214d22b48", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eda8cac04b8b413cabeda47214d22b48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eda8cac04b8b413cabeda47214d22b48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eda8cac04b8b413cabeda47214d22b48"}]}] Jun 16 14:36:40.429869 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:36:40.429869 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: eda8cac04b8b413cabeda47214d22b48 Jun 16 14:36:40.429869 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:36:40.429869 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1262169702-project Jun 16 14:36:40.429869 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:40.429869 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:40.429869 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: d23610eb709a411cb92d15207c43a1cd Jun 16 14:36:40.429869 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702-project Jun 16 14:36:40.429869 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:36:40.429869 n-d-836830-4 devstack@n-api.service[125862]: {"aggregate": {"name": "tempest-test_aggregate-1729118612"}} Jun 16 14:36:40.429869 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:36:40.429869 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1729118612'}}} Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:36:40.430581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:36:40.431506 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 16 14:36:40.432488 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.437872 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-40e762f8-aae4-4ea5-8026-34ac1efba49b tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:40.439071 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-40e762f8-aae4-4ea5-8026-34ac1efba49b tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.040085 Jun 16 14:36:40.443770 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 27/53] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:36:40 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:36:40.451644 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9f6738d2-9867-434d-b19d-42aa110731ca tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1009084818", "id": 2107124730, "os-flavor-access:is_public": "True"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:40.498785 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9f6738d2-9867-434d-b19d-42aa110731ca tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.053481 Jun 16 14:36:40.500583 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 28/54] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:36:40 2022] POST /compute/v2.1/flavors => generated 414 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:40.516345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8e0da2f8-9132-47fc-a257-ef3c89df5268 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1435669561"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:40.519290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.aggregate [None req-8e0da2f8-9132-47fc-a257-ef3c89df5268 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Generated uuid 954c3ccc-7e3b-457e-942b-989568d5e9e8 for aggregate {{(pid=125862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:36:40.578863 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-930355585", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "availability_zone": "tempest-test_az-2084315349"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:40.579910 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8e0da2f8-9132-47fc-a257-ef3c89df5268 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068206 Jun 16 14:36:40.581267 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 29/55] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:36:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:40.603115 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0ce9ac7b-507f-41e9-8967-a0d419e6e08f tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:40.618556 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:40.623816 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:40.625220 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:40.625852 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:40.640903 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0ce9ac7b-507f-41e9-8967-a0d419e6e08f tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/2107124730" status: 200 len: 414 microversion: 2.1 time: 0.054969 Jun 16 14:36:40.649554 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 30/56] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:36:40 2022] GET /compute/v2.1/flavors/2107124730 => generated 414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:40.659564 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-81f39594-daec-41aa-9033-fc715417b955 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1435669561"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:40.661196 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:40.661196 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:40.662994 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.aggregate [None req-81f39594-daec-41aa-9033-fc715417b955 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Generated uuid dd17da60-ef2a-4c44-86dc-1c53d106597f for aggregate {{(pid=125862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:36:40.688566 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-81f39594-daec-41aa-9033-fc715417b955 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1435669561 already exists. Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-81f39594-daec-41aa-9033-fc715417b955 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Request method failure captured: Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 60 Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_uTJYc_qiCMobHgBUvUm2R5ccoChJxTyUqlw1Vvch5jqGntOJSnaX7PKCzD4NERKeGCs-i6ok73XFMNjvEvMCbXhsbb1s8bWgYdVLVldtBKPpJJg1I10ymbbpmr_5y5IVBiUlMwLXFau970NrOLmGv0qlA2KLBrh7OTruRmkMCvuE Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:36:40.704678 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:36:40.705927 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f1eddbbee64342f2b7ec96646902faf2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f1eddbbee64342f2b7ec96646902faf2"}]}] Jun 16 14:36:40.705927 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:40.705927 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:36:40.705927 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:40.705927 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:36:40.705927 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:40.705927 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:40.705927 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 980421e03edd4f6db8f2414f1bc307cb Jun 16 14:36:40.705927 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:36:40.705927 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:36:40.705927 n-d-836830-4 devstack@n-api.service[125862]: {"aggregate": {"name": "tempest-test_aggregate-1435669561"}} Jun 16 14:36:40.705927 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:36:40.705927 n-d-836830-4 devstack@n-api.service[125862]: exception: Aggregate tempest-test_aggregate-1435669561 already exists. Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1435669561'}}} Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi aggregate.create() Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jun 16 14:36:40.706735 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1435669561 already exists. Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:36:40.707749 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jun 16 14:36:40.708791 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 16 14:36:40.708791 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1435669561 already exists. Jun 16 14:36:40.708791 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.708791 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:40.708791 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.708791 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:40.708791 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:40.708791 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:40.708791 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:36:40.708791 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:36:40.708791 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1435669561 already exists. Jun 16 14:36:40.708791 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:40.718029 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-81f39594-daec-41aa-9033-fc715417b955 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1435669561 already exists. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:40.719174 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-81f39594-daec-41aa-9033-fc715417b955 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.068565 Jun 16 14:36:40.723043 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 31/57] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:36:40 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:36:40.903366 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:36:41.347203 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:36:41.347768 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:36:41.348389 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:36:41.348944 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:36:41.349479 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:36:41.369889 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:41.370537 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:41.372157 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:41.372830 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:41.423306 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Getting quotas for project 4cfdcf1f9642426b998a940c5e5c43fa. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:36:41.435769 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Getting quotas for user c0f2fd6f3d4745d9aa2db33414a43384 and project 4cfdcf1f9642426b998a940c5e5c43fa. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:36:41.464585 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:36:41.470294 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:36:41.575181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-74f685cc-51b8-41e0-9e8f-93c6048ff9bf tempest-FlavorsAdminTestJSON-256614870 tempest-FlavorsAdminTestJSON-256614870-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:41.578872 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d5a375cb-1d24-4b45-96f0-d5b8ffec4b29 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.695475 Jun 16 14:36:41.580208 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 27/58] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:36:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:36:41.594578 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d0c928fe-28f8-4d5b-ab92-f1994e4180d1 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:41.600376 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:41.600376 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:41.644662 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-74f685cc-51b8-41e0-9e8f-93c6048ff9bf tempest-FlavorsAdminTestJSON-256614870 tempest-FlavorsAdminTestJSON-256614870-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.920024 Jun 16 14:36:41.645165 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 32/59] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:40 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:41.720914 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6c040310-c137-48ca-9e42-789bf7f67f0a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:41.721688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6c040310-c137-48ca-9e42-789bf7f67f0a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:41.727999 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d0c928fe-28f8-4d5b-ab92-f1994e4180d1 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.146389 Jun 16 14:36:41.734780 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 28/60] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:36:41 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:36:41.746776 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2e28c59e-9aa3-44df-9752-5d2fd535e3e0 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:41.748180 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2e28c59e-9aa3-44df-9752-5d2fd535e3e0 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:41.750533 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c040310-c137-48ca-9e42-789bf7f67f0a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:41.751720 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c040310-c137-48ca-9e42-789bf7f67f0a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:41.753436 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c040310-c137-48ca-9e42-789bf7f67f0a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:41.754419 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c040310-c137-48ca-9e42-789bf7f67f0a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:41.965188 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2e28c59e-9aa3-44df-9752-5d2fd535e3e0 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:41.979108 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2e28c59e-9aa3-44df-9752-5d2fd535e3e0 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1242 microversion: 2.1 time: 0.242955 Jun 16 14:36:41.983304 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 29/61] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:41 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1242 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:42.003455 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d50dfec8-d088-4c1e-889a-672b0a283409 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:42.006035 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:42.006035 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:42.089344 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d50dfec8-d088-4c1e-889a-672b0a283409 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/2107124730" status: 202 len: 0 microversion: 2.1 time: 0.104532 Jun 16 14:36:42.101364 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 30/62] 10.222.0.57 () {58 vars in 1160 bytes} [Thu Jun 16 14:36:41 2022] DELETE /compute/v2.1/flavors/2107124730 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:36:42.120336 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b219f72a-c4b3-4c5b-b1eb-39fde79c9f79 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-385218516"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:42.130715 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:42.130715 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:42.135278 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.aggregate [None req-b219f72a-c4b3-4c5b-b1eb-39fde79c9f79 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Generated uuid 9be2fa64-3de6-4db8-bd1d-1a73fa79280b for aggregate {{(pid=125863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:36:42.280903 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b219f72a-c4b3-4c5b-b1eb-39fde79c9f79 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.168145 Jun 16 14:36:42.288435 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 31/63] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:36:42 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:42.334801 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4937812a-0101-44be-aeee-6274aa0d00de tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:42.432070 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4937812a-0101-44be-aeee-6274aa0d00de tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.137938 Jun 16 14:36:42.453291 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 32/64] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:42.472906 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7d0ad405-2b59-4eb3-b03f-0d8e71972529 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:42.476352 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:42.476352 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:42.483080 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7d0ad405-2b59-4eb3-b03f-0d8e71972529 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'd23610eb709a411cb92d15207c43a1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda8cac04b8b413cabeda47214d22b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7d0ad405-2b59-4eb3-b03f-0d8e71972529 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Request method failure captured: Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_qVvHjMCXYTg8L6nABQZUCRTUlkcLFE2lbj9ArH8Pxqzra1e4-pJ5Z1GG39CLdRSqqwhmLxQJ5qMxxMwZIaORMZvsd5yodGQ11l-ewZ8xunBrxwlWAZ_4kDd-H89Hc77pgfBRrR9WnKLptFY3KVSCEields_4VKGFbvcm1IH3yqCU Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: eda8cac04b8b413cabeda47214d22b48 Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:36:42.493114 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:36:42.494604 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eda8cac04b8b413cabeda47214d22b48", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eda8cac04b8b413cabeda47214d22b48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eda8cac04b8b413cabeda47214d22b48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eda8cac04b8b413cabeda47214d22b48"}]}] Jun 16 14:36:42.494604 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:36:42.494604 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: eda8cac04b8b413cabeda47214d22b48 Jun 16 14:36:42.494604 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:36:42.494604 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1262169702-project Jun 16 14:36:42.494604 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:36:42.494604 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:36:42.494604 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: d23610eb709a411cb92d15207c43a1cd Jun 16 14:36:42.494604 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702-project Jun 16 14:36:42.494604 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:36:42.494604 n-d-836830-4 devstack@n-api.service[125863]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 16 14:36:42.494604 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '7'} Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:42.495222 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 16 14:36:42.496780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:42.499788 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7d0ad405-2b59-4eb3-b03f-0d8e71972529 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:42.504827 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7d0ad405-2b59-4eb3-b03f-0d8e71972529 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.049925 Jun 16 14:36:42.506977 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 33/65] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:36:42 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:36:42.521272 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e8d7e3f7-8759-4b74-91c1-616671abe867 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2044558431", "id": 434552135, "os-flavor-access:is_public": "False"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:42.523386 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:42.523386 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:42.570266 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e8d7e3f7-8759-4b74-91c1-616671abe867 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.060739 Jun 16 14:36:42.583254 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:36:42 2022] POST /compute/v2.1/flavors => generated 427 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:42.596724 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d51eee6e-b031-44d6-9427-4d969b014884 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:42.704414 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d51eee6e-b031-44d6-9427-4d969b014884 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.118849 Jun 16 14:36:42.708650 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:42.710420 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 35/67] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:36:42 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:36:42.742355 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-85dd22e6-f9d3-44d1-a78c-a9ba9125290f tempest-FlavorsAdminTestJSON-256614870 tempest-FlavorsAdminTestJSON-256614870-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "434552135"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:42.816665 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-85dd22e6-f9d3-44d1-a78c-a9ba9125290f tempest-FlavorsAdminTestJSON-256614870 tempest-FlavorsAdminTestJSON-256614870-project] HTTP exception thrown: Flavor 434552135 could not be found. Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-85dd22e6-f9d3-44d1-a78c-a9ba9125290f tempest-FlavorsAdminTestJSON-256614870 tempest-FlavorsAdminTestJSON-256614870-project] Request method failure captured: Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 106 Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_w2xS6asyJV6ozulaPTCvby0ufXEYpsp8EZmbQHqW2oX3nFEegK3CdUlnOyfV_4Xq0DbDZbU4ulWgKIqd2CrBfImraXqyRr8tKkDd1FvN8i-xtO4n2f8_NDu5-DoDAD2WSl279Q_CGSUkcxQ3IfZ_fcmK6I1bzDVOAimA-_I2G4kQ Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 8aa8bf01164941179d7474da5e1570b6 Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-FlavorsAdminTestJSON-256614870 Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:36:42.820093 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:36:42.821612 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8aa8bf01164941179d7474da5e1570b6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8aa8bf01164941179d7474da5e1570b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8aa8bf01164941179d7474da5e1570b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8aa8bf01164941179d7474da5e1570b6"}]}] Jun 16 14:36:42.821612 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-FlavorsAdminTestJSON-256614870 Jun 16 14:36:42.821612 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 8aa8bf01164941179d7474da5e1570b6 Jun 16 14:36:42.821612 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-256614870 Jun 16 14:36:42.821612 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-FlavorsAdminTestJSON-256614870-project Jun 16 14:36:42.821612 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:36:42.821612 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:36:42.821612 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 13f459a4468f4b0daf80e0fb3117c6e6 Jun 16 14:36:42.821612 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-FlavorsAdminTestJSON-256614870-project Jun 16 14:36:42.821612 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:36:42.821612 n-d-836830-4 devstack@n-api.service[125863]: {"server": {"name": "test", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "434552135"}} Jun 16 14:36:42.821612 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:36:42.821612 n-d-836830-4 devstack@n-api.service[125863]: exception: Flavor 434552135 could not be found. Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '3c5b2063-0858-477e-a4dd-6736a4c60e42', 'flavorRef': '434552135'}}} Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 434552135 could not be found. Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:42.822559 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 434552135 could not be found. Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:42.823731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:42.825770 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:42.825770 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:36:42.825770 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:36:42.825770 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 434552135 could not be found. Jun 16 14:36:42.825770 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:42.825770 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-85dd22e6-f9d3-44d1-a78c-a9ba9125290f tempest-FlavorsAdminTestJSON-256614870 tempest-FlavorsAdminTestJSON-256614870-project] Returning 400 to user: Flavor 434552135 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:42.825770 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-85dd22e6-f9d3-44d1-a78c-a9ba9125290f tempest-FlavorsAdminTestJSON-256614870 tempest-FlavorsAdminTestJSON-256614870-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.109640 Jun 16 14:36:42.847246 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 36/68] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:36:42 2022] POST /compute/v2.1/servers => generated 80 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:36:42.853474 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-dc758f45-ed6e-403b-a46d-6363e511e976 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:42.859891 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:42.859891 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:42.897412 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-dc758f45-ed6e-403b-a46d-6363e511e976 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-dc758f45-ed6e-403b-a46d-6363e511e976 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Request method failure captured: Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_uTJYc_qiCMobHgBUvUm2R5ccoChJxTyUqlw1Vvch5jqGntOJSnaX7PKCzD4NERKeGCs-i6ok73XFMNjvEvMCbXhsbb1s8bWgYdVLVldtBKPpJJg1I10ymbbpmr_5y5IVBiUlMwLXFau970NrOLmGv0qlA2KLBrh7OTruRmkMCvuE Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:36:42.899228 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:36:42.900417 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f1eddbbee64342f2b7ec96646902faf2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f1eddbbee64342f2b7ec96646902faf2"}]}] Jun 16 14:36:42.900417 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:42.900417 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:36:42.900417 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:42.900417 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:36:42.900417 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:36:42.900417 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:36:42.900417 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 980421e03edd4f6db8f2414f1bc307cb Jun 16 14:36:42.900417 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:36:42.900417 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:36:42.900417 n-d-836830-4 devstack@n-api.service[125863]: exception: Aggregate -1 could not be found. Jun 16 14:36:42.900417 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '-1'} Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 16 14:36:42.901196 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:42.902134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:42.904249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:42.904249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:42.904249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:36:42.904249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:36:42.904249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 16 14:36:42.904249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:36:42.905733 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-dc758f45-ed6e-403b-a46d-6363e511e976 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:42.911270 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-dc758f45-ed6e-403b-a46d-6363e511e976 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.062674 Jun 16 14:36:42.912483 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 37/69] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jun 16 14:36:42 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:36:42.935852 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7c6ae9cc-ad9d-4bb0-9e53-fffd7cc58356 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:42.938497 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:42.938497 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:42.972348 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6c040310-c137-48ca-9e42-789bf7f67f0a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:42.986535 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7c6ae9cc-ad9d-4bb0-9e53-fffd7cc58356 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/434552135" status: 202 len: 0 microversion: 2.1 time: 0.072549 Jun 16 14:36:42.991972 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 38/70] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:36:42 2022] DELETE /compute/v2.1/flavors/434552135 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:36:42.998197 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-273056c8-e1f0-493e-bd9b-84cab6f9311c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-899311602"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:43.011425 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:43.011425 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:43.013128 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.aggregate [None req-273056c8-e1f0-493e-bd9b-84cab6f9311c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Generated uuid f0314121-f637-4a46-b730-8ca3404bbcfa for aggregate {{(pid=125863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:36:43.021206 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6c040310-c137-48ca-9e42-789bf7f67f0a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1277 microversion: 2.1 time: 1.328818 Jun 16 14:36:43.029701 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 33/71] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:41 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1277 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:43.037721 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9,nova_api:DELETE=15 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:43.075662 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-38ef50a4-f806-4392-8fba-44b687f489ae tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:43.086726 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-273056c8-e1f0-493e-bd9b-84cab6f9311c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.093201 Jun 16 14:36:43.106803 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 39/72] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:36:42 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:43.128327 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8dcb46d9-fb0d-4132-a835-830a41b3a59a tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:43.131259 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8dcb46d9-fb0d-4132-a835-830a41b3a59a tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:43.165122 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-38ef50a4-f806-4392-8fba-44b687f489ae tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.132515 Jun 16 14:36:43.167428 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 34/73] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:43.181953 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fc03616b-73d2-493a-853a-ed61c9b5b762 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:43.184591 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:43.184591 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:43.191769 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fc03616b-73d2-493a-853a-ed61c9b5b762 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'd23610eb709a411cb92d15207c43a1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda8cac04b8b413cabeda47214d22b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fc03616b-73d2-493a-853a-ed61c9b5b762 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Request method failure captured: Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_qVvHjMCXYTg8L6nABQZUCRTUlkcLFE2lbj9ArH8Pxqzra1e4-pJ5Z1GG39CLdRSqqwhmLxQJ5qMxxMwZIaORMZvsd5yodGQ11l-ewZ8xunBrxwlWAZ_4kDd-H89Hc77pgfBRrR9WnKLptFY3KVSCEields_4VKGFbvcm1IH3yqCU Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: eda8cac04b8b413cabeda47214d22b48 Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:36:43.198651 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:36:43.200874 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eda8cac04b8b413cabeda47214d22b48", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eda8cac04b8b413cabeda47214d22b48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eda8cac04b8b413cabeda47214d22b48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eda8cac04b8b413cabeda47214d22b48"}]}] Jun 16 14:36:43.200874 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:36:43.200874 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: eda8cac04b8b413cabeda47214d22b48 Jun 16 14:36:43.200874 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:36:43.200874 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1262169702-project Jun 16 14:36:43.200874 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:43.200874 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:43.200874 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: d23610eb709a411cb92d15207c43a1cd Jun 16 14:36:43.200874 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702-project Jun 16 14:36:43.200874 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:36:43.200874 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 16 14:36:43.200874 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '8'} Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:43.201638 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 16 14:36:43.203680 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:43.208395 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fc03616b-73d2-493a-853a-ed61c9b5b762 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:43.212658 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fc03616b-73d2-493a-853a-ed61c9b5b762 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] 10.222.0.57 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.039803 Jun 16 14:36:43.217398 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 35/74] 10.222.0.57 () {58 vars in 1148 bytes} [Thu Jun 16 14:36:43 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:36:43.234525 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8f4848d4-714d-4e82-98c1-01f1adb2a55d tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-580396452", "id": 897634086, "os-flavor-access:is_public": "False"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:43.241964 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:43.241964 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:43.291386 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8f4848d4-714d-4e82-98c1-01f1adb2a55d tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.070978 Jun 16 14:36:43.296596 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 36/75] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:36:43 2022] POST /compute/v2.1/flavors => generated 411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:43.313220 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5a4ad94a-a3d9-485e-a9a1-d4d3555cf40d tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:43.319632 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:43.319632 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:43.401678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8dcb46d9-fb0d-4132-a835-830a41b3a59a tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:43.429415 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8dcb46d9-fb0d-4132-a835-830a41b3a59a tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1242 microversion: 2.1 time: 0.320997 Jun 16 14:36:43.442537 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 40/76] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:43 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1242 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:43.456790 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5a4ad94a-a3d9-485e-a9a1-d4d3555cf40d tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.143742 Jun 16 14:36:43.459481 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 37/77] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:36:43 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:36:43.474800 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fe656994-f82d-4a82-a791-d933dd22ea01 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-235896141", "id": 1740735793, "os-flavor-access:is_public": "True"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:43.487623 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8aab8582-77aa-4731-9e01-c1ce0594109c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:43.492656 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:43.492656 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:43.494132 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:43.494132 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:43.522098 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-8aab8582-77aa-4731-9e01-c1ce0594109c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8aab8582-77aa-4731-9e01-c1ce0594109c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Request method failure captured: Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_uTJYc_qiCMobHgBUvUm2R5ccoChJxTyUqlw1Vvch5jqGntOJSnaX7PKCzD4NERKeGCs-i6ok73XFMNjvEvMCbXhsbb1s8bWgYdVLVldtBKPpJJg1I10ymbbpmr_5y5IVBiUlMwLXFau970NrOLmGv0qlA2KLBrh7OTruRmkMCvuE Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:36:43.533073 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:36:43.535872 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f1eddbbee64342f2b7ec96646902faf2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f1eddbbee64342f2b7ec96646902faf2"}]}] Jun 16 14:36:43.535872 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:43.535872 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:36:43.535872 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:36:43.535872 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:36:43.535872 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:43.535872 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:43.535872 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 980421e03edd4f6db8f2414f1bc307cb Jun 16 14:36:43.535872 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:36:43.535872 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:36:43.535872 n-d-836830-4 devstack@n-api.service[125862]: exception: Aggregate -1 could not be found. Jun 16 14:36:43.535872 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '-1'} Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:43.537066 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 16 14:36:43.539056 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:43.547705 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8aab8582-77aa-4731-9e01-c1ce0594109c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:43.549455 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8aab8582-77aa-4731-9e01-c1ce0594109c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.081857 Jun 16 14:36:43.563399 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 38/78] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:36:43 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 14:36:43.598623 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-866bee3b-23ca-42ea-b757-32db3a48cf02 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:43.601875 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fe656994-f82d-4a82-a791-d933dd22ea01 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.152454 Jun 16 14:36:43.603098 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:43.603098 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:43.609664 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-866bee3b-23ca-42ea-b757-32db3a48cf02 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'd23610eb709a411cb92d15207c43a1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda8cac04b8b413cabeda47214d22b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:43.617138 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 41/79] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:36:43 2022] POST /compute/v2.1/flavors => generated 413 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-866bee3b-23ca-42ea-b757-32db3a48cf02 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Request method failure captured: Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_qVvHjMCXYTg8L6nABQZUCRTUlkcLFE2lbj9ArH8Pxqzra1e4-pJ5Z1GG39CLdRSqqwhmLxQJ5qMxxMwZIaORMZvsd5yodGQ11l-ewZ8xunBrxwlWAZ_4kDd-H89Hc77pgfBRrR9WnKLptFY3KVSCEields_4VKGFbvcm1IH3yqCU Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: eda8cac04b8b413cabeda47214d22b48 Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:36:43.623239 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:36:43.624790 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eda8cac04b8b413cabeda47214d22b48", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eda8cac04b8b413cabeda47214d22b48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eda8cac04b8b413cabeda47214d22b48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eda8cac04b8b413cabeda47214d22b48"}]}] Jun 16 14:36:43.624790 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:36:43.624790 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: eda8cac04b8b413cabeda47214d22b48 Jun 16 14:36:43.624790 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:36:43.624790 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1262169702-project Jun 16 14:36:43.624790 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:43.624790 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:43.624790 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: d23610eb709a411cb92d15207c43a1cd Jun 16 14:36:43.624790 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702-project Jun 16 14:36:43.624790 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:36:43.624790 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 16 14:36:43.624790 n-d-836830-4 devstack@n-api.service[125862]: action_args: {} Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:43.625584 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 16 14:36:43.627738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:43.631824 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-866bee3b-23ca-42ea-b757-32db3a48cf02 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:43.635940 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-866bee3b-23ca-42ea-b757-32db3a48cf02 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] 10.222.0.57 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.064559 Jun 16 14:36:43.638430 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-218a335a-b63d-469e-b7c0-cde3c5577410 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:43.645132 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 39/80] 10.222.0.57 () {58 vars in 1142 bytes} [Thu Jun 16 14:36:43 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 75 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:36:43.732612 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-218a335a-b63d-469e-b7c0-cde3c5577410 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.097285 Jun 16 14:36:43.739431 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 42/81] 10.222.0.57 () {58 vars in 1168 bytes} [Thu Jun 16 14:36:43 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:43.747747 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-45c802fe-0102-4086-867e-d94d12692a9a tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:43.829209 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-45c802fe-0102-4086-867e-d94d12692a9a tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.088218 Jun 16 14:36:43.841084 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 40/82] 10.222.0.57 () {58 vars in 1176 bytes} [Thu Jun 16 14:36:43 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:36:43.852954 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ed9d4a1c-b7ac-4484-b785-876c63c1a4b6 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:43.877303 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ed9d4a1c-b7ac-4484-b785-876c63c1a4b6 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.027384 Jun 16 14:36:43.881056 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 43/83] 10.222.0.57 () {58 vars in 1170 bytes} [Thu Jun 16 14:36:43 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:43.895807 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c01cdb9e-8611-43c9-98b6-7b6b5066d753 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:43.925453 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c01cdb9e-8611-43c9-98b6-7b6b5066d753 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.035832 Jun 16 14:36:43.926715 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 41/84] 10.222.0.57 () {58 vars in 1168 bytes} [Thu Jun 16 14:36:43 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:43.938320 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c56edf14-8245-4a51-81f0-5598d684b761 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:43.991977 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c56edf14-8245-4a51-81f0-5598d684b761 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.056819 Jun 16 14:36:43.992653 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 44/85] 10.222.0.57 () {58 vars in 1168 bytes} [Thu Jun 16 14:36:43 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:36:44.010520 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c340b4d8-0604-4ceb-9e28-d11fb23024d5 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:44.042455 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0037aafe-6ce8-4727-8dfa-6cfd9472301f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:44.044125 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0037aafe-6ce8-4727-8dfa-6cfd9472301f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:44.074929 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0037aafe-6ce8-4727-8dfa-6cfd9472301f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:44.075891 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0037aafe-6ce8-4727-8dfa-6cfd9472301f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:44.084248 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0037aafe-6ce8-4727-8dfa-6cfd9472301f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:44.088493 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0037aafe-6ce8-4727-8dfa-6cfd9472301f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:44.110198 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c340b4d8-0604-4ceb-9e28-d11fb23024d5 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.104371 Jun 16 14:36:44.116139 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 42/86] 10.222.0.57 () {58 vars in 1174 bytes} [Thu Jun 16 14:36:44 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:44.141219 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-96630e5c-7a2f-4029-86e4-4929b121361f tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:44.246567 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-96630e5c-7a2f-4029-86e4-4929b121361f tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.118780 Jun 16 14:36:44.247223 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 43/87] 10.222.0.57 () {58 vars in 1172 bytes} [Thu Jun 16 14:36:44 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:44.272820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bf5d24d3-b754-4e46-b348-2587b7de631e tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:44.379432 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bf5d24d3-b754-4e46-b348-2587b7de631e tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.120544 Jun 16 14:36:44.388298 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 44/88] 10.222.0.57 () {58 vars in 1168 bytes} [Thu Jun 16 14:36:44 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:36:44.414111 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0db0fb55-6272-4cbb-8edd-ad529369bad7 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:44.420507 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:44.420507 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:44.495412 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0db0fb55-6272-4cbb-8edd-ad529369bad7 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1740735793" status: 202 len: 0 microversion: 2.1 time: 0.093783 Jun 16 14:36:44.499170 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 45/89] 10.222.0.57 () {58 vars in 1160 bytes} [Thu Jun 16 14:36:44 2022] DELETE /compute/v2.1/flavors/1740735793 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:36:44.525063 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ec02f77e-5d2f-4890-9784-79c04265ebcd tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:44.526948 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ec02f77e-5d2f-4890-9784-79c04265ebcd tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:44.563443 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec02f77e-5d2f-4890-9784-79c04265ebcd tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:44.569726 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec02f77e-5d2f-4890-9784-79c04265ebcd tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:44.572514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec02f77e-5d2f-4890-9784-79c04265ebcd tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:44.585433 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec02f77e-5d2f-4890-9784-79c04265ebcd tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:45.082995 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ec02f77e-5d2f-4890-9784-79c04265ebcd tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:45.156733 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ec02f77e-5d2f-4890-9784-79c04265ebcd tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1242 microversion: 2.1 time: 0.653698 Jun 16 14:36:45.165195 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 46/90] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:44 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1242 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:45.209175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b405bb19-615b-407b-a685-94bc3f1635c8 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:45.345392 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b405bb19-615b-407b-a685-94bc3f1635c8 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.177707 Jun 16 14:36:45.358020 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 47/91] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:45.375613 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-af34c5b9-3eae-42ea-a1e1-0560184622ad tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:45.377231 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:45.377231 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:45.482361 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-af34c5b9-3eae-42ea-a1e1-0560184622ad tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/897634086" status: 202 len: 0 microversion: 2.1 time: 0.122076 Jun 16 14:36:45.486275 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 48/92] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:36:45 2022] DELETE /compute/v2.1/flavors/897634086 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:36:45.513142 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cbe9c374-623a-47cd-96ee-08041131a99c tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:45.640759 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cbe9c374-623a-47cd-96ee-08041131a99c tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.145400 Jun 16 14:36:45.656912 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 49/93] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:45.674593 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-79953e7f-ac92-442e-a88b-bccb5d27cab3 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1510553740", "id": 428582427, "os-flavor-access:is_public": "False"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:45.696561 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:45.696561 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:45.779246 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-79953e7f-ac92-442e-a88b-bccb5d27cab3 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.113820 Jun 16 14:36:45.785597 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 50/94] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:36:45 2022] POST /compute/v2.1/flavors => generated 412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:45.827437 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fbb81ba6-77e0-4b77-b801-ed5538951f8d tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:45.930160 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fbb81ba6-77e0-4b77-b801-ed5538951f8d tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.140301 Jun 16 14:36:45.932259 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 51/95] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:45.953686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e5a70359-8d85-4746-a072-f98c4e5a9cef tempest-FlavorsAdminTestJSON-256614870 tempest-FlavorsAdminTestJSON-256614870-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:46.041001 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e5a70359-8d85-4746-a072-f98c4e5a9cef tempest-FlavorsAdminTestJSON-256614870 tempest-FlavorsAdminTestJSON-256614870-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.097444 Jun 16 14:36:46.049107 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 52/96] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:46.074062 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2cc40587-500d-40ec-acce-2fcc89afa364 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:46.179129 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2cc40587-500d-40ec-acce-2fcc89afa364 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/428582427" status: 202 len: 0 microversion: 2.1 time: 0.111543 Jun 16 14:36:46.179129 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 53/97] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:36:46 2022] DELETE /compute/v2.1/flavors/428582427 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 14:36:46.191528 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ee29cebc-8767-44f7-a4b3-65a1eb6944bc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:46.192458 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ee29cebc-8767-44f7-a4b3-65a1eb6944bc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:46.213530 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ee29cebc-8767-44f7-a4b3-65a1eb6944bc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:46.213530 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ee29cebc-8767-44f7-a4b3-65a1eb6944bc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:46.230823 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ee29cebc-8767-44f7-a4b3-65a1eb6944bc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:46.232989 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ee29cebc-8767-44f7-a4b3-65a1eb6944bc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:46.496808 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0037aafe-6ce8-4727-8dfa-6cfd9472301f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:46.580620 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0037aafe-6ce8-4727-8dfa-6cfd9472301f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 2.543593 Jun 16 14:36:46.597737 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 45/98] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:44 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 2562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:46.644424 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b5809ccd-f454-4ee9-82da-f73d082a6485 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:46.828692 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b5809ccd-f454-4ee9-82da-f73d082a6485 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.214008 Jun 16 14:36:46.831861 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 46/99] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:46.849051 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-da4b33a7-0c31-4c81-8a2d-c5bd561a9d20 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1951333579", "id": 260075049, "os-flavor-access:is_public": "True"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:46.851375 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:46.851375 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:46.880654 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-da4b33a7-0c31-4c81-8a2d-c5bd561a9d20 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.035653 Jun 16 14:36:46.888548 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 47/100] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:36:46 2022] POST /compute/v2.1/flavors => generated 411 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:36:46.896311 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-48e7f5f6-b471-45e4-b0e5-5d8ced765246 tempest-FlavorsAdminTestJSON-256614870 tempest-FlavorsAdminTestJSON-256614870-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:46.935971 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-48e7f5f6-b471-45e4-b0e5-5d8ced765246 tempest-FlavorsAdminTestJSON-256614870 tempest-FlavorsAdminTestJSON-256614870-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.045606 Jun 16 14:36:46.947024 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 48/101] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:46 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:46.952928 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-30dc3517-78bb-42cd-9883-4997f609f3b4 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:46.954101 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:46.954101 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:36:46.981635 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-30dc3517-78bb-42cd-9883-4997f609f3b4 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/260075049" status: 202 len: 0 microversion: 2.1 time: 0.033045 Jun 16 14:36:46.983722 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 49/102] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:36:46 2022] DELETE /compute/v2.1/flavors/260075049 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:36:47.026832 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7bedf651-f921-4409-8c1c-9b06c311d683 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:47.142715 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7bedf651-f921-4409-8c1c-9b06c311d683 tempest-FlavorsAdminTestJSON-698505765 tempest-FlavorsAdminTestJSON-698505765-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.150502 Jun 16 14:36:47.144876 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 50/103] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:36:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:47.242805 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ee29cebc-8767-44f7-a4b3-65a1eb6944bc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:47.300370 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ee29cebc-8767-44f7-a4b3-65a1eb6944bc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1298 microversion: 2.1 time: 1.092584 Jun 16 14:36:47.305231 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 54/104] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:46 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1298 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:47.631637 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2454ad17-263d-4ee8-a690-d80b16a5412a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:47.633188 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2454ad17-263d-4ee8-a690-d80b16a5412a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:47.693376 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2454ad17-263d-4ee8-a690-d80b16a5412a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:47.701833 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2454ad17-263d-4ee8-a690-d80b16a5412a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:47.707077 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2454ad17-263d-4ee8-a690-d80b16a5412a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:47.711279 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2454ad17-263d-4ee8-a690-d80b16a5412a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:48.312587 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2454ad17-263d-4ee8-a690-d80b16a5412a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:48.337270 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2454ad17-263d-4ee8-a690-d80b16a5412a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 0.705903 Jun 16 14:36:48.354303 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 51/105] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:47 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:48.392481 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f142cf10-b77b-4794-b134-ec41ead31cac tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:48.396714 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f142cf10-b77b-4794-b134-ec41ead31cac tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:48.439646 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f142cf10-b77b-4794-b134-ec41ead31cac tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:48.443796 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f142cf10-b77b-4794-b134-ec41ead31cac tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:48.450309 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f142cf10-b77b-4794-b134-ec41ead31cac tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:48.454628 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f142cf10-b77b-4794-b134-ec41ead31cac tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:48.669696 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f142cf10-b77b-4794-b134-ec41ead31cac tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:48.696350 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f142cf10-b77b-4794-b134-ec41ead31cac tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1296 microversion: 2.1 time: 0.340396 Jun 16 14:36:48.703758 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 52/106] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:48 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1296 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:49.368690 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-26738a57-ecbe-401f-a95a-8fdcb333d792 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:49.369585 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-26738a57-ecbe-401f-a95a-8fdcb333d792 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:49.391763 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-26738a57-ecbe-401f-a95a-8fdcb333d792 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:49.392619 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-26738a57-ecbe-401f-a95a-8fdcb333d792 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:49.395484 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-26738a57-ecbe-401f-a95a-8fdcb333d792 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:49.398647 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-26738a57-ecbe-401f-a95a-8fdcb333d792 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:49.912350 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:50.040133 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a935980c-2266-4863-a1a5-eaef18246582 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Calling method '.version_select at 0x7fdf0ce36e50>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:50.041563 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:50.041563 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:50.046024 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a935980c-2266-4863-a1a5-eaef18246582 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:50.047309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a935980c-2266-4863-a1a5-eaef18246582 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:50.049292 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a935980c-2266-4863-a1a5-eaef18246582 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:50.050919 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a935980c-2266-4863-a1a5-eaef18246582 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:50.260583 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a935980c-2266-4863-a1a5-eaef18246582 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 2.498200 Jun 16 14:36:50.265625 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 55/107] 10.222.0.57 () {58 vars in 1127 bytes} [Thu Jun 16 14:36:47 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 2506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:50.279820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2261c180-fc8e-45cd-a0ef-f5278d2db822 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:50.282464 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2261c180-fc8e-45cd-a0ef-f5278d2db822 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:50.305869 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2261c180-fc8e-45cd-a0ef-f5278d2db822 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:50.310358 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2261c180-fc8e-45cd-a0ef-f5278d2db822 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:50.317141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2261c180-fc8e-45cd-a0ef-f5278d2db822 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:50.319603 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2261c180-fc8e-45cd-a0ef-f5278d2db822 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:50.557867 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2261c180-fc8e-45cd-a0ef-f5278d2db822 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:50.578255 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2261c180-fc8e-45cd-a0ef-f5278d2db822 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1296 microversion: 2.1 time: 0.309609 Jun 16 14:36:50.579057 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 56/108] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:50 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1296 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:51.165681 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-78ae88cb-829a-44e0-b6f4-928be35a34ac tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Calling method '.version_select at 0x7fdf0cc92700>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:51.170625 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:51.170625 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:51.176475 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-78ae88cb-829a-44e0-b6f4-928be35a34ac tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'b93df5bfe89a44bca0bbfecd14f3bd74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7027298312e54cddb2d2ad9ec6138d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-78ae88cb-829a-44e0-b6f4-928be35a34ac tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Request method failure captured: Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_72She7qS7TIxYZbsXZhkJs5NLEU-iqUtzYdeQ0ULZVnuI9iFrhW3cxRtzojACmL9y1Wb6oX7MeOoyhIIf5BpmloM19cRbhdnJ4NUrLTBYJ9rNkL3JvTc3fsGUf9al4lZ8NYK0CKQeMYqMkBN2X_wbwUdt1vLSDE5KNSHtdbwigeo Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 7027298312e54cddb2d2ad9ec6138d08 Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:36:51.212247 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:36:51.213514 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7027298312e54cddb2d2ad9ec6138d08", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7027298312e54cddb2d2ad9ec6138d08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7027298312e54cddb2d2ad9ec6138d08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7027298312e54cddb2d2ad9ec6138d08"}]}] Jun 16 14:36:51.213514 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:51.213514 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 7027298312e54cddb2d2ad9ec6138d08 Jun 16 14:36:51.213514 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:51.213514 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HostsAdminNegativeTestJSON-1672914810-project Jun 16 14:36:51.213514 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:51.213514 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:51.213514 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: b93df5bfe89a44bca0bbfecd14f3bd74 Jun 16 14:36:51.213514 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1672914810-project Jun 16 14:36:51.213514 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:36:51.213514 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 16 14:36:51.213514 n-d-836830-4 devstack@n-api.service[125862]: action_args: {} Jun 16 14:36:51.213514 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:51.215537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 16 14:36:51.216583 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.220561 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-78ae88cb-829a-44e0-b6f4-928be35a34ac tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:51.222116 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-78ae88cb-829a-44e0-b6f4-928be35a34ac tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] 10.222.0.57 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.641805 Jun 16 14:36:51.223256 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 57/109] 10.222.0.57 () {58 vars in 1127 bytes} [Thu Jun 16 14:36:50 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 644 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:36:51.394433 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=8 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:51.450100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-abc3a09e-3e81-4784-924a-c53b19abed27 tempest-InstanceUsageAuditLogTestJSON-1265201705 tempest-InstanceUsageAuditLogTestJSON-1265201705-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:51.468854 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:51.468854 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:51.544792 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-abc3a09e-3e81-4784-924a-c53b19abed27 tempest-InstanceUsageAuditLogTestJSON-1265201705 tempest-InstanceUsageAuditLogTestJSON-1265201705-project-admin] 10.222.0.57 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-16 14:36:50" status: 200 len: 318 microversion: 2.1 time: 0.320004 Jun 16 14:36:51.563792 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 58/110] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jun 16 14:36:51 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-16%2014%3A36%3A50 => generated 318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:51.594056 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b8fdb21e-0911-4390-998e-141b7c097af3 tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Calling method '.version_select at 0x7fdf0cbd2280>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:51.595404 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:51.595404 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:51.599203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b8fdb21e-0911-4390-998e-141b7c097af3 tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'b93df5bfe89a44bca0bbfecd14f3bd74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7027298312e54cddb2d2ad9ec6138d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b8fdb21e-0911-4390-998e-141b7c097af3 tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Request method failure captured: Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-hosts/n-d-836830-4/reboot HTTP/1.1 Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_72She7qS7TIxYZbsXZhkJs5NLEU-iqUtzYdeQ0ULZVnuI9iFrhW3cxRtzojACmL9y1Wb6oX7MeOoyhIIf5BpmloM19cRbhdnJ4NUrLTBYJ9rNkL3JvTc3fsGUf9al4lZ8NYK0CKQeMYqMkBN2X_wbwUdt1vLSDE5KNSHtdbwigeo Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 7027298312e54cddb2d2ad9ec6138d08 Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:36:51.605102 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:36:51.607265 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7027298312e54cddb2d2ad9ec6138d08", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7027298312e54cddb2d2ad9ec6138d08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7027298312e54cddb2d2ad9ec6138d08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7027298312e54cddb2d2ad9ec6138d08"}]}] Jun 16 14:36:51.607265 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:51.607265 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 7027298312e54cddb2d2ad9ec6138d08 Jun 16 14:36:51.607265 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:51.607265 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HostsAdminNegativeTestJSON-1672914810-project Jun 16 14:36:51.607265 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:51.607265 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:51.607265 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: b93df5bfe89a44bca0bbfecd14f3bd74 Jun 16 14:36:51.607265 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1672914810-project Jun 16 14:36:51.607265 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:36:51.607265 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 16 14:36:51.607265 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'n-d-836830-4'} Jun 16 14:36:51.607265 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:51.608485 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 16 14:36:51.609783 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.612349 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-26738a57-ecbe-401f-a95a-8fdcb333d792 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:51.614174 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b8fdb21e-0911-4390-998e-141b7c097af3 tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:51.618677 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b8fdb21e-0911-4390-998e-141b7c097af3 tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] 10.222.0.57 "GET /compute/v2.1/os-hosts/n-d-836830-4/reboot" status: 403 len: 111 microversion: 2.1 time: 0.053525 Jun 16 14:36:51.628967 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 59/111] 10.222.0.57 () {58 vars in 1187 bytes} [Thu Jun 16 14:36:51 2022] GET /compute/v2.1/os-hosts/n-d-836830-4/reboot => generated 111 bytes in 64 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:36:51.634723 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-26738a57-ecbe-401f-a95a-8fdcb333d792 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 2.270276 Jun 16 14:36:51.635345 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 53/112] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:49 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 2272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:36:51.644734 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-13717a39-cf5f-45ad-aaf7-663950b7d127 tempest-InstanceUsageAuditLogTestJSON-1265201705 tempest-InstanceUsageAuditLogTestJSON-1265201705-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:51.648291 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:51.648291 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:51.661847 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-813111d8-d9a9-44b5-831a-5320ce10200b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:51.680964 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-813111d8-d9a9-44b5-831a-5320ce10200b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:51.701507 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-13717a39-cf5f-45ad-aaf7-663950b7d127 tempest-InstanceUsageAuditLogTestJSON-1265201705 tempest-InstanceUsageAuditLogTestJSON-1265201705-project-admin] 10.222.0.57 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.071061 Jun 16 14:36:51.714284 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-813111d8-d9a9-44b5-831a-5320ce10200b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:51.716359 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 60/113] 10.222.0.57 () {58 vars in 1184 bytes} [Thu Jun 16 14:36:51 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:51.719599 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-813111d8-d9a9-44b5-831a-5320ce10200b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:51.727369 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-813111d8-d9a9-44b5-831a-5320ce10200b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:51.732411 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-813111d8-d9a9-44b5-831a-5320ce10200b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:51.739157 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-be12f493-b645-452f-a6ed-4bf0e7717008 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Calling method '.version_select at 0x7fdf0cc92670>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:51.747901 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:51.747901 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:51.789947 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-be12f493-b645-452f-a6ed-4bf0e7717008 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-be12f493-b645-452f-a6ed-4bf0e7717008 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Request method failure captured: Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz__DhpPTKZKQKvgq4Hsi3ILK98k-_PHb0bmZ940DQmwkd4WJgH6Qdrqmvt3lmei8JHJrdFeokChROZ2lSetMjp3MDpRfhG1-O8VRB89Mk19I_Hl8GCFsMUf4gAl5FCkxTBqHD8dy2sx8QSOwVjJNrw9DrqZCVNYXfIqxWA3c7cPTSY Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:36:51.796079 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:36:51.797314 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9ecf565e18c44447beb1ced3ff479c15", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9ecf565e18c44447beb1ced3ff479c15"}]}] Jun 16 14:36:51.797314 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:51.797314 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:51.797314 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:51.797314 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:51.797314 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:51.797314 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:51.797314 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 5be84743d8f24ce7b14865fb89c76ccc Jun 16 14:36:51.797314 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:51.797314 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:36:51.797314 n-d-836830-4 devstack@n-api.service[125862]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:51.797314 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'nonexistent_hostname'} Jun 16 14:36:51.797314 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:36:51.798051 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 16 14:36:51.799169 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:36:51.800132 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:51.800132 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.800132 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:51.800132 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.800132 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:51.800132 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:51.800132 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:51.800132 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:36:51.800132 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:36:51.800132 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:51.800132 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.816127 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-be12f493-b645-452f-a6ed-4bf0e7717008 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:51.817017 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-be12f493-b645-452f-a6ed-4bf0e7717008 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.099430 Jun 16 14:36:51.825670 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 61/114] 10.222.0.57 () {58 vars in 1211 bytes} [Thu Jun 16 14:36:51 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:36:51.851146 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1d794b5b-a8b4-4658-a047-c684762a2bcc tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Calling method '.version_select at 0x7fdf0cb6b5e0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:51.861525 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:51.861525 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:51.865724 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1d794b5b-a8b4-4658-a047-c684762a2bcc tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'b93df5bfe89a44bca0bbfecd14f3bd74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7027298312e54cddb2d2ad9ec6138d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1d794b5b-a8b4-4658-a047-c684762a2bcc tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Request method failure captured: Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-hosts/n-d-836830-4 HTTP/1.1 Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_72She7qS7TIxYZbsXZhkJs5NLEU-iqUtzYdeQ0ULZVnuI9iFrhW3cxRtzojACmL9y1Wb6oX7MeOoyhIIf5BpmloM19cRbhdnJ4NUrLTBYJ9rNkL3JvTc3fsGUf9al4lZ8NYK0CKQeMYqMkBN2X_wbwUdt1vLSDE5KNSHtdbwigeo Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 7027298312e54cddb2d2ad9ec6138d08 Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:36:51.875160 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:36:51.876441 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7027298312e54cddb2d2ad9ec6138d08", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7027298312e54cddb2d2ad9ec6138d08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7027298312e54cddb2d2ad9ec6138d08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7027298312e54cddb2d2ad9ec6138d08"}]}] Jun 16 14:36:51.876441 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:51.876441 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 7027298312e54cddb2d2ad9ec6138d08 Jun 16 14:36:51.876441 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:51.876441 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HostsAdminNegativeTestJSON-1672914810-project Jun 16 14:36:51.876441 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:51.876441 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:51.876441 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: b93df5bfe89a44bca0bbfecd14f3bd74 Jun 16 14:36:51.876441 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1672914810-project Jun 16 14:36:51.876441 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:36:51.876441 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 16 14:36:51.876441 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'n-d-836830-4'} Jun 16 14:36:51.876441 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:51.877277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 16 14:36:51.878555 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.889198 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1d794b5b-a8b4-4658-a047-c684762a2bcc tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:51.890426 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1d794b5b-a8b4-4658-a047-c684762a2bcc tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] 10.222.0.57 "GET /compute/v2.1/os-hosts/n-d-836830-4" status: 403 len: 109 microversion: 2.1 time: 0.063702 Jun 16 14:36:51.896179 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 62/115] 10.222.0.57 () {58 vars in 1166 bytes} [Thu Jun 16 14:36:51 2022] GET /compute/v2.1/os-hosts/n-d-836830-4 => generated 109 bytes in 70 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:36:51.942295 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d413c866-b292-4725-99cf-bacdad922331 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Calling method '.version_select at 0x7fdf0cb6b310>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:51.964552 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-d413c866-b292-4725-99cf-bacdad922331 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d413c866-b292-4725-99cf-bacdad922331 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Request method failure captured: Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz__DhpPTKZKQKvgq4Hsi3ILK98k-_PHb0bmZ940DQmwkd4WJgH6Qdrqmvt3lmei8JHJrdFeokChROZ2lSetMjp3MDpRfhG1-O8VRB89Mk19I_Hl8GCFsMUf4gAl5FCkxTBqHD8dy2sx8QSOwVjJNrw9DrqZCVNYXfIqxWA3c7cPTSY Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:36:51.966871 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:36:51.968130 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9ecf565e18c44447beb1ced3ff479c15", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9ecf565e18c44447beb1ced3ff479c15"}]}] Jun 16 14:36:51.968130 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:51.968130 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:51.968130 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:51.968130 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:51.968130 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:51.968130 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:51.968130 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 5be84743d8f24ce7b14865fb89c76ccc Jun 16 14:36:51.968130 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:51.968130 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:36:51.968130 n-d-836830-4 devstack@n-api.service[125862]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:51.968130 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'nonexistent_hostname'} Jun 16 14:36:51.968130 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:51.968801 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:51.969781 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:51.973471 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d413c866-b292-4725-99cf-bacdad922331 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:51.974710 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d413c866-b292-4725-99cf-bacdad922331 tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.077163 Jun 16 14:36:51.982046 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 63/116] 10.222.0.57 () {58 vars in 1190 bytes} [Thu Jun 16 14:36:51 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:36:52.002215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5fb4b161-b8cb-462d-b612-e87daff1f2dc tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Calling method '.version_select at 0x7fdf0cb4df70>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:52.008446 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:52.008446 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:52.010254 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5fb4b161-b8cb-462d-b612-e87daff1f2dc tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'b93df5bfe89a44bca0bbfecd14f3bd74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7027298312e54cddb2d2ad9ec6138d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5fb4b161-b8cb-462d-b612-e87daff1f2dc tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Request method failure captured: Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-hosts/n-d-836830-4/shutdown HTTP/1.1 Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_72She7qS7TIxYZbsXZhkJs5NLEU-iqUtzYdeQ0ULZVnuI9iFrhW3cxRtzojACmL9y1Wb6oX7MeOoyhIIf5BpmloM19cRbhdnJ4NUrLTBYJ9rNkL3JvTc3fsGUf9al4lZ8NYK0CKQeMYqMkBN2X_wbwUdt1vLSDE5KNSHtdbwigeo Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 7027298312e54cddb2d2ad9ec6138d08 Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:36:52.018278 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:36:52.019585 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7027298312e54cddb2d2ad9ec6138d08", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7027298312e54cddb2d2ad9ec6138d08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7027298312e54cddb2d2ad9ec6138d08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7027298312e54cddb2d2ad9ec6138d08"}]}] Jun 16 14:36:52.019585 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:52.019585 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 7027298312e54cddb2d2ad9ec6138d08 Jun 16 14:36:52.019585 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:52.019585 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HostsAdminNegativeTestJSON-1672914810-project Jun 16 14:36:52.019585 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:52.019585 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:52.019585 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: b93df5bfe89a44bca0bbfecd14f3bd74 Jun 16 14:36:52.019585 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1672914810-project Jun 16 14:36:52.019585 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:36:52.019585 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 16 14:36:52.019585 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'n-d-836830-4'} Jun 16 14:36:52.019585 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:52.020262 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 16 14:36:52.021240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.023685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5fb4b161-b8cb-462d-b612-e87daff1f2dc tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:52.025190 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5fb4b161-b8cb-462d-b612-e87daff1f2dc tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] 10.222.0.57 "GET /compute/v2.1/os-hosts/n-d-836830-4/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.026972 Jun 16 14:36:52.026027 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 64/117] 10.222.0.57 () {58 vars in 1193 bytes} [Thu Jun 16 14:36:51 2022] GET /compute/v2.1/os-hosts/n-d-836830-4/shutdown => generated 113 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:36:52.035847 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-769a185c-5115-428a-8c53-7f28084bbefc tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Calling method '.version_select at 0x7fdf0cc92550>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:52.067659 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-769a185c-5115-428a-8c53-7f28084bbefc tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-769a185c-5115-428a-8c53-7f28084bbefc tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Request method failure captured: Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz__DhpPTKZKQKvgq4Hsi3ILK98k-_PHb0bmZ940DQmwkd4WJgH6Qdrqmvt3lmei8JHJrdFeokChROZ2lSetMjp3MDpRfhG1-O8VRB89Mk19I_Hl8GCFsMUf4gAl5FCkxTBqHD8dy2sx8QSOwVjJNrw9DrqZCVNYXfIqxWA3c7cPTSY Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:36:52.069640 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:36:52.072024 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9ecf565e18c44447beb1ced3ff479c15", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9ecf565e18c44447beb1ced3ff479c15"}]}] Jun 16 14:36:52.072024 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.072024 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:52.072024 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.072024 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:52.072024 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:52.072024 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:52.072024 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 5be84743d8f24ce7b14865fb89c76ccc Jun 16 14:36:52.072024 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:52.072024 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:36:52.072024 n-d-836830-4 devstack@n-api.service[125862]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:52.072024 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'nonexistent_hostname'} Jun 16 14:36:52.072024 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:36:52.075422 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 16 14:36:52.079802 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:36:52.085503 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:52.085503 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.085503 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:52.085503 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.085503 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.085503 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.085503 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.085503 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:36:52.085503 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:36:52.085503 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:52.085503 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.085503 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-769a185c-5115-428a-8c53-7f28084bbefc tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:52.085503 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-769a185c-5115-428a-8c53-7f28084bbefc tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.039866 Jun 16 14:36:52.085503 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 65/118] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jun 16 14:36:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:36:52.087921 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8139acbd-e3ae-463c-8285-a4663ba506bf tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Calling method '.version_select at 0x7fdf0cb4de50>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:52.087921 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:52.087921 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:52.087921 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8139acbd-e3ae-463c-8285-a4663ba506bf tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'b93df5bfe89a44bca0bbfecd14f3bd74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7027298312e54cddb2d2ad9ec6138d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:52.087921 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8139acbd-e3ae-463c-8285-a4663ba506bf tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Request method failure captured: Jun 16 14:36:52.087921 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-hosts/n-d-836830-4/startup HTTP/1.1 Jun 16 14:36:52.087921 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:52.087921 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:52.087921 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:52.087921 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:36:52.087921 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:52.087921 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_72She7qS7TIxYZbsXZhkJs5NLEU-iqUtzYdeQ0ULZVnuI9iFrhW3cxRtzojACmL9y1Wb6oX7MeOoyhIIf5BpmloM19cRbhdnJ4NUrLTBYJ9rNkL3JvTc3fsGUf9al4lZ8NYK0CKQeMYqMkBN2X_wbwUdt1vLSDE5KNSHtdbwigeo Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 7027298312e54cddb2d2ad9ec6138d08 Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7027298312e54cddb2d2ad9ec6138d08", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7027298312e54cddb2d2ad9ec6138d08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7027298312e54cddb2d2ad9ec6138d08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7027298312e54cddb2d2ad9ec6138d08"}]}] Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:52.089183 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 7027298312e54cddb2d2ad9ec6138d08 Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HostsAdminNegativeTestJSON-1672914810-project Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: b93df5bfe89a44bca0bbfecd14f3bd74 Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1672914810-project Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'n-d-836830-4'} Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:36:52.091537 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:36:52.094053 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:36:52.102963 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 16 14:36:52.102963 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.102963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8139acbd-e3ae-463c-8285-a4663ba506bf tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:52.102963 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8139acbd-e3ae-463c-8285-a4663ba506bf tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] 10.222.0.57 "GET /compute/v2.1/os-hosts/n-d-836830-4/startup" status: 403 len: 110 microversion: 2.1 time: 0.012465 Jun 16 14:36:52.102963 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 66/119] 10.222.0.57 () {58 vars in 1190 bytes} [Thu Jun 16 14:36:52 2022] GET /compute/v2.1/os-hosts/n-d-836830-4/startup => generated 110 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:36:52.109997 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-188df558-9d7e-4003-95ba-e9ada282ccda tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Calling method '.version_select at 0x7fdf0cb6b310>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:52.157988 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-188df558-9d7e-4003-95ba-e9ada282ccda tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-188df558-9d7e-4003-95ba-e9ada282ccda tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Request method failure captured: Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz__DhpPTKZKQKvgq4Hsi3ILK98k-_PHb0bmZ940DQmwkd4WJgH6Qdrqmvt3lmei8JHJrdFeokChROZ2lSetMjp3MDpRfhG1-O8VRB89Mk19I_Hl8GCFsMUf4gAl5FCkxTBqHD8dy2sx8QSOwVjJNrw9DrqZCVNYXfIqxWA3c7cPTSY Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:36:52.179099 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:36:52.181346 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9ecf565e18c44447beb1ced3ff479c15", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9ecf565e18c44447beb1ced3ff479c15"}]}] Jun 16 14:36:52.181346 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.181346 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:52.181346 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.181346 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:52.181346 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:52.181346 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:52.181346 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 5be84743d8f24ce7b14865fb89c76ccc Jun 16 14:36:52.181346 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:52.181346 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:36:52.181346 n-d-836830-4 devstack@n-api.service[125862]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:52.181346 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'nonexistent_hostname'} Jun 16 14:36:52.181346 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:36:52.182759 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 16 14:36:52.183993 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:36:52.185182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:52.185182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.185182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:52.185182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.185182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.185182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.185182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.185182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:36:52.185182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:36:52.185182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:52.185182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.190360 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-188df558-9d7e-4003-95ba-e9ada282ccda tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:52.192513 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-188df558-9d7e-4003-95ba-e9ada282ccda tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.090997 Jun 16 14:36:52.196391 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 67/120] 10.222.0.57 () {58 vars in 1214 bytes} [Thu Jun 16 14:36:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:36:52.237807 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a6fe913f-2f12-42ce-b7a0-dcda07e1300f tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0cb6bd30>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a6fe913f-2f12-42ce-b7a0-dcda07e1300f tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Request method failure captured: Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: request: PUT /compute/v2.1/os-hosts/n-d-836830-4 HTTP/1.1 Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 51 Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz__DhpPTKZKQKvgq4Hsi3ILK98k-_PHb0bmZ940DQmwkd4WJgH6Qdrqmvt3lmei8JHJrdFeokChROZ2lSetMjp3MDpRfhG1-O8VRB89Mk19I_Hl8GCFsMUf4gAl5FCkxTBqHD8dy2sx8QSOwVjJNrw9DrqZCVNYXfIqxWA3c7cPTSY Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:36:52.284772 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:36:52.286018 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9ecf565e18c44447beb1ced3ff479c15", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9ecf565e18c44447beb1ced3ff479c15"}]}] Jun 16 14:36:52.286018 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.286018 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:52.286018 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.286018 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:52.286018 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:52.286018 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:52.286018 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 5be84743d8f24ce7b14865fb89c76ccc Jun 16 14:36:52.286018 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:52.286018 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:36:52.286018 n-d-836830-4 devstack@n-api.service[125862]: {"status": "enable", "maintenance_mode": "invalid"} Jun 16 14:36:52.286018 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:36:52.286018 n-d-836830-4 devstack@n-api.service[125862]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'n-d-836830-4', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'disable', Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'Enable', Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'Disable', Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi On instance: Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'invalid' Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.287028 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.288903 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.289992 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.289992 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:36:52.289992 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:36:52.289992 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 14:36:52.289992 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.289992 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a6fe913f-2f12-42ce-b7a0-dcda07e1300f tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:52.289992 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a6fe913f-2f12-42ce-b7a0-dcda07e1300f tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-hosts/n-d-836830-4" status: 400 len: 199 microversion: 2.1 time: 0.073029 Jun 16 14:36:52.293486 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 68/121] 10.222.0.57 () {60 vars in 1186 bytes} [Thu Jun 16 14:36:52 2022] PUT /compute/v2.1/os-hosts/n-d-836830-4 => generated 199 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:36:52.318341 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-460585c6-c7e4-456b-9888-9d2be3bef6ef tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0cb45160>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-460585c6-c7e4-456b-9888-9d2be3bef6ef tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Request method failure captured: Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: request: PUT /compute/v2.1/os-hosts/n-d-836830-4 HTTP/1.1 Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 51 Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz__DhpPTKZKQKvgq4Hsi3ILK98k-_PHb0bmZ940DQmwkd4WJgH6Qdrqmvt3lmei8JHJrdFeokChROZ2lSetMjp3MDpRfhG1-O8VRB89Mk19I_Hl8GCFsMUf4gAl5FCkxTBqHD8dy2sx8QSOwVjJNrw9DrqZCVNYXfIqxWA3c7cPTSY Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:36:52.321568 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:36:52.322938 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9ecf565e18c44447beb1ced3ff479c15", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9ecf565e18c44447beb1ced3ff479c15"}]}] Jun 16 14:36:52.322938 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.322938 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:52.322938 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.322938 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:52.322938 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:52.322938 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:52.322938 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 5be84743d8f24ce7b14865fb89c76ccc Jun 16 14:36:52.322938 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:52.322938 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:36:52.322938 n-d-836830-4 devstack@n-api.service[125862]: {"status": "invalid", "maintenance_mode": "enable"} Jun 16 14:36:52.322938 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:36:52.322938 n-d-836830-4 devstack@n-api.service[125862]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'n-d-836830-4', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'disable', Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'Enable', Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'Disable', Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi On instance: Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'invalid' Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.323710 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.325610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.328991 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.328991 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:36:52.328991 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:36:52.328991 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 16 14:36:52.328991 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.328991 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-460585c6-c7e4-456b-9888-9d2be3bef6ef tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:52.328991 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-460585c6-c7e4-456b-9888-9d2be3bef6ef tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-hosts/n-d-836830-4" status: 400 len: 189 microversion: 2.1 time: 0.027007 Jun 16 14:36:52.328991 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 69/122] 10.222.0.57 () {60 vars in 1186 bytes} [Thu Jun 16 14:36:52 2022] PUT /compute/v2.1/os-hosts/n-d-836830-4 => generated 189 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:36:52.340834 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ff4980a8-c5d1-414f-9acc-435d400cd412 tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Action: 'update', calling method: .version_select at 0x7fdf0cc92790>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:52.344100 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:36:52.344100 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:36:52.348832 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ff4980a8-c5d1-414f-9acc-435d400cd412 tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'b93df5bfe89a44bca0bbfecd14f3bd74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7027298312e54cddb2d2ad9ec6138d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ff4980a8-c5d1-414f-9acc-435d400cd412 tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Request method failure captured: Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: request: PUT /compute/v2.1/os-hosts/n-d-836830-4 HTTP/1.1 Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 50 Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_72She7qS7TIxYZbsXZhkJs5NLEU-iqUtzYdeQ0ULZVnuI9iFrhW3cxRtzojACmL9y1Wb6oX7MeOoyhIIf5BpmloM19cRbhdnJ4NUrLTBYJ9rNkL3JvTc3fsGUf9al4lZ8NYK0CKQeMYqMkBN2X_wbwUdt1vLSDE5KNSHtdbwigeo Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 7027298312e54cddb2d2ad9ec6138d08 Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:36:52.368185 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:36:52.370196 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7027298312e54cddb2d2ad9ec6138d08", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7027298312e54cddb2d2ad9ec6138d08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7027298312e54cddb2d2ad9ec6138d08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7027298312e54cddb2d2ad9ec6138d08"}]}] Jun 16 14:36:52.370196 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:52.370196 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 7027298312e54cddb2d2ad9ec6138d08 Jun 16 14:36:52.370196 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1672914810 Jun 16 14:36:52.370196 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HostsAdminNegativeTestJSON-1672914810-project Jun 16 14:36:52.370196 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:52.370196 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:52.370196 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: b93df5bfe89a44bca0bbfecd14f3bd74 Jun 16 14:36:52.370196 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1672914810-project Jun 16 14:36:52.370196 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:36:52.370196 n-d-836830-4 devstack@n-api.service[125862]: {"status": "enable", "maintenance_mode": "enable"} Jun 16 14:36:52.370196 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:36:52.370196 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 16 14:36:52.370196 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'n-d-836830-4', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:52.372018 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 16 14:36:52.373258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.374249 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ff4980a8-c5d1-414f-9acc-435d400cd412 tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:52.374249 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ff4980a8-c5d1-414f-9acc-435d400cd412 tempest-HostsAdminNegativeTestJSON-1672914810 tempest-HostsAdminNegativeTestJSON-1672914810-project] 10.222.0.57 "PUT /compute/v2.1/os-hosts/n-d-836830-4" status: 403 len: 111 microversion: 2.1 time: 0.038897 Jun 16 14:36:52.375945 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 70/123] 10.222.0.57 () {60 vars in 1186 bytes} [Thu Jun 16 14:36:52 2022] PUT /compute/v2.1/os-hosts/n-d-836830-4 => generated 111 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:36:52.391736 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ae20f8bd-5cb5-4ed6-a0e8-23d64a02b06d tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0cb6bca0>, body: {"status": null, "maintenance_mode": null} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ae20f8bd-5cb5-4ed6-a0e8-23d64a02b06d tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Request method failure captured: Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: request: PUT /compute/v2.1/os-hosts/n-d-836830-4 HTTP/1.1 Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 42 Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz__DhpPTKZKQKvgq4Hsi3ILK98k-_PHb0bmZ940DQmwkd4WJgH6Qdrqmvt3lmei8JHJrdFeokChROZ2lSetMjp3MDpRfhG1-O8VRB89Mk19I_Hl8GCFsMUf4gAl5FCkxTBqHD8dy2sx8QSOwVjJNrw9DrqZCVNYXfIqxWA3c7cPTSY Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:36:52.398691 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:36:52.399870 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9ecf565e18c44447beb1ced3ff479c15", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9ecf565e18c44447beb1ced3ff479c15"}]}] Jun 16 14:36:52.399870 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.399870 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:52.399870 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.399870 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:52.399870 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:52.399870 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:52.399870 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 5be84743d8f24ce7b14865fb89c76ccc Jun 16 14:36:52.399870 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:52.399870 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:36:52.399870 n-d-836830-4 devstack@n-api.service[125862]: {"status": null, "maintenance_mode": null} Jun 16 14:36:52.399870 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:36:52.399870 n-d-836830-4 devstack@n-api.service[125862]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 16 14:36:52.399870 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'n-d-836830-4', 'body': {'status': None, 'maintenance_mode': None}} Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'disable', Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'Enable', Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'Disable', Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi On instance: Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi None Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.400615 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.402026 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.404092 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:36:52.404092 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:36:52.404092 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 16 14:36:52.404092 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.409404 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ae20f8bd-5cb5-4ed6-a0e8-23d64a02b06d tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:52.430528 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ae20f8bd-5cb5-4ed6-a0e8-23d64a02b06d tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-hosts/n-d-836830-4" status: 400 len: 127 microversion: 2.1 time: 0.033313 Jun 16 14:36:52.437776 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 71/124] 10.222.0.57 () {60 vars in 1186 bytes} [Thu Jun 16 14:36:52 2022] PUT /compute/v2.1/os-hosts/n-d-836830-4 => generated 127 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 14:36:52.471545 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-79ea2165-df88-454a-83dc-1ab7cf5f590a tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0cb13310>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:52.493515 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.hosts [None req-79ea2165-df88-454a-83dc-1ab7cf5f590a tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Enabling host nonexistent_hostname. Jun 16 14:36:52.513906 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:DELETE=14,nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:52.524263 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-79ea2165-df88-454a-83dc-1ab7cf5f590a tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-79ea2165-df88-454a-83dc-1ab7cf5f590a tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Request method failure captured: Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 50 Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz__DhpPTKZKQKvgq4Hsi3ILK98k-_PHb0bmZ940DQmwkd4WJgH6Qdrqmvt3lmei8JHJrdFeokChROZ2lSetMjp3MDpRfhG1-O8VRB89Mk19I_Hl8GCFsMUf4gAl5FCkxTBqHD8dy2sx8QSOwVjJNrw9DrqZCVNYXfIqxWA3c7cPTSY Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:36:52.531402 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:36:52.532828 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9ecf565e18c44447beb1ced3ff479c15", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9ecf565e18c44447beb1ced3ff479c15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9ecf565e18c44447beb1ced3ff479c15"}]}] Jun 16 14:36:52.532828 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.532828 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 9ecf565e18c44447beb1ced3ff479c15 Jun 16 14:36:52.532828 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1741048659 Jun 16 14:36:52.532828 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:52.532828 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:36:52.532828 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:36:52.532828 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 5be84743d8f24ce7b14865fb89c76ccc Jun 16 14:36:52.532828 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1741048659-project-admin Jun 16 14:36:52.532828 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:36:52.532828 n-d-836830-4 devstack@n-api.service[125862]: {"status": "enable", "maintenance_mode": "enable"} Jun 16 14:36:52.532828 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:36:52.532828 n-d-836830-4 devstack@n-api.service[125862]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:52.532828 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 16 14:36:52.533654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:36:52.534859 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jun 16 14:36:52.536300 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jun 16 14:36:52.536300 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jun 16 14:36:52.536300 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:36:52.536300 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:52.536300 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.536300 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:36:52.536300 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.536300 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:36:52.536300 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:36:52.536300 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:36:52.536300 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:36:52.536300 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:36:52.536300 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 16 14:36:52.536300 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:36:52.541215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-79ea2165-df88-454a-83dc-1ab7cf5f590a tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:36:52.547923 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-79ea2165-df88-454a-83dc-1ab7cf5f590a tempest-HostsAdminNegativeTestJSON-1741048659 tempest-HostsAdminNegativeTestJSON-1741048659-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.104275 Jun 16 14:36:52.550660 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 72/125] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jun 16 14:36:52 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:36:52.657250 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-afaf0d99-8326-4b4c-91b7-b6e40d29ea1d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:52.658119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-afaf0d99-8326-4b4c-91b7-b6e40d29ea1d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:52.707626 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-afaf0d99-8326-4b4c-91b7-b6e40d29ea1d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:52.711045 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-afaf0d99-8326-4b4c-91b7-b6e40d29ea1d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:52.716482 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-afaf0d99-8326-4b4c-91b7-b6e40d29ea1d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:52.723203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-afaf0d99-8326-4b4c-91b7-b6e40d29ea1d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:52.981686 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-813111d8-d9a9-44b5-831a-5320ce10200b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:52.994224 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-813111d8-d9a9-44b5-831a-5320ce10200b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1296 microversion: 2.1 time: 1.343393 Jun 16 14:36:53.009618 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 54/126] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:51 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1296 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:54.017748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b8298c4b-0ef4-44c1-b083-f95640802037 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:54.018833 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b8298c4b-0ef4-44c1-b083-f95640802037 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:54.020449 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=18 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:54.034347 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b8298c4b-0ef4-44c1-b083-f95640802037 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:54.034846 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b8298c4b-0ef4-44c1-b083-f95640802037 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:54.036034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b8298c4b-0ef4-44c1-b083-f95640802037 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:54.036034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b8298c4b-0ef4-44c1-b083-f95640802037 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:54.955874 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b8298c4b-0ef4-44c1-b083-f95640802037 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:54.969879 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b8298c4b-0ef4-44c1-b083-f95640802037 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1338 microversion: 2.1 time: 0.956029 Jun 16 14:36:54.972857 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 55/127] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:54 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1338 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:55.072374 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-afaf0d99-8326-4b4c-91b7-b6e40d29ea1d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:55.090113 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-afaf0d99-8326-4b4c-91b7-b6e40d29ea1d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 2.439145 Jun 16 14:36:55.092769 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 73/128] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:52 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 2444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:36:55.519897 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-6c747a86-5f1b-473f-b768-161caf5d7236 req-d8fe357c-a121-4bf1-af5f-9a3a25eb35e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6537907c-347c-4c0e-85c2-10b57fd8fd50", "tag": "533d1601-49c7-48a2-96b9-1c108accf4c4"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:36:55.579546 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-6c747a86-5f1b-473f-b768-161caf5d7236 req-d8fe357c-a121-4bf1-af5f-9a3a25eb35e7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:55.581568 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-6c747a86-5f1b-473f-b768-161caf5d7236 req-d8fe357c-a121-4bf1-af5f-9a3a25eb35e7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:55.704015 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-6c747a86-5f1b-473f-b768-161caf5d7236 req-d8fe357c-a121-4bf1-af5f-9a3a25eb35e7 service nova] Creating event network-changed:533d1601-49c7-48a2-96b9-1c108accf4c4 for instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 on n-h1-836830-4 Jun 16 14:36:55.704599 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-6c747a86-5f1b-473f-b768-161caf5d7236 req-d8fe357c-a121-4bf1-af5f-9a3a25eb35e7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 14:36:55.705820 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6e1ca067-45b7-49a5-b2a7-7ec922524d6e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:55.706281 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6e1ca067-45b7-49a5-b2a7-7ec922524d6e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:55.724552 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6e1ca067-45b7-49a5-b2a7-7ec922524d6e None None] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:55.729481 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6e1ca067-45b7-49a5-b2a7-7ec922524d6e None None] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:55.790821 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.compute.rpcapi [None req-6e1ca067-45b7-49a5-b2a7-7ec922524d6e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 14:36:55.791942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6e1ca067-45b7-49a5-b2a7-7ec922524d6e None None] Releasing lock "compute-rpcapi-router" {{(pid=125863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 14:36:55.851740 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6e1ca067-45b7-49a5-b2a7-7ec922524d6e None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.874314 Jun 16 14:36:55.853090 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 56/129] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:36:55.991224 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-929efbda-45b1-4459-9ce1-17982d4deb04 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:55.992177 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-929efbda-45b1-4459-9ce1-17982d4deb04 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:56.009199 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-929efbda-45b1-4459-9ce1-17982d4deb04 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:56.017341 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-929efbda-45b1-4459-9ce1-17982d4deb04 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:56.019484 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-929efbda-45b1-4459-9ce1-17982d4deb04 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:56.039237 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-929efbda-45b1-4459-9ce1-17982d4deb04 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:56.113067 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-95f99ec5-385a-4509-931d-454ff325b6f8 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:56.114023 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-95f99ec5-385a-4509-931d-454ff325b6f8 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:56.164712 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-95f99ec5-385a-4509-931d-454ff325b6f8 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:56.165546 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-95f99ec5-385a-4509-931d-454ff325b6f8 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:56.169097 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-95f99ec5-385a-4509-931d-454ff325b6f8 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:56.170070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-95f99ec5-385a-4509-931d-454ff325b6f8 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:57.820406 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-95f99ec5-385a-4509-931d-454ff325b6f8 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:57.838361 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-95f99ec5-385a-4509-931d-454ff325b6f8 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 1.732635 Jun 16 14:36:57.841822 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 57/130] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:56 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:36:57.933162 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-929efbda-45b1-4459-9ce1-17982d4deb04 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:36:57.968984 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=57 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:36:57.990295 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-929efbda-45b1-4459-9ce1-17982d4deb04 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1338 microversion: 2.1 time: 2.000851 Jun 16 14:36:57.997988 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 74/131] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:55 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1338 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:36:58.877527 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a0a30a06-5219-40b7-b0c6-7fb077405bba tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:58.879045 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a0a30a06-5219-40b7-b0c6-7fb077405bba tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:58.918084 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0a30a06-5219-40b7-b0c6-7fb077405bba tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:58.923607 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0a30a06-5219-40b7-b0c6-7fb077405bba tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:58.930796 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0a30a06-5219-40b7-b0c6-7fb077405bba tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:58.933108 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0a30a06-5219-40b7-b0c6-7fb077405bba tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:59.014486 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-be5d492c-c4b2-46a1-9082-31c56a321031 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:36:59.016430 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-be5d492c-c4b2-46a1-9082-31c56a321031 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:36:59.084647 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be5d492c-c4b2-46a1-9082-31c56a321031 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:59.105059 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be5d492c-c4b2-46a1-9082-31c56a321031 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:36:59.111972 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be5d492c-c4b2-46a1-9082-31c56a321031 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:36:59.116647 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be5d492c-c4b2-46a1-9082-31c56a321031 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:00.080552 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a0a30a06-5219-40b7-b0c6-7fb077405bba tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:00.100455 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a0a30a06-5219-40b7-b0c6-7fb077405bba tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 1.230075 Jun 16 14:37:00.107001 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 58/132] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:58 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:00.111143 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:01.144798 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d85543d4-1f9f-4c73-84b2-0f1753c5dd7d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:01.151134 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d85543d4-1f9f-4c73-84b2-0f1753c5dd7d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:01.197227 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d85543d4-1f9f-4c73-84b2-0f1753c5dd7d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:01.201966 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d85543d4-1f9f-4c73-84b2-0f1753c5dd7d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:01.203458 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d85543d4-1f9f-4c73-84b2-0f1753c5dd7d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:01.209846 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d85543d4-1f9f-4c73-84b2-0f1753c5dd7d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:01.234357 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=77 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:01.416049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-be5d492c-c4b2-46a1-9082-31c56a321031 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:01.445744 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-be5d492c-c4b2-46a1-9082-31c56a321031 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1338 microversion: 2.1 time: 2.435553 Jun 16 14:37:01.457405 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 75/133] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:36:59 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1338 bytes in 2449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:02.112566 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d85543d4-1f9f-4c73-84b2-0f1753c5dd7d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:02.121427 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d85543d4-1f9f-4c73-84b2-0f1753c5dd7d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 0.989967 Jun 16 14:37:02.140505 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 59/134] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:01 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:02.474966 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-535a85cb-e6f3-410f-a31a-d1bf7ff3bec7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:02.475660 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-535a85cb-e6f3-410f-a31a-d1bf7ff3bec7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:02.497261 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=8 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:02.501540 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-535a85cb-e6f3-410f-a31a-d1bf7ff3bec7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:02.504167 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-535a85cb-e6f3-410f-a31a-d1bf7ff3bec7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:02.513771 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-535a85cb-e6f3-410f-a31a-d1bf7ff3bec7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:02.514545 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-535a85cb-e6f3-410f-a31a-d1bf7ff3bec7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:03.154040 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7641dc10-2d80-4040-a201-c98ee2d52f05 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:03.160428 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7641dc10-2d80-4040-a201-c98ee2d52f05 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:03.212748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7641dc10-2d80-4040-a201-c98ee2d52f05 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:03.216289 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7641dc10-2d80-4040-a201-c98ee2d52f05 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:03.227047 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7641dc10-2d80-4040-a201-c98ee2d52f05 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:03.237145 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7641dc10-2d80-4040-a201-c98ee2d52f05 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:04.696838 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7641dc10-2d80-4040-a201-c98ee2d52f05 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:04.717849 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-535a85cb-e6f3-410f-a31a-d1bf7ff3bec7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:04.723189 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7641dc10-2d80-4040-a201-c98ee2d52f05 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 1.573387 Jun 16 14:37:04.724567 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 60/135] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:03 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:04.760792 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-535a85cb-e6f3-410f-a31a-d1bf7ff3bec7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1338 microversion: 2.1 time: 2.289171 Jun 16 14:37:04.774838 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 76/136] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:02 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1338 bytes in 2305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:37:05.754538 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7c5b3439-e6fb-4b89-be1e-4f2540028a5b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:05.756277 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7c5b3439-e6fb-4b89-be1e-4f2540028a5b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:05.770204 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7c5b3439-e6fb-4b89-be1e-4f2540028a5b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:05.775429 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7c5b3439-e6fb-4b89-be1e-4f2540028a5b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:05.777545 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:05.787684 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7c5b3439-e6fb-4b89-be1e-4f2540028a5b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:05.788584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7c5b3439-e6fb-4b89-be1e-4f2540028a5b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:05.924757 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-303eabb1-beaa-46e1-aab6-de258ebdf391 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Calling method '.version_select at 0x7fdf0c8df550>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:05.926860 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:05.926860 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:05.929408 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-303eabb1-beaa-46e1-aab6-de258ebdf391 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:05.930202 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-303eabb1-beaa-46e1-aab6-de258ebdf391 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:05.933759 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-303eabb1-beaa-46e1-aab6-de258ebdf391 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:05.935820 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-303eabb1-beaa-46e1-aab6-de258ebdf391 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:05.979194 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-303eabb1-beaa-46e1-aab6-de258ebdf391 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.864324 Jun 16 14:37:05.987822 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 61/137] 10.222.0.57 () {58 vars in 1127 bytes} [Thu Jun 16 14:37:05 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:05.995216 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bfb65c6c-e502-4ec8-9f11-59d069cdda1e tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:05.996284 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bfb65c6c-e502-4ec8-9f11-59d069cdda1e tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:06.005291 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bfb65c6c-e502-4ec8-9f11-59d069cdda1e tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:06.006150 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bfb65c6c-e502-4ec8-9f11-59d069cdda1e tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:06.007717 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bfb65c6c-e502-4ec8-9f11-59d069cdda1e tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:06.008521 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bfb65c6c-e502-4ec8-9f11-59d069cdda1e tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:06.606100 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bfb65c6c-e502-4ec8-9f11-59d069cdda1e tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:06.621541 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bfb65c6c-e502-4ec8-9f11-59d069cdda1e tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1338 microversion: 2.1 time: 0.632030 Jun 16 14:37:06.626847 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 62/138] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:05 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1338 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:06.641198 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-72ae79b8-651e-41c1-a147-7c76b0496b4a tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Calling method '.version_select at 0x7fdf0c93b8b0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:06.645912 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:06.645912 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:06.652312 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-72ae79b8-651e-41c1-a147-7c76b0496b4a tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:06.653786 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-72ae79b8-651e-41c1-a147-7c76b0496b4a tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:06.661408 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-72ae79b8-651e-41c1-a147-7c76b0496b4a tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:06.663334 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-72ae79b8-651e-41c1-a147-7c76b0496b4a tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:06.772332 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-72ae79b8-651e-41c1-a147-7c76b0496b4a tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.142566 Jun 16 14:37:06.785952 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 63/139] 10.222.0.57 () {58 vars in 1138 bytes} [Thu Jun 16 14:37:06 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:07.096088 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-143656557", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "f57fcde4-c3c0-449f-9871-02a5578b92d2"}]}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:07.333258 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] validate_networks() for [('f57fcde4-c3c0-449f-9871-02a5578b92d2', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:37:07.473270 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7c5b3439-e6fb-4b89-be1e-4f2540028a5b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:07.498005 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7c5b3439-e6fb-4b89-be1e-4f2540028a5b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 1.746902 Jun 16 14:37:07.498005 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 77/140] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:05 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:07.510108 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-15e65eeb-328f-4312-841f-c9ce4aa60291 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Calling method '.version_select at 0x7fdf0cbd2430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:07.536338 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:07.536338 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:07.546788 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-15e65eeb-328f-4312-841f-c9ce4aa60291 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:07.558900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-15e65eeb-328f-4312-841f-c9ce4aa60291 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:07.565815 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-15e65eeb-328f-4312-841f-c9ce4aa60291 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:07.574692 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-15e65eeb-328f-4312-841f-c9ce4aa60291 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:07.782287 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-15e65eeb-328f-4312-841f-c9ce4aa60291 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.282862 Jun 16 14:37:07.811682 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 78/141] 10.222.0.57 () {58 vars in 1144 bytes} [Thu Jun 16 14:37:07 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:37:07.823520 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-f0cbe757-1b0f-4889-9025-419f5b1710dd req-5f1b1b50-adad-4817-9f1f-fbe5a2579fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a04c70b9-8bf4-4d60-98f7-bc846e5c2a09", "tag": "49201993-415f-4385-a2cd-53f832cd102f"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:07.911094 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-f0cbe757-1b0f-4889-9025-419f5b1710dd req-5f1b1b50-adad-4817-9f1f-fbe5a2579fae service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:07.918307 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-f0cbe757-1b0f-4889-9025-419f5b1710dd req-5f1b1b50-adad-4817-9f1f-fbe5a2579fae service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:08.059200 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-f0cbe757-1b0f-4889-9025-419f5b1710dd req-5f1b1b50-adad-4817-9f1f-fbe5a2579fae service nova] Creating event network-changed:49201993-415f-4385-a2cd-53f832cd102f for instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 on n-h2-836830-4 Jun 16 14:37:08.065120 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-f0cbe757-1b0f-4889-9025-419f5b1710dd req-5f1b1b50-adad-4817-9f1f-fbe5a2579fae service nova] Acquired lock "compute-rpcapi-router" {{(pid=125862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 14:37:08.076890 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-613db23a-f349-4fff-99ef-aa3d4c9e7e03 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:08.077358 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-613db23a-f349-4fff-99ef-aa3d4c9e7e03 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:08.078224 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-613db23a-f349-4fff-99ef-aa3d4c9e7e03 None None] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:08.081118 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-613db23a-f349-4fff-99ef-aa3d4c9e7e03 None None] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:08.111546 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.compute.rpcapi [None req-613db23a-f349-4fff-99ef-aa3d4c9e7e03 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 14:37:08.113492 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-613db23a-f349-4fff-99ef-aa3d4c9e7e03 None None] Releasing lock "compute-rpcapi-router" {{(pid=125862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 14:37:08.174847 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-613db23a-f349-4fff-99ef-aa3d4c9e7e03 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.366087 Jun 16 14:37:08.176122 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 79/142] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:08.183004 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c8f777a9-e44b-48db-9607-bfd8adec35a4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:08.186703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c8f777a9-e44b-48db-9607-bfd8adec35a4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:08.206940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8f777a9-e44b-48db-9607-bfd8adec35a4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:08.209109 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8f777a9-e44b-48db-9607-bfd8adec35a4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:08.212245 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8f777a9-e44b-48db-9607-bfd8adec35a4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:08.212952 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8f777a9-e44b-48db-9607-bfd8adec35a4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:08.879144 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c8f777a9-e44b-48db-9607-bfd8adec35a4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:08.897600 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c8f777a9-e44b-48db-9607-bfd8adec35a4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1338 microversion: 2.1 time: 0.718408 Jun 16 14:37:08.900837 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 80/143] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:08 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1338 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:09.595195 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9aaac778-8a59-4435-aa70-0f101e037059 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Calling method '.version_select at 0x7fdf0cb31700>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:09.596716 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:09.596716 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:09.598262 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9aaac778-8a59-4435-aa70-0f101e037059 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '1d79ddded5984006a44c38e7dab77799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418e596e547b49be835bd05e4e7fddda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9aaac778-8a59-4435-aa70-0f101e037059 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Request method failure captured: Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0ARrzqabMHqyLC1zpKCBaopnkNizv6S6gL7zyNV0Txz9wFUM60BZnhtIE7L--EZYyBZ8uNMEkDTgXqRerzg2zODMLG3zyPdoNjMkmVL8yEwtWXbI808GpYIE08Cd078SN63ggHZ7NniLCcmffpX-Crm-8L3vbx-b8jzagR5QfXXomA Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 418e596e547b49be835bd05e4e7fddda Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-739268981 Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:37:09.601499 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:37:09.602909 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_418e596e547b49be835bd05e4e7fddda", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/418e596e547b49be835bd05e4e7fddda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/418e596e547b49be835bd05e4e7fddda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/418e596e547b49be835bd05e4e7fddda"}]}] Jun 16 14:37:09.602909 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-739268981 Jun 16 14:37:09.602909 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 418e596e547b49be835bd05e4e7fddda Jun 16 14:37:09.602909 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-739268981 Jun 16 14:37:09.602909 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HypervisorAdminNegativeTestJSON-739268981-project Jun 16 14:37:09.602909 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:37:09.602909 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:37:09.602909 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 1d79ddded5984006a44c38e7dab77799 Jun 16 14:37:09.602909 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-739268981-project Jun 16 14:37:09.602909 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:37:09.602909 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 16 14:37:09.602909 n-d-836830-4 devstack@n-api.service[125862]: action_args: {} Jun 16 14:37:09.602909 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._detail(req) Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:37:09.603850 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 16 14:37:09.605337 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:09.608195 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9aaac778-8a59-4435-aa70-0f101e037059 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:09.609231 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9aaac778-8a59-4435-aa70-0f101e037059 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.704443 Jun 16 14:37:09.609995 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 81/144] 10.222.0.57 () {58 vars in 1166 bytes} [Thu Jun 16 14:37:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 708 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:37:09.617967 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a67ee4fd-314e-4749-93d0-3a7703c4bc07 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:09.618632 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a67ee4fd-314e-4749-93d0-3a7703c4bc07 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:09.623234 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:37:09.624049 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:37:09.624217 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:37:09.624756 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:37:09.625180 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:37:09.639941 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a67ee4fd-314e-4749-93d0-3a7703c4bc07 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:09.641572 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a67ee4fd-314e-4749-93d0-3a7703c4bc07 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:09.643614 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:09.644238 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:09.645220 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:09.646323 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a67ee4fd-314e-4749-93d0-3a7703c4bc07 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:09.646992 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:09.647620 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a67ee4fd-314e-4749-93d0-3a7703c4bc07 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:09.679508 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Getting quotas for project b0484f4c1c304b84a88b7d2be3b9483c. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:37:09.696700 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Getting quotas for user 96fb5660c35642ad9da6d8bb34e393f4 and project b0484f4c1c304b84a88b7d2be3b9483c. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:37:09.764152 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:37:09.771852 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:37:09.972108 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-31608369-15fe-43f5-b847-7061e84eeaf3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.182758 Jun 16 14:37:09.974223 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 64/145] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:37:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:37:10.266371 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2a1552b9-b7c7-4088-8aa7-280469bb1530 tempest-QuotaClassesAdmin257Test-1360833431 tempest-QuotaClassesAdmin257Test-1360833431-project-admin] Calling method '.version_select at 0x7fdf0ca3d820>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:10.271561 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:10.271561 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:10.299085 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a67ee4fd-314e-4749-93d0-3a7703c4bc07 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:10.313284 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a67ee4fd-314e-4749-93d0-3a7703c4bc07 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 0.701823 Jun 16 14:37:10.320928 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 82/146] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:09 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:10.332884 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ed0c172a-345f-43b3-8c1c-e54ca026fd52 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Calling method '.version_select at 0x7fdf0cc92700>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:10.333814 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:10.333814 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:10.336321 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ed0c172a-345f-43b3-8c1c-e54ca026fd52 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '1d79ddded5984006a44c38e7dab77799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418e596e547b49be835bd05e4e7fddda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ed0c172a-345f-43b3-8c1c-e54ca026fd52 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Request method failure captured: Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0ARrzqabMHqyLC1zpKCBaopnkNizv6S6gL7zyNV0Txz9wFUM60BZnhtIE7L--EZYyBZ8uNMEkDTgXqRerzg2zODMLG3zyPdoNjMkmVL8yEwtWXbI808GpYIE08Cd078SN63ggHZ7NniLCcmffpX-Crm-8L3vbx-b8jzagR5QfXXomA Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 418e596e547b49be835bd05e4e7fddda Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-739268981 Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:37:10.338040 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:37:10.339625 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_418e596e547b49be835bd05e4e7fddda", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/418e596e547b49be835bd05e4e7fddda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/418e596e547b49be835bd05e4e7fddda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/418e596e547b49be835bd05e4e7fddda"}]}] Jun 16 14:37:10.339625 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-739268981 Jun 16 14:37:10.339625 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 418e596e547b49be835bd05e4e7fddda Jun 16 14:37:10.339625 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-739268981 Jun 16 14:37:10.339625 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HypervisorAdminNegativeTestJSON-739268981-project Jun 16 14:37:10.339625 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:37:10.339625 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:37:10.339625 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 1d79ddded5984006a44c38e7dab77799 Jun 16 14:37:10.339625 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-739268981-project Jun 16 14:37:10.339625 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:37:10.339625 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 16 14:37:10.339625 n-d-836830-4 devstack@n-api.service[125862]: action_args: {} Jun 16 14:37:10.339625 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:37:10.340581 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 16 14:37:10.342658 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:10.345634 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ed0c172a-345f-43b3-8c1c-e54ca026fd52 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:10.345634 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ed0c172a-345f-43b3-8c1c-e54ca026fd52 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.017247 Jun 16 14:37:10.347026 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 83/147] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:37:10 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:37:10.352804 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fb70af2a-7718-420d-8951-a021d047832f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:10.353437 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fb70af2a-7718-420d-8951-a021d047832f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:10.361101 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2a1552b9-b7c7-4088-8aa7-280469bb1530 tempest-QuotaClassesAdmin257Test-1360833431 tempest-QuotaClassesAdmin257Test-1360833431-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.384221 Jun 16 14:37:10.372754 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 65/148] 10.222.0.57 () {60 vars in 1225 bytes} [Thu Jun 16 14:37:09 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:37:10.380230 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb70af2a-7718-420d-8951-a021d047832f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:10.380986 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb70af2a-7718-420d-8951-a021d047832f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:10.382062 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb70af2a-7718-420d-8951-a021d047832f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:10.387253 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb70af2a-7718-420d-8951-a021d047832f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:10.389899 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-20f2cfbc-23fb-4afd-a7d4-8c4aea3e2ef5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:10.395282 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-20f2cfbc-23fb-4afd-a7d4-8c4aea3e2ef5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:10.672363 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-20f2cfbc-23fb-4afd-a7d4-8c4aea3e2ef5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:10.680995 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fb70af2a-7718-420d-8951-a021d047832f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:10.691862 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fb70af2a-7718-420d-8951-a021d047832f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1338 microversion: 2.1 time: 0.343605 Jun 16 14:37:10.692451 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 84/149] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:10 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1338 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:10.705093 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-20f2cfbc-23fb-4afd-a7d4-8c4aea3e2ef5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1210 microversion: 2.1 time: 0.330844 Jun 16 14:37:10.706845 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c7efc633-7c14-4f34-9fa4-a0c8bf16b941 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Calling method '.version_select at 0x7fdf0cb45a60>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:10.707446 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 66/150] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:10 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1210 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:10.707603 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:10.707603 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:10.708698 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c7efc633-7c14-4f34-9fa4-a0c8bf16b941 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '1d79ddded5984006a44c38e7dab77799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418e596e547b49be835bd05e4e7fddda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c7efc633-7c14-4f34-9fa4-a0c8bf16b941 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Request method failure captured: Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0ARrzqabMHqyLC1zpKCBaopnkNizv6S6gL7zyNV0Txz9wFUM60BZnhtIE7L--EZYyBZ8uNMEkDTgXqRerzg2zODMLG3zyPdoNjMkmVL8yEwtWXbI808GpYIE08Cd078SN63ggHZ7NniLCcmffpX-Crm-8L3vbx-b8jzagR5QfXXomA Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 418e596e547b49be835bd05e4e7fddda Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-739268981 Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:37:10.710312 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:37:10.711789 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_418e596e547b49be835bd05e4e7fddda", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/418e596e547b49be835bd05e4e7fddda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/418e596e547b49be835bd05e4e7fddda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/418e596e547b49be835bd05e4e7fddda"}]}] Jun 16 14:37:10.711789 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-739268981 Jun 16 14:37:10.711789 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 418e596e547b49be835bd05e4e7fddda Jun 16 14:37:10.711789 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-739268981 Jun 16 14:37:10.711789 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HypervisorAdminNegativeTestJSON-739268981-project Jun 16 14:37:10.711789 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:37:10.711789 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:37:10.711789 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 1d79ddded5984006a44c38e7dab77799 Jun 16 14:37:10.711789 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-739268981-project Jun 16 14:37:10.711789 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:37:10.711789 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 16 14:37:10.711789 n-d-836830-4 devstack@n-api.service[125862]: action_args: {} Jun 16 14:37:10.711789 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:37:10.712588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 16 14:37:10.713748 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:10.718026 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c7efc633-7c14-4f34-9fa4-a0c8bf16b941 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:10.722744 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c7efc633-7c14-4f34-9fa4-a0c8bf16b941 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.018977 Jun 16 14:37:10.722941 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 85/151] 10.222.0.57 () {58 vars in 1178 bytes} [Thu Jun 16 14:37:10 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:37:10.732252 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-64edb3a0-3406-4091-91cc-824e92b1aed8 tempest-QuotaClassesAdmin257Test-1360833431 tempest-QuotaClassesAdmin257Test-1360833431-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0c97d5e0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:10.744239 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:10.744239 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:10.965010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-13a93903-1d6e-4d63-8d55-47f212228c52 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Calling method '.version_select at 0x7fdf0cac2310>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:10.966457 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:10.966457 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:10.967771 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-13a93903-1d6e-4d63-8d55-47f212228c52 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:10.968404 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-13a93903-1d6e-4d63-8d55-47f212228c52 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:10.993632 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=3,nova_api:UPDATE=3 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:11.032799 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-13a93903-1d6e-4d63-8d55-47f212228c52 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:11.033283 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-13a93903-1d6e-4d63-8d55-47f212228c52 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:11.097456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-13a93903-1d6e-4d63-8d55-47f212228c52 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:11.098282 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-13a93903-1d6e-4d63-8d55-47f212228c52 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:11.120878 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-13a93903-1d6e-4d63-8d55-47f212228c52 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.389593 Jun 16 14:37:11.150593 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 86/152] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:37:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:11.162241 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d91e0e52-d3e1-461a-ba99-7c5f56c4fd11 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Calling method '.version_select at 0x7fdf0cac2670>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:11.174272 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:11.174272 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:11.180948 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d91e0e52-d3e1-461a-ba99-7c5f56c4fd11 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '1d79ddded5984006a44c38e7dab77799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418e596e547b49be835bd05e4e7fddda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d91e0e52-d3e1-461a-ba99-7c5f56c4fd11 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Request method failure captured: Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0ARrzqabMHqyLC1zpKCBaopnkNizv6S6gL7zyNV0Txz9wFUM60BZnhtIE7L--EZYyBZ8uNMEkDTgXqRerzg2zODMLG3zyPdoNjMkmVL8yEwtWXbI808GpYIE08Cd078SN63ggHZ7NniLCcmffpX-Crm-8L3vbx-b8jzagR5QfXXomA Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 418e596e547b49be835bd05e4e7fddda Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-739268981 Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:37:11.199446 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:37:11.203485 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_418e596e547b49be835bd05e4e7fddda", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/418e596e547b49be835bd05e4e7fddda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/418e596e547b49be835bd05e4e7fddda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/418e596e547b49be835bd05e4e7fddda"}]}] Jun 16 14:37:11.203485 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-739268981 Jun 16 14:37:11.203485 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 418e596e547b49be835bd05e4e7fddda Jun 16 14:37:11.203485 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-739268981 Jun 16 14:37:11.203485 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HypervisorAdminNegativeTestJSON-739268981-project Jun 16 14:37:11.203485 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:37:11.203485 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:37:11.203485 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 1d79ddded5984006a44c38e7dab77799 Jun 16 14:37:11.203485 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-739268981-project Jun 16 14:37:11.203485 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:37:11.203485 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 16 14:37:11.203485 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '1'} Jun 16 14:37:11.203485 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:37:11.205186 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 16 14:37:11.207252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.209317 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d91e0e52-d3e1-461a-ba99-7c5f56c4fd11 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:11.209317 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d91e0e52-d3e1-461a-ba99-7c5f56c4fd11 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.049641 Jun 16 14:37:11.209317 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 87/153] 10.222.0.57 () {58 vars in 1172 bytes} [Thu Jun 16 14:37:11 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:37:11.214354 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dad1d90f-5b93-43f6-a07d-4a79790ba7fa tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Calling method '.version_select at 0x7fdf0cb310d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:11.217543 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-dad1d90f-5b93-43f6-a07d-4a79790ba7fa tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] HTTP exception thrown: Hypervisor with ID 'cc01543d-cc00-4879-b524-6f2db123b80e' could not be found. Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dad1d90f-5b93-43f6-a07d-4a79790ba7fa tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Request method failure captured: Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-hypervisors/cc01543d-cc00-4879-b524-6f2db123b80e/uptime HTTP/1.1 Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0AUvYuidpuW2ZRDO1ScvJEvm-_hEbDMpvY8BInbaV7iAca1gXkuYEt1g03WQv8aF-de6YOfPgsVJWSAHha8LEzEeHqydHb44-Ev_rYoUvwsrZ8iIfYjAC8wiWLScvb-0FrV2isqeH8YTd2gQTVsODth6NSMnVp1aHNjp1hkg1dseLI Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: e9d002290b8c4f268ca90d26b6609142 Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1392601289 Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:37:11.240398 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:37:11.242899 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e9d002290b8c4f268ca90d26b6609142", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9d002290b8c4f268ca90d26b6609142"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9d002290b8c4f268ca90d26b6609142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e9d002290b8c4f268ca90d26b6609142"}]}] Jun 16 14:37:11.242899 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1392601289 Jun 16 14:37:11.242899 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: e9d002290b8c4f268ca90d26b6609142 Jun 16 14:37:11.242899 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1392601289 Jun 16 14:37:11.242899 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin Jun 16 14:37:11.242899 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:37:11.242899 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:37:11.242899 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: b93e4c6d284b406cb746a5a2d69f9e15 Jun 16 14:37:11.242899 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin Jun 16 14:37:11.242899 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:37:11.242899 n-d-836830-4 devstack@n-api.service[125862]: exception: Hypervisor with ID 'cc01543d-cc00-4879-b524-6f2db123b80e' could not be found. Jun 16 14:37:11.242899 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'cc01543d-cc00-4879-b524-6f2db123b80e'} Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'cc01543d-cc00-4879-b524-6f2db123b80e' Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 16 14:37:11.244240 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'cc01543d-cc00-4879-b524-6f2db123b80e' could not be found. Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:11.247656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.253351 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:11.253351 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:11.253351 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:11.253351 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:37:11.253351 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:37:11.253351 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'cc01543d-cc00-4879-b524-6f2db123b80e' could not be found. Jun 16 14:37:11.253351 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.253351 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dad1d90f-5b93-43f6-a07d-4a79790ba7fa tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Returning 404 to user: Hypervisor with ID 'cc01543d-cc00-4879-b524-6f2db123b80e' could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:11.253351 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-dad1d90f-5b93-43f6-a07d-4a79790ba7fa tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/cc01543d-cc00-4879-b524-6f2db123b80e/uptime" status: 404 len: 123 microversion: 2.1 time: 0.032590 Jun 16 14:37:11.254912 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 88/154] 10.222.0.57 () {58 vars in 1277 bytes} [Thu Jun 16 14:37:11 2022] GET /compute/v2.1/os-hypervisors/cc01543d-cc00-4879-b524-6f2db123b80e/uptime => generated 123 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:37:11.279918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0c64a302-a071-4b05-a778-a203e0a6f2e8 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Calling method '.version_select at 0x7fdf0cb310d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:11.281568 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:11.281568 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:11.304223 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c64a302-a071-4b05-a778-a203e0a6f2e8 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:11.310189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c64a302-a071-4b05-a778-a203e0a6f2e8 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:11.372670 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c64a302-a071-4b05-a778-a203e0a6f2e8 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:11.373971 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c64a302-a071-4b05-a778-a203e0a6f2e8 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:11.412345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c64a302-a071-4b05-a778-a203e0a6f2e8 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:11.415892 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c64a302-a071-4b05-a778-a203e0a6f2e8 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:11.461262 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0c64a302-a071-4b05-a778-a203e0a6f2e8 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.199558 Jun 16 14:37:11.469426 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 89/155] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:37:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:11.488338 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-007a4024-8c2e-4880-acf9-4fa6bc1539db tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:11.490623 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-007a4024-8c2e-4880-acf9-4fa6bc1539db tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:11.512217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-007a4024-8c2e-4880-acf9-4fa6bc1539db tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:11.517124 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-007a4024-8c2e-4880-acf9-4fa6bc1539db tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:11.519774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-007a4024-8c2e-4880-acf9-4fa6bc1539db tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:11.521026 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-007a4024-8c2e-4880-acf9-4fa6bc1539db tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:11.533260 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-64edb3a0-3406-4091-91cc-824e92b1aed8 tempest-QuotaClassesAdmin257Test-1360833431 tempest-QuotaClassesAdmin257Test-1360833431-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.818139 Jun 16 14:37:11.536629 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 67/156] 10.222.0.57 () {62 vars in 1246 bytes} [Thu Jun 16 14:37:10 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:37:11.567558 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3d51077f-006d-44b6-b15d-0b7f5fbd79f2 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Calling method '.version_select at 0x7fdf0c8ab310>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:11.580724 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:11.580724 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:11.591918 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3d51077f-006d-44b6-b15d-0b7f5fbd79f2 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '1d79ddded5984006a44c38e7dab77799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418e596e547b49be835bd05e4e7fddda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3d51077f-006d-44b6-b15d-0b7f5fbd79f2 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Request method failure captured: Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0ARrzqabMHqyLC1zpKCBaopnkNizv6S6gL7zyNV0Txz9wFUM60BZnhtIE7L--EZYyBZ8uNMEkDTgXqRerzg2zODMLG3zyPdoNjMkmVL8yEwtWXbI808GpYIE08Cd078SN63ggHZ7NniLCcmffpX-Crm-8L3vbx-b8jzagR5QfXXomA Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 418e596e547b49be835bd05e4e7fddda Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-739268981 Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:37:11.596482 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:37:11.598775 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_418e596e547b49be835bd05e4e7fddda", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/418e596e547b49be835bd05e4e7fddda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/418e596e547b49be835bd05e4e7fddda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/418e596e547b49be835bd05e4e7fddda"}]}] Jun 16 14:37:11.598775 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-739268981 Jun 16 14:37:11.598775 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 418e596e547b49be835bd05e4e7fddda Jun 16 14:37:11.598775 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-739268981 Jun 16 14:37:11.598775 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-HypervisorAdminNegativeTestJSON-739268981-project Jun 16 14:37:11.598775 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:37:11.598775 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:37:11.598775 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 1d79ddded5984006a44c38e7dab77799 Jun 16 14:37:11.598775 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-739268981-project Jun 16 14:37:11.598775 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:37:11.598775 n-d-836830-4 devstack@n-api.service[125863]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 16 14:37:11.598775 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '1'} Jun 16 14:37:11.598775 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:37:11.600231 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 16 14:37:11.602235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.620775 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3d51077f-006d-44b6-b15d-0b7f5fbd79f2 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:11.623502 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3d51077f-006d-44b6-b15d-0b7f5fbd79f2 tempest-HypervisorAdminNegativeTestJSON-739268981 tempest-HypervisorAdminNegativeTestJSON-739268981-project] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.073526 Jun 16 14:37:11.624837 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 68/157] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:37:11 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 88 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:37:11.648076 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c05a4f4a-cf2e-477e-a4e7-d901ce787c30 tempest-QuotaClassesAdmin257Test-1360833431 tempest-QuotaClassesAdmin257Test-1360833431-project-admin] Calling method '.version_select at 0x7fdf0c8611f0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:11.650403 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:11.650403 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:11.696281 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c05a4f4a-cf2e-477e-a4e7-d901ce787c30 tempest-QuotaClassesAdmin257Test-1360833431 tempest-QuotaClassesAdmin257Test-1360833431-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.069173 Jun 16 14:37:11.697900 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 69/158] 10.222.0.57 () {60 vars in 1225 bytes} [Thu Jun 16 14:37:11 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:37:11.709102 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8632754f-bd09-4ac2-b81f-cfa1523350e3 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Calling method '.version_select at 0x7fdf0c843820>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:11.737097 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-8632754f-bd09-4ac2-b81f-cfa1523350e3 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] HTTP exception thrown: Hypervisor with ID '7a96185a-6aa1-4e6c-a114-8773e02f8b2c' could not be found. Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8632754f-bd09-4ac2-b81f-cfa1523350e3 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Request method failure captured: Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/os-hypervisors/7a96185a-6aa1-4e6c-a114-8773e02f8b2c HTTP/1.1 Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0AUvYuidpuW2ZRDO1ScvJEvm-_hEbDMpvY8BInbaV7iAca1gXkuYEt1g03WQv8aF-de6YOfPgsVJWSAHha8LEzEeHqydHb44-Ev_rYoUvwsrZ8iIfYjAC8wiWLScvb-0FrV2isqeH8YTd2gQTVsODth6NSMnVp1aHNjp1hkg1dseLI Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: e9d002290b8c4f268ca90d26b6609142 Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1392601289 Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:37:11.793759 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:37:11.797702 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e9d002290b8c4f268ca90d26b6609142", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9d002290b8c4f268ca90d26b6609142"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e9d002290b8c4f268ca90d26b6609142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e9d002290b8c4f268ca90d26b6609142"}]}] Jun 16 14:37:11.797702 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1392601289 Jun 16 14:37:11.797702 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: e9d002290b8c4f268ca90d26b6609142 Jun 16 14:37:11.797702 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1392601289 Jun 16 14:37:11.797702 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin Jun 16 14:37:11.797702 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:37:11.797702 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:37:11.797702 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: b93e4c6d284b406cb746a5a2d69f9e15 Jun 16 14:37:11.797702 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin Jun 16 14:37:11.797702 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:37:11.797702 n-d-836830-4 devstack@n-api.service[125863]: exception: Hypervisor with ID '7a96185a-6aa1-4e6c-a114-8773e02f8b2c' could not be found. Jun 16 14:37:11.797702 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '7a96185a-6aa1-4e6c-a114-8773e02f8b2c'} Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '7a96185a-6aa1-4e6c-a114-8773e02f8b2c' Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 16 14:37:11.799469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 14:37:11.802108 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '7a96185a-6aa1-4e6c-a114-8773e02f8b2c' could not be found. Jun 16 14:37:11.807049 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.807049 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:11.807049 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.807049 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:11.807049 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:11.807049 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:11.807049 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:37:11.807049 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:37:11.807049 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '7a96185a-6aa1-4e6c-a114-8773e02f8b2c' could not be found. Jun 16 14:37:11.807049 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:11.813823 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8632754f-bd09-4ac2-b81f-cfa1523350e3 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] Returning 404 to user: Hypervisor with ID '7a96185a-6aa1-4e6c-a114-8773e02f8b2c' could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:11.818962 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8632754f-bd09-4ac2-b81f-cfa1523350e3 tempest-HypervisorAdminNegativeTestJSON-1392601289 tempest-HypervisorAdminNegativeTestJSON-1392601289-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/7a96185a-6aa1-4e6c-a114-8773e02f8b2c" status: 404 len: 123 microversion: 2.1 time: 0.113115 Jun 16 14:37:11.837896 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 70/159] 10.222.0.57 () {58 vars in 1256 bytes} [Thu Jun 16 14:37:11 2022] GET /compute/v2.1/os-hypervisors/7a96185a-6aa1-4e6c-a114-8773e02f8b2c => generated 123 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:37:11.864273 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8f5c27e7-546c-4549-9359-7727483c17ca tempest-QuotaClassesAdmin257Test-1360833431 tempest-QuotaClassesAdmin257Test-1360833431-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0c97d4c0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:12.225690 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8f5c27e7-546c-4549-9359-7727483c17ca tempest-QuotaClassesAdmin257Test-1360833431 tempest-QuotaClassesAdmin257Test-1360833431-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.378373 Jun 16 14:37:12.243197 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 71/160] 10.222.0.57 () {62 vars in 1246 bytes} [Thu Jun 16 14:37:11 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:37:12.272039 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-76b28a87-9883-474b-a6f4-fdbe3c447100 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:12.279695 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-76b28a87-9883-474b-a6f4-fdbe3c447100 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:12.328974 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-76b28a87-9883-474b-a6f4-fdbe3c447100 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:12.331936 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-76b28a87-9883-474b-a6f4-fdbe3c447100 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:12.338623 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-76b28a87-9883-474b-a6f4-fdbe3c447100 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:12.339855 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-76b28a87-9883-474b-a6f4-fdbe3c447100 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:12.883059 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-007a4024-8c2e-4880-acf9-4fa6bc1539db tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:12.935062 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-007a4024-8c2e-4880-acf9-4fa6bc1539db tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 1.461885 Jun 16 14:37:12.950689 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 90/161] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:11 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:12.977143 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e78a89e5-7d18-492d-8553-c0be6ab62116 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:12.985319 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e78a89e5-7d18-492d-8553-c0be6ab62116 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:13.033936 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e78a89e5-7d18-492d-8553-c0be6ab62116 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:13.037678 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e78a89e5-7d18-492d-8553-c0be6ab62116 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:13.043365 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e78a89e5-7d18-492d-8553-c0be6ab62116 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:13.050709 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e78a89e5-7d18-492d-8553-c0be6ab62116 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:13.469349 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-76b28a87-9883-474b-a6f4-fdbe3c447100 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:13.480466 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-76b28a87-9883-474b-a6f4-fdbe3c447100 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1338 microversion: 2.1 time: 1.234415 Jun 16 14:37:13.482127 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 72/162] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:12 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1338 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:13.570131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e78a89e5-7d18-492d-8553-c0be6ab62116 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:13.584745 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e78a89e5-7d18-492d-8553-c0be6ab62116 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1270 microversion: 2.1 time: 0.639878 Jun 16 14:37:13.600339 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 91/163] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:12 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1270 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:13.970161 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bb8d22e8-28a1-4713-96c6-640a0abb48d3 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:13.971679 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bb8d22e8-28a1-4713-96c6-640a0abb48d3 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:13.985539 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb8d22e8-28a1-4713-96c6-640a0abb48d3 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:13.985937 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb8d22e8-28a1-4713-96c6-640a0abb48d3 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:13.987792 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb8d22e8-28a1-4713-96c6-640a0abb48d3 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:13.988403 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb8d22e8-28a1-4713-96c6-640a0abb48d3 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:14.523674 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-275e61cc-7f17-40e2-a993-c407ab490857 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:14.527177 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-275e61cc-7f17-40e2-a993-c407ab490857 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:14.543489 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-275e61cc-7f17-40e2-a993-c407ab490857 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:14.546854 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-275e61cc-7f17-40e2-a993-c407ab490857 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:14.549431 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-275e61cc-7f17-40e2-a993-c407ab490857 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:14.551111 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-275e61cc-7f17-40e2-a993-c407ab490857 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:14.999901 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bb8d22e8-28a1-4713-96c6-640a0abb48d3 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:15.009582 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bb8d22e8-28a1-4713-96c6-640a0abb48d3 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 1.045216 Jun 16 14:37:15.014083 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 73/164] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:13 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:15.027661 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f328fb4a-e873-43a6-9f40-8b35a407b77c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:15.029150 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f328fb4a-e873-43a6-9f40-8b35a407b77c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:15.040977 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f328fb4a-e873-43a6-9f40-8b35a407b77c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:15.041445 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f328fb4a-e873-43a6-9f40-8b35a407b77c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:15.042698 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f328fb4a-e873-43a6-9f40-8b35a407b77c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:15.043305 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f328fb4a-e873-43a6-9f40-8b35a407b77c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:15.240649 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-275e61cc-7f17-40e2-a993-c407ab490857 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:15.282497 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-275e61cc-7f17-40e2-a993-c407ab490857 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1338 microversion: 2.1 time: 0.773665 Jun 16 14:37:15.286561 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f328fb4a-e873-43a6-9f40-8b35a407b77c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:15.289332 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 92/165] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:14 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1338 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:37:15.328757 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f328fb4a-e873-43a6-9f40-8b35a407b77c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1268 microversion: 2.1 time: 0.311436 Jun 16 14:37:15.330720 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 74/166] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:15 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1268 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:16.034933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cd3bfc25-9f05-4f55-b040-e853d2dede77 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:16.035635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cd3bfc25-9f05-4f55-b040-e853d2dede77 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:16.050070 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd3bfc25-9f05-4f55-b040-e853d2dede77 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:16.050582 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd3bfc25-9f05-4f55-b040-e853d2dede77 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:16.051385 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd3bfc25-9f05-4f55-b040-e853d2dede77 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:16.051892 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd3bfc25-9f05-4f55-b040-e853d2dede77 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:16.307703 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-20833386-d468-4e0c-8afc-9da8d85bdf9f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:16.309828 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-20833386-d468-4e0c-8afc-9da8d85bdf9f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:16.327013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-20833386-d468-4e0c-8afc-9da8d85bdf9f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:16.328120 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-20833386-d468-4e0c-8afc-9da8d85bdf9f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:16.329707 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-20833386-d468-4e0c-8afc-9da8d85bdf9f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:16.330766 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-20833386-d468-4e0c-8afc-9da8d85bdf9f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:16.855191 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-20833386-d468-4e0c-8afc-9da8d85bdf9f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:16.890805 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-20833386-d468-4e0c-8afc-9da8d85bdf9f tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1338 microversion: 2.1 time: 0.590152 Jun 16 14:37:16.903037 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 75/167] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:16 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1338 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:16.924129 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-aba0115c-5b98-417c-a8d0-b22bf1de8789 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:16.925436 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-aba0115c-5b98-417c-a8d0-b22bf1de8789 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:16.948781 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aba0115c-5b98-417c-a8d0-b22bf1de8789 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:16.952190 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aba0115c-5b98-417c-a8d0-b22bf1de8789 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:16.957887 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aba0115c-5b98-417c-a8d0-b22bf1de8789 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:16.960784 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aba0115c-5b98-417c-a8d0-b22bf1de8789 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:16.970231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cd3bfc25-9f05-4f55-b040-e853d2dede77 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:16.994550 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cd3bfc25-9f05-4f55-b040-e853d2dede77 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 0.963534 Jun 16 14:37:17.002283 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 93/168] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:16 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:17.386093 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-aba0115c-5b98-417c-a8d0-b22bf1de8789 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:17.435176 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-aba0115c-5b98-417c-a8d0-b22bf1de8789 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1310 microversion: 2.1 time: 0.528083 Jun 16 14:37:17.438425 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 76/169] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:16 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1310 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:17.923510 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6bfdbfff-d88f-435b-8eff-d9e46769b523 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:17.926110 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6bfdbfff-d88f-435b-8eff-d9e46769b523 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:17.940635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6bfdbfff-d88f-435b-8eff-d9e46769b523 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:17.941584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6bfdbfff-d88f-435b-8eff-d9e46769b523 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:17.949004 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6bfdbfff-d88f-435b-8eff-d9e46769b523 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:17.953064 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6bfdbfff-d88f-435b-8eff-d9e46769b523 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:18.031772 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a95db453-5bba-4b15-af30-a942c7f98736 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:18.032478 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a95db453-5bba-4b15-af30-a942c7f98736 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:18.049078 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a95db453-5bba-4b15-af30-a942c7f98736 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:18.050620 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a95db453-5bba-4b15-af30-a942c7f98736 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:18.054530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a95db453-5bba-4b15-af30-a942c7f98736 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:18.055377 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a95db453-5bba-4b15-af30-a942c7f98736 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:18.105247 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:18.465210 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6bfdbfff-d88f-435b-8eff-d9e46769b523 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:18.498930 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6bfdbfff-d88f-435b-8eff-d9e46769b523 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1338 microversion: 2.1 time: 0.577973 Jun 16 14:37:18.506655 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 94/170] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:17 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1338 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:18.564885 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a95db453-5bba-4b15-af30-a942c7f98736 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:18.614440 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a95db453-5bba-4b15-af30-a942c7f98736 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 0.588674 Jun 16 14:37:18.626032 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 77/171] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:18 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:37:18.636967 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-24585c24-1d79-4a25-acdb-afd930d1b279 req-014a0e70-3f30-45ed-ba10-76e67854e067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea3c31ac-af0e-4b6f-ab6a-36316a393d77", "tag": "75ab1982-70e8-4bb1-a9d6-1f4b0b0997f2"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:18.695547 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-24585c24-1d79-4a25-acdb-afd930d1b279 req-014a0e70-3f30-45ed-ba10-76e67854e067 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:18.696260 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-24585c24-1d79-4a25-acdb-afd930d1b279 req-014a0e70-3f30-45ed-ba10-76e67854e067 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:18.751281 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-24585c24-1d79-4a25-acdb-afd930d1b279 req-014a0e70-3f30-45ed-ba10-76e67854e067 service nova] Creating event network-changed:75ab1982-70e8-4bb1-a9d6-1f4b0b0997f2 for instance ea3c31ac-af0e-4b6f-ab6a-36316a393d77 on n-h1-836830-4 Jun 16 14:37:18.783667 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-24585c24-1d79-4a25-acdb-afd930d1b279 req-014a0e70-3f30-45ed-ba10-76e67854e067 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146821 Jun 16 14:37:18.787429 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 78/172] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:18.809542 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0b9c2253-7150-4608-99a5-296a48c676c5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:18.812173 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0b9c2253-7150-4608-99a5-296a48c676c5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:18.840610 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0b9c2253-7150-4608-99a5-296a48c676c5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:18.845445 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0b9c2253-7150-4608-99a5-296a48c676c5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:18.848429 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0b9c2253-7150-4608-99a5-296a48c676c5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:18.852646 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0b9c2253-7150-4608-99a5-296a48c676c5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:19.047044 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-4b72dbda-44ba-4284-90e0-ca57705d2488 req-26147f56-f76a-44e1-abc9-4aac9b7c3582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6537907c-347c-4c0e-85c2-10b57fd8fd50", "name": "network-vif-plugged", "status": "completed", "tag": "533d1601-49c7-48a2-96b9-1c108accf4c4"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:19.067346 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-4b72dbda-44ba-4284-90e0-ca57705d2488 req-26147f56-f76a-44e1-abc9-4aac9b7c3582 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:19.067814 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-4b72dbda-44ba-4284-90e0-ca57705d2488 req-26147f56-f76a-44e1-abc9-4aac9b7c3582 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:19.095521 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-4b72dbda-44ba-4284-90e0-ca57705d2488 req-26147f56-f76a-44e1-abc9-4aac9b7c3582 service nova] Creating event network-vif-plugged:533d1601-49c7-48a2-96b9-1c108accf4c4 for instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 on n-h1-836830-4 Jun 16 14:37:19.105494 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-4b72dbda-44ba-4284-90e0-ca57705d2488 req-26147f56-f76a-44e1-abc9-4aac9b7c3582 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.595463 Jun 16 14:37:19.107468 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 95/173] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:19.291849 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0b9c2253-7150-4608-99a5-296a48c676c5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:19.313910 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0b9c2253-7150-4608-99a5-296a48c676c5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1310 microversion: 2.1 time: 0.524014 Jun 16 14:37:19.342950 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 79/174] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:18 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1310 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:19.533538 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b5f33779-4f53-46b6-88d8-d7e85d42e481 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:19.534918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b5f33779-4f53-46b6-88d8-d7e85d42e481 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:19.558450 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b5f33779-4f53-46b6-88d8-d7e85d42e481 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:19.559173 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b5f33779-4f53-46b6-88d8-d7e85d42e481 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:19.564205 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b5f33779-4f53-46b6-88d8-d7e85d42e481 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:19.564972 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b5f33779-4f53-46b6-88d8-d7e85d42e481 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:19.665704 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6124be4d-6bf2-448d-9cc8-23f9d230750c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:19.677588 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6124be4d-6bf2-448d-9cc8-23f9d230750c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:19.693518 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=6 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:19.706917 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6124be4d-6bf2-448d-9cc8-23f9d230750c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:19.708767 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6124be4d-6bf2-448d-9cc8-23f9d230750c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:19.711940 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6124be4d-6bf2-448d-9cc8-23f9d230750c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:19.713328 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6124be4d-6bf2-448d-9cc8-23f9d230750c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:19.994896 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b5f33779-4f53-46b6-88d8-d7e85d42e481 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:20.010426 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b5f33779-4f53-46b6-88d8-d7e85d42e481 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1338 microversion: 2.1 time: 0.483682 Jun 16 14:37:20.023281 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 96/175] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:19 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1338 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:37:20.299792 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6124be4d-6bf2-448d-9cc8-23f9d230750c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:20.333205 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6124be4d-6bf2-448d-9cc8-23f9d230750c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 0.681396 Jun 16 14:37:20.345993 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 80/176] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:19 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:20.356287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b50c5121-93ee-4a97-886e-e29625f94bee tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:20.358727 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b50c5121-93ee-4a97-886e-e29625f94bee tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:20.378478 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b50c5121-93ee-4a97-886e-e29625f94bee tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:20.379142 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b50c5121-93ee-4a97-886e-e29625f94bee tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:20.380304 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b50c5121-93ee-4a97-886e-e29625f94bee tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:20.380778 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b50c5121-93ee-4a97-886e-e29625f94bee tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:20.745060 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b50c5121-93ee-4a97-886e-e29625f94bee tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:20.774210 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b50c5121-93ee-4a97-886e-e29625f94bee tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1310 microversion: 2.1 time: 0.420856 Jun 16 14:37:20.788954 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 97/177] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:20 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1310 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:37:21.035575 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8e7ec22a-49a5-4d8a-999a-2732ccf6c6d3 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:21.042343 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8e7ec22a-49a5-4d8a-999a-2732ccf6c6d3 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:21.068340 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8e7ec22a-49a5-4d8a-999a-2732ccf6c6d3 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:21.070875 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8e7ec22a-49a5-4d8a-999a-2732ccf6c6d3 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:21.072121 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8e7ec22a-49a5-4d8a-999a-2732ccf6c6d3 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:21.073635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8e7ec22a-49a5-4d8a-999a-2732ccf6c6d3 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:21.174289 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-a8bff4db-15df-42db-938b-45f847dc8a27 req-474dd6b7-b9c5-49a1-bfbe-15d6396fa187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a04c70b9-8bf4-4d60-98f7-bc846e5c2a09", "name": "network-vif-plugged", "status": "completed", "tag": "49201993-415f-4385-a2cd-53f832cd102f"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:21.204804 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-a8bff4db-15df-42db-938b-45f847dc8a27 req-474dd6b7-b9c5-49a1-bfbe-15d6396fa187 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:21.213487 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-a8bff4db-15df-42db-938b-45f847dc8a27 req-474dd6b7-b9c5-49a1-bfbe-15d6396fa187 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:21.241482 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:21.292291 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-a8bff4db-15df-42db-938b-45f847dc8a27 req-474dd6b7-b9c5-49a1-bfbe-15d6396fa187 service nova] Creating event network-vif-plugged:49201993-415f-4385-a2cd-53f832cd102f for instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 on n-h2-836830-4 Jun 16 14:37:21.339287 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-a8bff4db-15df-42db-938b-45f847dc8a27 req-474dd6b7-b9c5-49a1-bfbe-15d6396fa187 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151673 Jun 16 14:37:21.345028 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 98/178] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:21.391909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-35ae5d95-f5ae-456e-b636-e762f44c305e tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:21.402158 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-35ae5d95-f5ae-456e-b636-e762f44c305e tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:21.439616 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35ae5d95-f5ae-456e-b636-e762f44c305e tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:21.440937 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35ae5d95-f5ae-456e-b636-e762f44c305e tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:21.446289 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35ae5d95-f5ae-456e-b636-e762f44c305e tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:21.447627 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35ae5d95-f5ae-456e-b636-e762f44c305e tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:21.525971 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8e7ec22a-49a5-4d8a-999a-2732ccf6c6d3 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:21.538164 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8e7ec22a-49a5-4d8a-999a-2732ccf6c6d3 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1338 microversion: 2.1 time: 0.512631 Jun 16 14:37:21.548754 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 81/179] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:21 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1338 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:21.802611 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8769d00a-0744-4dcd-bf6d-5bb30632c474 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:21.803726 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8769d00a-0744-4dcd-bf6d-5bb30632c474 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:21.818284 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8769d00a-0744-4dcd-bf6d-5bb30632c474 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:21.820312 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8769d00a-0744-4dcd-bf6d-5bb30632c474 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:21.824165 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8769d00a-0744-4dcd-bf6d-5bb30632c474 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:21.827230 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8769d00a-0744-4dcd-bf6d-5bb30632c474 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:22.179857 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8769d00a-0744-4dcd-bf6d-5bb30632c474 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:22.195624 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8769d00a-0744-4dcd-bf6d-5bb30632c474 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1310 microversion: 2.1 time: 0.397467 Jun 16 14:37:22.197119 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 82/180] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:21 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1310 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:22.211989 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=37,nova_cell0:UPDATE=7 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:22.429806 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-35ae5d95-f5ae-456e-b636-e762f44c305e tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:22.449937 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-35ae5d95-f5ae-456e-b636-e762f44c305e tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 1.097881 Jun 16 14:37:22.452814 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 99/181] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:21 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:22.562559 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4e74e6e9-2de3-424d-9824-c2c63263408e tempest-QuotaClassesAdminTestJSON-312487085 tempest-QuotaClassesAdminTestJSON-312487085-project-admin] Calling method '.version_select at 0x7fdf0c8abd30>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:22.564071 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:22.564071 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:22.582227 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4e74e6e9-2de3-424d-9824-c2c63263408e tempest-QuotaClassesAdminTestJSON-312487085 tempest-QuotaClassesAdminTestJSON-312487085-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.383479 Jun 16 14:37:22.583149 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 83/182] 10.222.0.57 () {58 vars in 1184 bytes} [Thu Jun 16 14:37:22 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:22.589953 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e0828f24-7117-4fc6-86b6-bd6693ab6bf9 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:22.592542 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e0828f24-7117-4fc6-86b6-bd6693ab6bf9 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:22.600491 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e0828f24-7117-4fc6-86b6-bd6693ab6bf9 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:22.601946 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e0828f24-7117-4fc6-86b6-bd6693ab6bf9 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:22.602859 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e0828f24-7117-4fc6-86b6-bd6693ab6bf9 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:22.603421 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e0828f24-7117-4fc6-86b6-bd6693ab6bf9 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:22.627843 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3ee4c467-419d-431f-875d-7bbae2aa240f tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] Action: 'create', calling method: .version_select at 0x7fdf0cac21f0>, body: {"keypair": {"name": "tempest-keypair-1113115437", "type": "ssh", "user_id": "ebbb08dcf78448db93753d15e9712744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFl27Ffwk/yFufV+XtIIffEDxZAMnkXF5U40RI0Yxwep691Kk6WZNFSmXHh5erTLrK6LJhlcGTCdrzqzsK1Mr60soyQCvt9wJ3/caLJWDizAtfFcnxhhkcXjt1XyOCZsQ=="}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:22.707826 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-3ee4c467-419d-431f-875d-7bbae2aa240f tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] Getting quotas for project 5b098df25daa4772a99c8b5983dac00e. Resources: {'key_pairs'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:37:22.734173 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=55 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:22.736921 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-3ee4c467-419d-431f-875d-7bbae2aa240f tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] Getting quotas for user 0809a33f75fa41bfab0c901363143e42 and project 5b098df25daa4772a99c8b5983dac00e. Resources: {'key_pairs'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:37:22.817088 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3ee4c467-419d-431f-875d-7bbae2aa240f tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.361552 Jun 16 14:37:22.834151 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 100/183] 10.222.0.57 () {62 vars in 1199 bytes} [Thu Jun 16 14:37:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 379 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 14:37:22.847242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-68c08d95-c751-4c9a-afdf-1e62173c4211 tempest-QuotaClassesAdminTestJSON-312487085 tempest-QuotaClassesAdminTestJSON-312487085-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0ce45c10>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:22.851388 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:22.851388 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:23.386441 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e0828f24-7117-4fc6-86b6-bd6693ab6bf9 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:23.417591 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e0828f24-7117-4fc6-86b6-bd6693ab6bf9 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1338 microversion: 2.1 time: 0.832810 Jun 16 14:37:23.418329 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 84/184] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:22 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1338 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:23.432175 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f6b9549e-216c-4a49-86cb-2195f0535d46 tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] Action: 'create', calling method: .version_select at 0x7fdf0caf6d30>, body: {"keypair": {"name": "tempest-keypair-94203855", "type": "ssh", "user_id": "ebbb08dcf78448db93753d15e9712744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBIuVll/za3NPftq58M5CbRIfNPhwVeIjwWkJwb+0P5ZiicMCC1SNUgcXuTdIGU+i3rEGc0pMyiJdoHq4Vhj5sSTebsHZS4/8IJwzlXR06TfEHDpubspkXFY8Q93Fh/rA=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:23.490651 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-f6b9549e-216c-4a49-86cb-2195f0535d46 tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] Getting quotas for project 5b098df25daa4772a99c8b5983dac00e. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:37:23.505933 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-f6b9549e-216c-4a49-86cb-2195f0535d46 tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] Getting quotas for user 0809a33f75fa41bfab0c901363143e42 and project 5b098df25daa4772a99c8b5983dac00e. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:37:23.598767 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f6b9549e-216c-4a49-86cb-2195f0535d46 tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.170669 Jun 16 14:37:23.599606 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 85/185] 10.222.0.57 () {62 vars in 1199 bytes} [Thu Jun 16 14:37:23 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 14:37:23.605246 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f29adafc-e340-42ca-aa85-8d6603f69e71 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:23.615359 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f29adafc-e340-42ca-aa85-8d6603f69e71 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:23.628279 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-68c08d95-c751-4c9a-afdf-1e62173c4211 tempest-QuotaClassesAdminTestJSON-312487085 tempest-QuotaClassesAdminTestJSON-312487085-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.791789 Jun 16 14:37:23.630558 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f29adafc-e340-42ca-aa85-8d6603f69e71 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:23.631132 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 101/186] 10.222.0.57 () {60 vars in 1205 bytes} [Thu Jun 16 14:37:22 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:23.632903 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f29adafc-e340-42ca-aa85-8d6603f69e71 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:23.633777 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f29adafc-e340-42ca-aa85-8d6603f69e71 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:23.634223 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f29adafc-e340-42ca-aa85-8d6603f69e71 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:23.649053 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-60daba94-bff2-4de2-a4ea-847876850ad7 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:23.649053 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-60daba94-bff2-4de2-a4ea-847876850ad7 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:23.674527 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-60daba94-bff2-4de2-a4ea-847876850ad7 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:23.676505 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-60daba94-bff2-4de2-a4ea-847876850ad7 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:23.680300 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-60daba94-bff2-4de2-a4ea-847876850ad7 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:23.684893 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-60daba94-bff2-4de2-a4ea-847876850ad7 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:24.046128 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f29adafc-e340-42ca-aa85-8d6603f69e71 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:24.063162 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f29adafc-e340-42ca-aa85-8d6603f69e71 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1310 microversion: 2.1 time: 0.461787 Jun 16 14:37:24.063986 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 86/187] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:23 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1310 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:24.071157 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0b8187a3-5fcc-4b62-81a3-2b270e804268 tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] Calling method '.version_select at 0x7fdf0c8dff70>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:24.105978 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0b8187a3-5fcc-4b62-81a3-2b270e804268 tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] 10.222.0.57 "GET /compute/v2.1/os-keypairs/tempest-keypair-1113115437?user_id=ebbb08dcf78448db93753d15e9712744" status: 200 len: 512 microversion: 2.10 time: 0.040751 Jun 16 14:37:24.111445 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 87/188] 10.222.0.57 () {60 vars in 1339 bytes} [Thu Jun 16 14:37:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1113115437?user_id=ebbb08dcf78448db93753d15e9712744 => generated 512 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:37:24.117559 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2c9d7a16-29e8-4f3a-be81-b2f9fb6042e6 tempest-QuotaClassesAdminTestJSON-312487085 tempest-QuotaClassesAdminTestJSON-312487085-project-admin] Calling method '.version_select at 0x7fdf0c8dfd30>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:24.125441 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:24.125441 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:24.146128 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2c9d7a16-29e8-4f3a-be81-b2f9fb6042e6 tempest-QuotaClassesAdminTestJSON-312487085 tempest-QuotaClassesAdminTestJSON-312487085-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.033258 Jun 16 14:37:24.151343 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 88/189] 10.222.0.57 () {58 vars in 1184 bytes} [Thu Jun 16 14:37:24 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:24.160027 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4ec1e0bc-3835-4012-9a63-0395f851f2bb tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] Action: 'create', calling method: .version_select at 0x7fdf0c8ab0d0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2044445657", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOLYPz/uZ16uahXd2fxWw83JlWeWRph3HyJSrG0yhqOuop6+joW/NnDnNf5O7lBi2WelEnJ9hN/hJsp9bNgRNNVAnOtUcdouajLYKmrNeI4jQXvfTO/SnWcyuclLT++sA=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:24.227519 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-4ec1e0bc-3835-4012-9a63-0395f851f2bb tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] Getting quotas for project 5b098df25daa4772a99c8b5983dac00e. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:37:24.248921 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-4ec1e0bc-3835-4012-9a63-0395f851f2bb tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] Getting quotas for user 0809a33f75fa41bfab0c901363143e42 and project 5b098df25daa4772a99c8b5983dac00e. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:37:24.294092 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4ec1e0bc-3835-4012-9a63-0395f851f2bb tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.138642 Jun 16 14:37:24.306134 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 89/190] 10.222.0.57 () {62 vars in 1199 bytes} [Thu Jun 16 14:37:24 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 14:37:24.317337 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-664423ae-16a8-4c75-847b-b8b8e4586049 tempest-QuotaClassesAdminTestJSON-312487085 tempest-QuotaClassesAdminTestJSON-312487085-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0c8619d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:24.322584 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:24.322584 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:24.380881 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=13,nova_api:INSERT=6 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:24.491203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-60daba94-bff2-4de2-a4ea-847876850ad7 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:24.511608 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-60daba94-bff2-4de2-a4ea-847876850ad7 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1319 microversion: 2.1 time: 0.877447 Jun 16 14:37:24.514101 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 102/191] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:23 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1319 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:24.529420 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0f29feab-5a61-453b-a708-cdd939842342 tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] Calling method '.version_select at 0x7fdf0ca01550>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:24.552325 n-d-836830-4 devstack@n-api.service[125862]: WARNING oslo_db.sqlalchemy.utils [None req-0f29feab-5a61-453b-a708-cdd939842342 tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jun 16 14:37:24.566668 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0f29feab-5a61-453b-a708-cdd939842342 tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] 10.222.0.57 "GET /compute/v2.1/os-keypairs?user_id=ebbb08dcf78448db93753d15e9712744" status: 200 len: 724 microversion: 2.10 time: 0.039697 Jun 16 14:37:24.571909 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 103/192] 10.222.0.57 () {60 vars in 1258 bytes} [Thu Jun 16 14:37:24 2022] GET /compute/v2.1/os-keypairs?user_id=ebbb08dcf78448db93753d15e9712744 => generated 724 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:37:24.579149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0a4c1642-6ce3-4ff6-bb5d-23085f232d91 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:24.580367 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0a4c1642-6ce3-4ff6-bb5d-23085f232d91 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:24.593443 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0a4c1642-6ce3-4ff6-bb5d-23085f232d91 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:24.595288 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0a4c1642-6ce3-4ff6-bb5d-23085f232d91 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:24.600541 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0a4c1642-6ce3-4ff6-bb5d-23085f232d91 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:24.601456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0a4c1642-6ce3-4ff6-bb5d-23085f232d91 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:24.683387 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-664423ae-16a8-4c75-847b-b8b8e4586049 tempest-QuotaClassesAdminTestJSON-312487085 tempest-QuotaClassesAdminTestJSON-312487085-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.371968 Jun 16 14:37:24.688700 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 90/193] 10.222.0.57 () {60 vars in 1205 bytes} [Thu Jun 16 14:37:24 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:24.724034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0cee2cb6-fde8-497b-b04a-e1929b35d4a9 tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] Calling method '.version_select at 0x7fdf0c97d4c0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:24.793338 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0cee2cb6-fde8-497b-b04a-e1929b35d4a9 tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2044445657" status: 204 len: 0 microversion: 2.10 time: 0.102002 Jun 16 14:37:24.793940 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 91/194] 10.222.0.57 () {60 vars in 1324 bytes} [Thu Jun 16 14:37:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2044445657 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 14:37:24.815610 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b3d1f30f-8c52-4c21-8618-87d8c555cee4 tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] Calling method '.version_select at 0x7fdf0c8df310>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:24.869099 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b3d1f30f-8c52-4c21-8618-87d8c555cee4 tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-94203855?user_id=ebbb08dcf78448db93753d15e9712744" status: 204 len: 0 microversion: 2.10 time: 0.066336 Jun 16 14:37:24.869754 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 92/195] 10.222.0.57 () {60 vars in 1336 bytes} [Thu Jun 16 14:37:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-94203855?user_id=ebbb08dcf78448db93753d15e9712744 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 14:37:24.881233 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2dac9475-f4e6-463a-a012-15f96777df39 tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] Calling method '.version_select at 0x7fdf0c7c4670>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:24.924160 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2dac9475-f4e6-463a-a012-15f96777df39 tempest-KeyPairsV210TestJSON-1322618833 tempest-KeyPairsV210TestJSON-1322618833-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1113115437?user_id=ebbb08dcf78448db93753d15e9712744" status: 204 len: 0 microversion: 2.10 time: 0.048505 Jun 16 14:37:24.925370 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 93/196] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jun 16 14:37:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1113115437?user_id=ebbb08dcf78448db93753d15e9712744 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 14:37:25.097314 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-661750a9-996a-4460-96f6-ea0146e54570 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:25.097962 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-661750a9-996a-4460-96f6-ea0146e54570 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:25.115378 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0a4c1642-6ce3-4ff6-bb5d-23085f232d91 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:25.119908 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-661750a9-996a-4460-96f6-ea0146e54570 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:25.120378 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-661750a9-996a-4460-96f6-ea0146e54570 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:25.121200 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-661750a9-996a-4460-96f6-ea0146e54570 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:25.121650 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-661750a9-996a-4460-96f6-ea0146e54570 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:25.127908 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0a4c1642-6ce3-4ff6-bb5d-23085f232d91 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1338 microversion: 2.1 time: 0.554353 Jun 16 14:37:25.129913 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 104/197] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:24 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1338 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:25.167918 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:25.520158 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-661750a9-996a-4460-96f6-ea0146e54570 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:25.536227 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-683cc318-99ae-4011-83d1-aded201fb719 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:25.536227 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-683cc318-99ae-4011-83d1-aded201fb719 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:25.548736 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-683cc318-99ae-4011-83d1-aded201fb719 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:25.549299 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-683cc318-99ae-4011-83d1-aded201fb719 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:25.550167 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-683cc318-99ae-4011-83d1-aded201fb719 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:25.550906 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-683cc318-99ae-4011-83d1-aded201fb719 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:25.562438 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-661750a9-996a-4460-96f6-ea0146e54570 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1310 microversion: 2.1 time: 0.474697 Jun 16 14:37:25.578118 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 94/198] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:25 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1310 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:26.146924 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-00ae5c9e-92db-43eb-91f4-3ad39e7ec954 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:26.148440 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-00ae5c9e-92db-43eb-91f4-3ad39e7ec954 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:26.164436 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-00ae5c9e-92db-43eb-91f4-3ad39e7ec954 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:26.169715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-00ae5c9e-92db-43eb-91f4-3ad39e7ec954 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:26.170880 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-00ae5c9e-92db-43eb-91f4-3ad39e7ec954 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:26.172064 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-00ae5c9e-92db-43eb-91f4-3ad39e7ec954 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:26.420016 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-683cc318-99ae-4011-83d1-aded201fb719 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:26.430645 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-683cc318-99ae-4011-83d1-aded201fb719 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1469 microversion: 2.1 time: 0.903239 Jun 16 14:37:26.434169 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 105/199] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:25 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1469 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:26.495138 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-00ae5c9e-92db-43eb-91f4-3ad39e7ec954 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:26.557132 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-00ae5c9e-92db-43eb-91f4-3ad39e7ec954 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1488 microversion: 2.1 time: 0.412910 Jun 16 14:37:26.562241 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 95/200] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:26 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1488 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:26.589708 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-197736cd-7a54-4c82-b873-dcdb24801e47 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:26.596827 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-197736cd-7a54-4c82-b873-dcdb24801e47 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:26.617619 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-197736cd-7a54-4c82-b873-dcdb24801e47 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:26.620754 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-197736cd-7a54-4c82-b873-dcdb24801e47 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:26.621934 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-197736cd-7a54-4c82-b873-dcdb24801e47 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:26.624372 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-197736cd-7a54-4c82-b873-dcdb24801e47 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:26.880283 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-86c8c0f0-5322-4073-9bc8-af39cb0ae6cc tempest-DeleteServersAdminTestJSON-908878947 tempest-DeleteServersAdminTestJSON-908878947-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:26.880804 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-86c8c0f0-5322-4073-9bc8-af39cb0ae6cc tempest-DeleteServersAdminTestJSON-908878947 tempest-DeleteServersAdminTestJSON-908878947-project-admin] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:26.902502 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-86c8c0f0-5322-4073-9bc8-af39cb0ae6cc tempest-DeleteServersAdminTestJSON-908878947 tempest-DeleteServersAdminTestJSON-908878947-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:26.902982 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-86c8c0f0-5322-4073-9bc8-af39cb0ae6cc tempest-DeleteServersAdminTestJSON-908878947 tempest-DeleteServersAdminTestJSON-908878947-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:26.903838 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-86c8c0f0-5322-4073-9bc8-af39cb0ae6cc tempest-DeleteServersAdminTestJSON-908878947 tempest-DeleteServersAdminTestJSON-908878947-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:26.904463 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-86c8c0f0-5322-4073-9bc8-af39cb0ae6cc tempest-DeleteServersAdminTestJSON-908878947 tempest-DeleteServersAdminTestJSON-908878947-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:27.251378 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-197736cd-7a54-4c82-b873-dcdb24801e47 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1639 microversion: 2.1 time: 0.673234 Jun 16 14:37:27.253954 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 96/201] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:26 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1639 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:27.264340 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-006d1be5-ff38-499f-b014-25fd43d586d5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:27.266238 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-006d1be5-ff38-499f-b014-25fd43d586d5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:27.278669 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-006d1be5-ff38-499f-b014-25fd43d586d5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:27.279656 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-006d1be5-ff38-499f-b014-25fd43d586d5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:27.280743 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-006d1be5-ff38-499f-b014-25fd43d586d5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:27.281447 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-006d1be5-ff38-499f-b014-25fd43d586d5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:27.416930 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-86c8c0f0-5322-4073-9bc8-af39cb0ae6cc tempest-DeleteServersAdminTestJSON-908878947 tempest-DeleteServersAdminTestJSON-908878947-project-admin] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:37:27.525170 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-006d1be5-ff38-499f-b014-25fd43d586d5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:27.557948 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-006d1be5-ff38-499f-b014-25fd43d586d5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1310 microversion: 2.1 time: 0.300700 Jun 16 14:37:27.559285 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 97/202] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:27 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1310 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:27.598830 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cf42c72b-1a37-4205-a399-3dd48112acfc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:27.601462 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cf42c72b-1a37-4205-a399-3dd48112acfc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:27.613674 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cf42c72b-1a37-4205-a399-3dd48112acfc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:27.614922 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cf42c72b-1a37-4205-a399-3dd48112acfc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:27.617712 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cf42c72b-1a37-4205-a399-3dd48112acfc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:27.619281 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cf42c72b-1a37-4205-a399-3dd48112acfc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:27.734398 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-86c8c0f0-5322-4073-9bc8-af39cb0ae6cc tempest-DeleteServersAdminTestJSON-908878947 tempest-DeleteServersAdminTestJSON-908878947-project-admin] 10.222.0.57 "DELETE /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 204 len: 0 microversion: 2.1 time: 1.284901 Jun 16 14:37:27.740268 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 106/203] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:37:26 2022] DELETE /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 0 bytes in 1288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:37:27.752540 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cf42c72b-1a37-4205-a399-3dd48112acfc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:37:27.754335 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-737f52bd-1b63-4a67-b976-164c9f478652 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:27.757894 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-737f52bd-1b63-4a67-b976-164c9f478652 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:27.774217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-737f52bd-1b63-4a67-b976-164c9f478652 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:27.774900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-737f52bd-1b63-4a67-b976-164c9f478652 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:27.775788 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-737f52bd-1b63-4a67-b976-164c9f478652 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:27.776319 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-737f52bd-1b63-4a67-b976-164c9f478652 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:28.246767 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cf42c72b-1a37-4205-a399-3dd48112acfc tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 204 len: 0 microversion: 2.1 time: 0.664799 Jun 16 14:37:28.247058 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-737f52bd-1b63-4a67-b976-164c9f478652 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:28.254372 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 98/204] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:37:27 2022] DELETE /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:37:28.263264 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-737f52bd-1b63-4a67-b976-164c9f478652 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1475 microversion: 2.1 time: 0.518137 Jun 16 14:37:28.264353 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 107/205] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:27 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1475 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:37:28.276671 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-458f445b-7410-44ef-87d4-1b1f2f719882 req-e5782cef-33aa-4a8f-add1-23902651c462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3c31ac-af0e-4b6f-ab6a-36316a393d77", "name": "network-vif-plugged", "status": "completed", "tag": "75ab1982-70e8-4bb1-a9d6-1f4b0b0997f2"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:28.286457 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8cecb6d5-3732-4e37-9280-58bdde75e13b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:28.287217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8cecb6d5-3732-4e37-9280-58bdde75e13b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:28.312058 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8cecb6d5-3732-4e37-9280-58bdde75e13b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:28.313038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8cecb6d5-3732-4e37-9280-58bdde75e13b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:28.314608 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8cecb6d5-3732-4e37-9280-58bdde75e13b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:28.315528 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8cecb6d5-3732-4e37-9280-58bdde75e13b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:28.322683 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-458f445b-7410-44ef-87d4-1b1f2f719882 req-e5782cef-33aa-4a8f-add1-23902651c462 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:28.329234 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-458f445b-7410-44ef-87d4-1b1f2f719882 req-e5782cef-33aa-4a8f-add1-23902651c462 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:28.372696 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-458f445b-7410-44ef-87d4-1b1f2f719882 req-e5782cef-33aa-4a8f-add1-23902651c462 service nova] Creating event network-vif-plugged:75ab1982-70e8-4bb1-a9d6-1f4b0b0997f2 for instance ea3c31ac-af0e-4b6f-ab6a-36316a393d77 on n-h1-836830-4 Jun 16 14:37:28.396354 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-458f445b-7410-44ef-87d4-1b1f2f719882 req-e5782cef-33aa-4a8f-add1-23902651c462 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136166 Jun 16 14:37:28.398474 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 99/206] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:28.601651 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c3b5fd80-2692-42ae-9c6e-53bc0f972d74 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:28.602982 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c3b5fd80-2692-42ae-9c6e-53bc0f972d74 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:28.618847 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c3b5fd80-2692-42ae-9c6e-53bc0f972d74 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:28.619253 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c3b5fd80-2692-42ae-9c6e-53bc0f972d74 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:28.621412 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c3b5fd80-2692-42ae-9c6e-53bc0f972d74 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:28.622000 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c3b5fd80-2692-42ae-9c6e-53bc0f972d74 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:28.975293 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c3b5fd80-2692-42ae-9c6e-53bc0f972d74 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:28.984017 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8cecb6d5-3732-4e37-9280-58bdde75e13b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:28.994895 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c3b5fd80-2692-42ae-9c6e-53bc0f972d74 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1310 microversion: 2.1 time: 0.412731 Jun 16 14:37:28.996030 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 100/207] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:28 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1310 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:29.009498 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8cecb6d5-3732-4e37-9280-58bdde75e13b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1494 microversion: 2.1 time: 0.743747 Jun 16 14:37:29.010435 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 108/208] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:28 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1494 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:29.298651 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9317fa4e-738a-4cef-95d8-715ba7ed600b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:29.301446 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9317fa4e-738a-4cef-95d8-715ba7ed600b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:29.314482 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9317fa4e-738a-4cef-95d8-715ba7ed600b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:29.315820 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9317fa4e-738a-4cef-95d8-715ba7ed600b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:29.317554 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9317fa4e-738a-4cef-95d8-715ba7ed600b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:29.318704 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9317fa4e-738a-4cef-95d8-715ba7ed600b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:29.667202 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9317fa4e-738a-4cef-95d8-715ba7ed600b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:29.701678 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9317fa4e-738a-4cef-95d8-715ba7ed600b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1475 microversion: 2.1 time: 0.407646 Jun 16 14:37:29.730161 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 101/209] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:29 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1475 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:30.013751 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d8a73fc3-c1eb-473b-bd94-c57fa24dffa4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:30.014748 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d8a73fc3-c1eb-473b-bd94-c57fa24dffa4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:30.024797 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d8a73fc3-c1eb-473b-bd94-c57fa24dffa4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:30.031184 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d8a73fc3-c1eb-473b-bd94-c57fa24dffa4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:30.032440 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d8a73fc3-c1eb-473b-bd94-c57fa24dffa4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:30.033341 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d8a73fc3-c1eb-473b-bd94-c57fa24dffa4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:30.037569 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9488ad5a-2afe-4ddb-8fea-f656b374aed7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:30.038795 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9488ad5a-2afe-4ddb-8fea-f656b374aed7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:30.104404 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9488ad5a-2afe-4ddb-8fea-f656b374aed7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:30.106009 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9488ad5a-2afe-4ddb-8fea-f656b374aed7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:30.113100 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9488ad5a-2afe-4ddb-8fea-f656b374aed7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:30.114135 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9488ad5a-2afe-4ddb-8fea-f656b374aed7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:30.523893 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9488ad5a-2afe-4ddb-8fea-f656b374aed7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:30.538491 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9488ad5a-2afe-4ddb-8fea-f656b374aed7 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1494 microversion: 2.1 time: 0.508038 Jun 16 14:37:30.540702 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 102/210] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:30 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1494 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:37:30.730410 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fda4a89d-7145-412a-97f1-ba93efb5e8bb tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:30.732855 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fda4a89d-7145-412a-97f1-ba93efb5e8bb tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:30.750195 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fda4a89d-7145-412a-97f1-ba93efb5e8bb tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:30.751031 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fda4a89d-7145-412a-97f1-ba93efb5e8bb tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:30.754001 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fda4a89d-7145-412a-97f1-ba93efb5e8bb tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:30.754811 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fda4a89d-7145-412a-97f1-ba93efb5e8bb tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:30.978215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d8a73fc3-c1eb-473b-bd94-c57fa24dffa4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:30.993605 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d8a73fc3-c1eb-473b-bd94-c57fa24dffa4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1310 microversion: 2.1 time: 0.983967 Jun 16 14:37:30.995343 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 109/211] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:30 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1310 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:31.055749 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fda4a89d-7145-412a-97f1-ba93efb5e8bb tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:31.073872 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fda4a89d-7145-412a-97f1-ba93efb5e8bb tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1475 microversion: 2.1 time: 0.348040 Jun 16 14:37:31.075542 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 103/212] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:30 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1475 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:37:31.582834 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fae15a9d-5dcc-4a9d-91d7-8a0fbf21bbb4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:31.584267 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fae15a9d-5dcc-4a9d-91d7-8a0fbf21bbb4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:31.596341 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fae15a9d-5dcc-4a9d-91d7-8a0fbf21bbb4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:31.596937 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fae15a9d-5dcc-4a9d-91d7-8a0fbf21bbb4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:31.600175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fae15a9d-5dcc-4a9d-91d7-8a0fbf21bbb4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:31.600639 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fae15a9d-5dcc-4a9d-91d7-8a0fbf21bbb4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:32.026999 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-15a4b6f3-c1d7-4fa0-adb2-d0a0ed9de256 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:32.027976 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-15a4b6f3-c1d7-4fa0-adb2-d0a0ed9de256 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:32.044612 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15a4b6f3-c1d7-4fa0-adb2-d0a0ed9de256 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:32.050505 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15a4b6f3-c1d7-4fa0-adb2-d0a0ed9de256 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:32.051642 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15a4b6f3-c1d7-4fa0-adb2-d0a0ed9de256 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:32.052208 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15a4b6f3-c1d7-4fa0-adb2-d0a0ed9de256 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:32.368464 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fae15a9d-5dcc-4a9d-91d7-8a0fbf21bbb4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:32.409634 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fae15a9d-5dcc-4a9d-91d7-8a0fbf21bbb4 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1494 microversion: 2.1 time: 0.844475 Jun 16 14:37:32.415578 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 110/213] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:31 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1494 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:37:32.438199 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-df50eb00-580e-4f56-8d02-27ac57a3a226 req-2ba453da-a9e9-478c-b944-c84d49a3779e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6537907c-347c-4c0e-85c2-10b57fd8fd50", "name": "network-vif-deleted", "tag": "533d1601-49c7-48a2-96b9-1c108accf4c4"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:32.475807 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-df50eb00-580e-4f56-8d02-27ac57a3a226 req-2ba453da-a9e9-478c-b944-c84d49a3779e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:32.479242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-df50eb00-580e-4f56-8d02-27ac57a3a226 req-2ba453da-a9e9-478c-b944-c84d49a3779e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:32.495470 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-15a4b6f3-c1d7-4fa0-adb2-d0a0ed9de256 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:32.519585 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-15a4b6f3-c1d7-4fa0-adb2-d0a0ed9de256 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1493 microversion: 2.1 time: 0.498612 Jun 16 14:37:32.519938 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 104/214] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:32 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1493 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:37:32.526186 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-df50eb00-580e-4f56-8d02-27ac57a3a226 req-2ba453da-a9e9-478c-b944-c84d49a3779e service nova] Creating event network-vif-deleted:533d1601-49c7-48a2-96b9-1c108accf4c4 for instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 on n-h1-836830-4 Jun 16 14:37:32.528643 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-09b925d0-dd95-45f0-9782-47ec19f1076d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:32.529716 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-09b925d0-dd95-45f0-9782-47ec19f1076d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:32.541068 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-09b925d0-dd95-45f0-9782-47ec19f1076d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:32.543264 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-09b925d0-dd95-45f0-9782-47ec19f1076d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:32.545677 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-09b925d0-dd95-45f0-9782-47ec19f1076d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:32.547161 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-09b925d0-dd95-45f0-9782-47ec19f1076d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:32.561153 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-df50eb00-580e-4f56-8d02-27ac57a3a226 req-2ba453da-a9e9-478c-b944-c84d49a3779e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138553 Jun 16 14:37:32.562252 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 111/215] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:32.649328 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-09b925d0-dd95-45f0-9782-47ec19f1076d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:32.650115 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-09b925d0-dd95-45f0-9782-47ec19f1076d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:32.650818 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-09b925d0-dd95-45f0-9782-47ec19f1076d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lazy-loading 'fault' on Instance uuid 6537907c-347c-4c0e-85c2-10b57fd8fd50 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:37:32.713656 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-09b925d0-dd95-45f0-9782-47ec19f1076d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:32.733371 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-09b925d0-dd95-45f0-9782-47ec19f1076d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 200 len: 1309 microversion: 2.1 time: 0.210799 Jun 16 14:37:32.738412 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 105/216] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:32 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 1309 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:33.317950 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c5765caf-481e-404c-81bf-051409dd5ec8 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:33.321417 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c5765caf-481e-404c-81bf-051409dd5ec8 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:33.343295 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c5765caf-481e-404c-81bf-051409dd5ec8 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:33.344643 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c5765caf-481e-404c-81bf-051409dd5ec8 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:33.346340 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c5765caf-481e-404c-81bf-051409dd5ec8 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:33.347229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c5765caf-481e-404c-81bf-051409dd5ec8 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:33.619993 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=7 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:33.666402 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-98b1cff3-faba-4df6-9534-53c892547434 tempest-NetworksTest-397339981 tempest-NetworksTest-397339981-project-admin] Calling method '.version_select at 0x7fdf0c7c4940>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:33.683051 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c5765caf-481e-404c-81bf-051409dd5ec8 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1644 microversion: 2.1 time: 1.118672 Jun 16 14:37:33.684024 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 112/217] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:32 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1644 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:33.700148 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-06da2aac-4c65-42dd-ab41-0c468a95766b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:33.711095 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-06da2aac-4c65-42dd-ab41-0c468a95766b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:33.735695 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06da2aac-4c65-42dd-ab41-0c468a95766b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:33.736885 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06da2aac-4c65-42dd-ab41-0c468a95766b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:33.738619 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06da2aac-4c65-42dd-ab41-0c468a95766b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:33.749291 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06da2aac-4c65-42dd-ab41-0c468a95766b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:33.837740 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06da2aac-4c65-42dd-ab41-0c468a95766b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:33.839172 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06da2aac-4c65-42dd-ab41-0c468a95766b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:33.840303 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-06da2aac-4c65-42dd-ab41-0c468a95766b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lazy-loading 'fault' on Instance uuid a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:37:33.923584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-06da2aac-4c65-42dd-ab41-0c468a95766b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f2fd6f3d4745d9aa2db33414a43384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cfdcf1f9642426b998a940c5e5c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:33.937246 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-06da2aac-4c65-42dd-ab41-0c468a95766b tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 200 len: 1328 microversion: 2.1 time: 0.243610 Jun 16 14:37:33.938653 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 113/218] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:33 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 1328 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:33.948373 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b4ae6526-bf87-43e8-999d-00b8acd76a49 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:33.949901 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b4ae6526-bf87-43e8-999d-00b8acd76a49 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:33.960564 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b4ae6526-bf87-43e8-999d-00b8acd76a49 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:33.961359 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b4ae6526-bf87-43e8-999d-00b8acd76a49 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:33.962870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b4ae6526-bf87-43e8-999d-00b8acd76a49 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:33.963680 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b4ae6526-bf87-43e8-999d-00b8acd76a49 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:34.199004 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b4ae6526-bf87-43e8-999d-00b8acd76a49 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1644 microversion: 2.1 time: 0.258051 Jun 16 14:37:34.214165 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 114/219] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:33 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1644 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:34.225715 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0646a01b-33cd-42c0-813d-3de7ed2226b9 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:34.227145 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0646a01b-33cd-42c0-813d-3de7ed2226b9 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:34.240433 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0646a01b-33cd-42c0-813d-3de7ed2226b9 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:34.241233 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0646a01b-33cd-42c0-813d-3de7ed2226b9 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:34.243435 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0646a01b-33cd-42c0-813d-3de7ed2226b9 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:34.243435 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0646a01b-33cd-42c0-813d-3de7ed2226b9 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:34.274928 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-0646a01b-33cd-42c0-813d-3de7ed2226b9 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] HTTP exception thrown: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0646a01b-33cd-42c0-813d-3de7ed2226b9 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Request method failure captured: Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 HTTP/1.1 Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_pkzkcJLO2D273eJhu4tW-8DvT7jvzGX4uw9lWuBU7Lu-_ig0-3dvrcxc1ImMi338YDOhJlcyvGMP0OM0v0MEkR4_2yrASQHGIooR_AY_UqGpoedr8Mat21CySIL6xsiG3qjyGhsDM2BTEiQSJwYLsU6YSHJAZ_aJuzKnkuvy2vu8 Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 8fdb8fc855c04708902f51318244b201 Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:37:34.281740 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:37:34.284670 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fdb8fc855c04708902f51318244b201", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fdb8fc855c04708902f51318244b201"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fdb8fc855c04708902f51318244b201"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fdb8fc855c04708902f51318244b201"}]}] Jun 16 14:37:34.284670 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:37:34.284670 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 8fdb8fc855c04708902f51318244b201 Jun 16 14:37:34.284670 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:37:34.284670 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-DeleteServersAdminTestJSON-51983624-project Jun 16 14:37:34.284670 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:37:34.284670 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:37:34.284670 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 6304cd29462244fc8559b2be905480c5 Jun 16 14:37:34.284670 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-DeleteServersAdminTestJSON-51983624-project Jun 16 14:37:34.284670 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:37:34.284670 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. Jun 16 14:37:34.284670 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '6537907c-347c-4c0e-85c2-10b57fd8fd50'} Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:34.287062 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. Jun 16 14:37:34.290352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:34.292852 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0646a01b-33cd-42c0-813d-3de7ed2226b9 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Returning 404 to user: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:34.292852 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0646a01b-33cd-42c0-813d-3de7ed2226b9 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 404 len: 111 microversion: 2.1 time: 0.068047 Jun 16 14:37:34.301742 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 115/220] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:34 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:37:34.462653 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-98b1cff3-faba-4df6-9534-53c892547434 tempest-NetworksTest-397339981 tempest-NetworksTest-397339981-project-admin] 10.222.0.57 "GET /compute/v2.1/os-networks" status: 200 len: 5368 microversion: 2.1 time: 1.089740 Jun 16 14:37:34.464528 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 106/221] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:37:33 2022] GET /compute/v2.1/os-networks => generated 5368 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:37:34.475279 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4493a9c4-2055-4b66-b99d-ed14ac46f517 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:34.480452 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:34.480452 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:34.482274 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4493a9c4-2055-4b66-b99d-ed14ac46f517 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:34.485268 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4493a9c4-2055-4b66-b99d-ed14ac46f517 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:34.486438 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4493a9c4-2055-4b66-b99d-ed14ac46f517 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:34.489972 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4493a9c4-2055-4b66-b99d-ed14ac46f517 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:34.534840 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4493a9c4-2055-4b66-b99d-ed14ac46f517 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.068271 Jun 16 14:37:34.536442 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 107/222] 10.222.0.57 () {58 vars in 1175 bytes} [Thu Jun 16 14:37:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:34.548193 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1986349017", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:34.580125 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d9e45ac4-3c9a-4f29-96a9-d9c8fe39b625 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:34.591190 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d9e45ac4-3c9a-4f29-96a9-d9c8fe39b625 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.289526 Jun 16 14:37:34.591586 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 116/223] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:37:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:34.598124 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a2f08f7f-4634-4e11-a4d0-6e73d4b48296 tempest-NetworksTest-397339981 tempest-NetworksTest-397339981-project-admin] Calling method '.version_select at 0x7fdf0ca2e3a0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:34.656382 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:37:34.681058 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=14 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:34.796357 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a2f08f7f-4634-4e11-a4d0-6e73d4b48296 tempest-NetworksTest-397339981 tempest-NetworksTest-397339981-project-admin] 10.222.0.57 "GET /compute/v2.1/os-networks/32dbc124-f3c2-4202-ae2b-8955b562fec8" status: 200 len: 652 microversion: 2.1 time: 0.202102 Jun 16 14:37:34.797115 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 117/224] 10.222.0.57 () {58 vars in 1247 bytes} [Thu Jun 16 14:37:34 2022] GET /compute/v2.1/os-networks/32dbc124-f3c2-4202-ae2b-8955b562fec8 => generated 652 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:34.804527 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cba009c9-2468-4c3e-bca1-2e29644bd0bf tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-4", "block_migration": true, "disk_over_commit": false}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:34.806666 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cba009c9-2468-4c3e-bca1-2e29644bd0bf tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:34.816584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cba009c9-2468-4c3e-bca1-2e29644bd0bf tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:34.817247 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cba009c9-2468-4c3e-bca1-2e29644bd0bf tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:34.818506 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cba009c9-2468-4c3e-bca1-2e29644bd0bf tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:34.819788 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cba009c9-2468-4c3e-bca1-2e29644bd0bf tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:35.153460 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-cba009c9-2468-4c3e-bca1-2e29644bd0bf tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lazy-loading 'flavor' on Instance uuid ea3c31ac-af0e-4b6f-ab6a-36316a393d77 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:37:35.222028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cba009c9-2468-4c3e-bca1-2e29644bd0bf tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Going to try to live migrate instance to n-h2-836830-4 {{(pid=125862) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 14:37:35.237477 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:37:35.241112 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:37:35.242343 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:37:35.243306 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:37:35.246142 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:37:35.273894 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:35.275301 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:35.277192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:35.278356 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:35.323108 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Getting quotas for project 8fdb8fc855c04708902f51318244b201. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:37:35.330015 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:35.336063 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Getting quotas for user 6304cd29462244fc8559b2be905480c5 and project 8fdb8fc855c04708902f51318244b201. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:37:35.362842 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:37:35.368710 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:37:35.450698 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-34452e32-ec93-4ed5-b562-cf1d22a4a650 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911098 Jun 16 14:37:35.452217 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 108/225] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:37:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:37:35.602956 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5cf1dbc2-5dca-410f-aba4-79894dec7026 tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-217974658", "id": 1595615383, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:35.605476 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:35.605476 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:35.636640 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5cf1dbc2-5dca-410f-aba4-79894dec7026 tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.182441 Jun 16 14:37:35.643648 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 109/226] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:37:35 2022] POST /compute/v2.1/flavors => generated 424 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:35.652148 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-acc88c9c-6cd5-44dc-be3a-d0be4e4de243 req-6a890652-9028-493e-9533-b2af7c0ae71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a04c70b9-8bf4-4d60-98f7-bc846e5c2a09", "name": "network-vif-deleted", "tag": "49201993-415f-4385-a2cd-53f832cd102f"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:35.675730 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-acc88c9c-6cd5-44dc-be3a-d0be4e4de243 req-6a890652-9028-493e-9533-b2af7c0ae71b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:35.676328 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-acc88c9c-6cd5-44dc-be3a-d0be4e4de243 req-6a890652-9028-493e-9533-b2af7c0ae71b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:35.705041 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-acc88c9c-6cd5-44dc-be3a-d0be4e4de243 req-6a890652-9028-493e-9533-b2af7c0ae71b service nova] Creating event network-vif-deleted:49201993-415f-4385-a2cd-53f832cd102f for instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 on n-h2-836830-4 Jun 16 14:37:35.713089 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-acc88c9c-6cd5-44dc-be3a-d0be4e4de243 req-6a890652-9028-493e-9533-b2af7c0ae71b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066414 Jun 16 14:37:35.713089 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 110/227] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:35.719916 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-30e89e4c-93ed-4e9f-a9a6-45f0d4ac1bc1 tempest-NetworksTest-397339981 tempest-NetworksTest-397339981-project-admin] Calling method '.version_select at 0x7fdf0ce2d550>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:36.126506 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-30e89e4c-93ed-4e9f-a9a6-45f0d4ac1bc1 tempest-NetworksTest-397339981 tempest-NetworksTest-397339981-project-admin] 10.222.0.57 "GET /compute/v2.1/os-networks" status: 200 len: 5368 microversion: 2.1 time: 0.412589 Jun 16 14:37:36.127284 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 111/228] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:37:35 2022] GET /compute/v2.1/os-networks => generated 5368 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:36.137038 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ead8444d-aa9d-4221-9b35-f8684b8e787c tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:36.141167 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ead8444d-aa9d-4221-9b35-f8684b8e787c tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:36.152392 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ead8444d-aa9d-4221-9b35-f8684b8e787c tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:36.152864 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ead8444d-aa9d-4221-9b35-f8684b8e787c tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:36.157248 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ead8444d-aa9d-4221-9b35-f8684b8e787c tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:36.160083 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ead8444d-aa9d-4221-9b35-f8684b8e787c tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:36.196567 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-ead8444d-aa9d-4221-9b35-f8684b8e787c tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] HTTP exception thrown: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ead8444d-aa9d-4221-9b35-f8684b8e787c tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Request method failure captured: Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 HTTP/1.1 Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_qbE0RZs65nEWgVvjgeZjT_SfyCQ5sswadwiAgFscT3jfUmf5fECFQ4QigdLJaq0N7Z5GaF0ygdp6m47p5JkZvfdzQm9iQm_xRXGASyNlZeszFwuCDK4dOIgk8bOOLywjvvIe6XRLMadfXmhrnz5uuMSfXiWkjdq5wb_0nAco_XEQ Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 4cfdcf1f9642426b998a940c5e5c43fa Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-AggregatesAdminTestJSON-881429094 Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:37:36.199174 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:37:36.200554 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4cfdcf1f9642426b998a940c5e5c43fa", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cfdcf1f9642426b998a940c5e5c43fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cfdcf1f9642426b998a940c5e5c43fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4cfdcf1f9642426b998a940c5e5c43fa"}]}] Jun 16 14:37:36.200554 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-AggregatesAdminTestJSON-881429094 Jun 16 14:37:36.200554 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 4cfdcf1f9642426b998a940c5e5c43fa Jun 16 14:37:36.200554 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-881429094 Jun 16 14:37:36.200554 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-AggregatesAdminTestJSON-881429094-project Jun 16 14:37:36.200554 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:37:36.200554 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:37:36.200554 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: c0f2fd6f3d4745d9aa2db33414a43384 Jun 16 14:37:36.200554 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-AggregatesAdminTestJSON-881429094-project Jun 16 14:37:36.200554 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:37:36.200554 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. Jun 16 14:37:36.200554 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'a04c70b9-8bf4-4d60-98f7-bc846e5c2a09'} Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:36.202028 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. Jun 16 14:37:36.203385 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:36.208556 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ead8444d-aa9d-4221-9b35-f8684b8e787c tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Returning 404 to user: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:36.211910 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ead8444d-aa9d-4221-9b35-f8684b8e787c tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 404 len: 111 microversion: 2.1 time: 0.082936 Jun 16 14:37:36.217481 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 112/229] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:36 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:37:36.227770 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-53928807-d884-437d-9779-041090f8f56d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:36.230291 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-53928807-d884-437d-9779-041090f8f56d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:36.509551 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-53928807-d884-437d-9779-041090f8f56d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:36.533461 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-53928807-d884-437d-9779-041090f8f56d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 200 len: 1220 microversion: 2.1 time: 0.314193 Jun 16 14:37:36.542520 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 113/230] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:36 2022] GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 1220 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:36.566982 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3c8bca51-0ae5-4158-8bdb-707436ecd1f2 tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:36.643974 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=11,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:36.652043 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3c8bca51-0ae5-4158-8bdb-707436ecd1f2 tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.107148 Jun 16 14:37:36.661071 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 114/231] 10.222.0.57 () {58 vars in 1181 bytes} [Thu Jun 16 14:37:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:37:36.683536 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3c9be501-7d72-4665-8b28-0db8aa9f699e tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-4"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:36.686908 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:36.686908 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:36.726304 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3c9be501-7d72-4665-8b28-0db8aa9f699e tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:36.729168 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3c9be501-7d72-4665-8b28-0db8aa9f699e tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:37.257790 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3c9be501-7d72-4665-8b28-0db8aa9f699e tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 299 microversion: 2.1 time: 0.594138 Jun 16 14:37:37.259661 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 115/232] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 16 14:37:36 2022] POST /compute/v2.1/os-aggregates/4/action => generated 299 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:37.267970 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-34e08d5d-c468-4603-9a6f-935dd596dbd6 tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-586184581", "id": 1808692178, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:37.271044 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:37.271044 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:37.307285 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-34e08d5d-c468-4603-9a6f-935dd596dbd6 tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.046189 Jun 16 14:37:37.308697 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 116/233] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:37:37 2022] POST /compute/v2.1/flavors => generated 424 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:37.315140 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5853e605-6c18-4389-bace-2d745fe47c6d tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:37.316491 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:37.316491 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:37.365180 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5853e605-6c18-4389-bace-2d745fe47c6d tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.054338 Jun 16 14:37:37.366493 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 117/234] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:37:37 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:37:37.377051 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-35987d6f-e110-49b9-a6df-4cffc9389b7d tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:37.408233 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-35987d6f-e110-49b9-a6df-4cffc9389b7d tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.039925 Jun 16 14:37:37.411980 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 118/235] 10.222.0.57 () {58 vars in 1181 bytes} [Thu Jun 16 14:37:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:37:37.425257 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f70799db-4610-4c7e-93c8-935cc5f55fe5 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-54528912"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:37.428754 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:37.428754 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:37.432076 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.aggregate [None req-f70799db-4610-4c7e-93c8-935cc5f55fe5 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Generated uuid a5b3aa77-ead4-4140-ae13-d39d233bade1 for aggregate {{(pid=125863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:37:37.540870 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f70799db-4610-4c7e-93c8-935cc5f55fe5 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.123439 Jun 16 14:37:37.541854 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 119/236] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:37:37 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:37.562268 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b8bee21a-5179-48eb-8f7e-5e1a6caf04ec tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Action: 'create', calling method: .version_select at 0x7fdf0c861ee0>, body: {"keypair": {"name": "tempest-keypair-1584692722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk2+NaQamO+IFGZkLbyZK4mxz93GmHZ0V7GmkBf3gJxLwnVnehyuOAmhtiQdaNh6Y4peTfTiZ+ToZZWpl/b4LZPVwWs7Gh4w4OVPjDBNIhoZU1zuaopAplXv7+EqI3KAg=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:37.606194 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-b8bee21a-5179-48eb-8f7e-5e1a6caf04ec tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Getting quotas for project b3bb36eedcf640af98a6bc7f41473758. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:37:37.621765 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-b8bee21a-5179-48eb-8f7e-5e1a6caf04ec tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Getting quotas for user 2b7e98a72497450c98f5f05bf74213a0 and project b3bb36eedcf640af98a6bc7f41473758. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:37:37.704065 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b8bee21a-5179-48eb-8f7e-5e1a6caf04ec tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.155397 Jun 16 14:37:37.704984 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 120/237] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:37:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:37.721269 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-09703eda-ab2e-4393-9125-9244b17a724e tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-4"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:37.725095 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:37.725095 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:37.757960 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-09703eda-ab2e-4393-9125-9244b17a724e tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:37.766924 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-09703eda-ab2e-4393-9125-9244b17a724e tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:38.195715 n-d-836830-4 devstack@n-api.service[125863]: WARNING nova.scheduler.client.report [None req-09703eda-ab2e-4393-9125-9244b17a724e tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] [req-87d94407-ab8f-41be-abdf-5b648036dcdb] Failed to update aggregates to [a5b3aa77-ead4-4140-ae13-d39d233bade1] for resource provider with UUID 4f35cd48-c450-487e-8f87-c177d6faaab5. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-87d94407-ab8f-41be-abdf-5b648036dcdb"}]} Jun 16 14:37:38.557297 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-09703eda-ab2e-4393-9125-9244b17a724e tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 240 microversion: 2.1 time: 0.849277 Jun 16 14:37:38.559503 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 121/238] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 16 14:37:37 2022] POST /compute/v2.1/os-aggregates/9/action => generated 240 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:38.577966 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-01c88f86-17dd-4c5e-a589-c3d691bfce19 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:38.594834 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-01c88f86-17dd-4c5e-a589-c3d691bfce19 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:38.603683 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01c88f86-17dd-4c5e-a589-c3d691bfce19 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:38.608115 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01c88f86-17dd-4c5e-a589-c3d691bfce19 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:38.621304 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01c88f86-17dd-4c5e-a589-c3d691bfce19 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:38.622339 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01c88f86-17dd-4c5e-a589-c3d691bfce19 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:39.110311 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-01c88f86-17dd-4c5e-a589-c3d691bfce19 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:39.140635 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-01c88f86-17dd-4c5e-a589-c3d691bfce19 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 200 len: 1290 microversion: 2.1 time: 0.578112 Jun 16 14:37:39.144389 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 122/239] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:38 2022] GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 1290 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:39.157349 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-46112c66-98e5-4cd1-9cf5-5546c224d1dc tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:39.158243 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:39.158243 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:39.189825 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-46112c66-98e5-4cd1-9cf5-5546c224d1dc tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 240 microversion: 2.1 time: 0.044142 Jun 16 14:37:39.204261 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 123/240] 10.222.0.57 () {58 vars in 1148 bytes} [Thu Jun 16 14:37:39 2022] GET /compute/v2.1/os-aggregates/9 => generated 240 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:39.210551 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-24288983-4e05-45c2-b0e3-540e78c698ff tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-4"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:39.217010 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:39.217010 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:39.243360 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-24288983-4e05-45c2-b0e3-540e78c698ff tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:39.243809 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-24288983-4e05-45c2-b0e3-540e78c698ff tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:39.258553 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:39.572616 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-24288983-4e05-45c2-b0e3-540e78c698ff tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 225 microversion: 2.1 time: 0.367015 Jun 16 14:37:39.578285 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 124/241] 10.222.0.57 () {60 vars in 1190 bytes} [Thu Jun 16 14:37:39 2022] POST /compute/v2.1/os-aggregates/9/action => generated 225 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:39.613170 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2d9ff0c3-5901-49f3-89a5-cb8d4fb89f85 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:39.613535 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:39.613535 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:39.711669 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2d9ff0c3-5901-49f3-89a5-cb8d4fb89f85 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.124391 Jun 16 14:37:39.715018 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 125/242] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:37:39 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:37:39.732782 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7ff408d1-6377-489e-ab49-f2dec9ea0125 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1967618543"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:39.746023 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:39.746023 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:39.768328 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.aggregate [None req-7ff408d1-6377-489e-ab49-f2dec9ea0125 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Generated uuid 7d0c5da7-34e7-416a-8b17-8de16497c21d for aggregate {{(pid=125863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:37:39.833791 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7ff408d1-6377-489e-ab49-f2dec9ea0125 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.110142 Jun 16 14:37:39.834944 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 126/243] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:37:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:37:39.855516 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1cd8cf68-0253-463d-bd7e-71932559fd91 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-4"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:39.856693 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:39.856693 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:39.896370 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1cd8cf68-0253-463d-bd7e-71932559fd91 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:39.897748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1cd8cf68-0253-463d-bd7e-71932559fd91 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:40.310149 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1cd8cf68-0253-463d-bd7e-71932559fd91 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.459129 Jun 16 14:37:40.318600 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 127/244] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 16 14:37:39 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:40.358686 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a4c4f61d-7df4-4b23-940a-0740ee81ea3b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:40.359948 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a4c4f61d-7df4-4b23-940a-0740ee81ea3b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:40.400943 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a4c4f61d-7df4-4b23-940a-0740ee81ea3b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:40.401732 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a4c4f61d-7df4-4b23-940a-0740ee81ea3b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:40.403156 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a4c4f61d-7df4-4b23-940a-0740ee81ea3b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:40.403930 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a4c4f61d-7df4-4b23-940a-0740ee81ea3b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:41.514851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a4c4f61d-7df4-4b23-940a-0740ee81ea3b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:41.533755 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a4c4f61d-7df4-4b23-940a-0740ee81ea3b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 200 len: 1320 microversion: 2.1 time: 1.213487 Jun 16 14:37:41.546849 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 128/245] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:40 2022] GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 1320 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:41.552064 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5a0f6cfc-991a-466b-b5f2-9bbe2dcf1a89 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:41.553200 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:41.553200 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:41.565182 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5a0f6cfc-991a-466b-b5f2-9bbe2dcf1a89 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.017046 Jun 16 14:37:41.571682 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 129/246] 10.222.0.57 () {58 vars in 1142 bytes} [Thu Jun 16 14:37:41 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:41.588941 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4a7ca2e1-9d43-42e1-9eb7-123884f9b267 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-4"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:41.590907 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:41.590907 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:41.612562 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4a7ca2e1-9d43-42e1-9eb7-123884f9b267 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:41.613024 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4a7ca2e1-9d43-42e1-9eb7-123884f9b267 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:41.895831 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4a7ca2e1-9d43-42e1-9eb7-123884f9b267 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.311554 Jun 16 14:37:41.897104 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 130/247] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 16 14:37:41 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:37:41.911504 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4a872a08-fca5-492f-b561-dcf7f7265626 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:41.912957 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:41.912957 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:42.004486 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4a872a08-fca5-492f-b561-dcf7f7265626 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.096790 Jun 16 14:37:42.013855 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 131/248] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jun 16 14:37:41 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:37:42.029476 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7e740af7-9fa1-4ba3-8596-5130714e825c tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-234312660"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:42.038102 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:42.038102 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:42.039789 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.aggregate [None req-7e740af7-9fa1-4ba3-8596-5130714e825c tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Generated uuid 3e188d22-c262-47e5-9f0c-e1a4704a889e for aggregate {{(pid=125863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:37:42.109836 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7e740af7-9fa1-4ba3-8596-5130714e825c tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.083791 Jun 16 14:37:42.118974 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 132/249] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:37:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:42.135310 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2e3b5b05-29e2-43aa-90de-76a02cbfa035 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-4"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:42.141167 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:42.141167 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:42.154012 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2e3b5b05-29e2-43aa-90de-76a02cbfa035 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:42.155391 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2e3b5b05-29e2-43aa-90de-76a02cbfa035 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:42.165186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=9,nova_api:INSERT=7 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:42.440132 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2e3b5b05-29e2-43aa-90de-76a02cbfa035 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.308612 Jun 16 14:37:42.441828 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 133/250] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 16 14:37:42 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:42.449914 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-b872cb15-28e6-448b-aff6-ee9564748606 req-4cf9ca9a-4a28-436c-a0a6-d683c3c7c585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08256156-566f-40b4-a2bf-7eb0a0e11a63", "tag": "b45b096e-0185-490d-9e2a-c85d1071e72e"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:42.474634 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-b872cb15-28e6-448b-aff6-ee9564748606 req-4cf9ca9a-4a28-436c-a0a6-d683c3c7c585 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:42.475088 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-b872cb15-28e6-448b-aff6-ee9564748606 req-4cf9ca9a-4a28-436c-a0a6-d683c3c7c585 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:42.501733 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-b872cb15-28e6-448b-aff6-ee9564748606 req-4cf9ca9a-4a28-436c-a0a6-d683c3c7c585 service nova] Creating event network-changed:b45b096e-0185-490d-9e2a-c85d1071e72e for instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 on n-h2-836830-4 Jun 16 14:37:42.513524 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-b872cb15-28e6-448b-aff6-ee9564748606 req-4cf9ca9a-4a28-436c-a0a6-d683c3c7c585 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070142 Jun 16 14:37:42.517682 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 134/251] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:42.532998 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cbd4a6fd-d1ae-4895-8c33-7e6ca3702923 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-4"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:42.536925 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:42.536925 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:42.558080 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cbd4a6fd-d1ae-4895-8c33-7e6ca3702923 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:42.563561 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cbd4a6fd-d1ae-4895-8c33-7e6ca3702923 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:42.801376 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cbd4a6fd-d1ae-4895-8c33-7e6ca3702923 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.281451 Jun 16 14:37:42.803252 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 135/252] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 16 14:37:42 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:42.831528 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-200d000f-bf6d-4da5-ae98-edcc9bb69c15 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:42.832706 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-200d000f-bf6d-4da5-ae98-edcc9bb69c15 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:42.843809 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-200d000f-bf6d-4da5-ae98-edcc9bb69c15 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:42.844597 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-200d000f-bf6d-4da5-ae98-edcc9bb69c15 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:42.845707 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-200d000f-bf6d-4da5-ae98-edcc9bb69c15 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:42.846336 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-200d000f-bf6d-4da5-ae98-edcc9bb69c15 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:43.974619 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-200d000f-bf6d-4da5-ae98-edcc9bb69c15 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:43.990950 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-200d000f-bf6d-4da5-ae98-edcc9bb69c15 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 200 len: 1320 microversion: 2.1 time: 1.185947 Jun 16 14:37:43.991566 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 136/253] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:42 2022] GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 1320 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:44.023331 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-228585a7-7d9c-427a-8418-31f01e4440d6 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:44.025466 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:44.025466 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:44.044906 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cba009c9-2468-4c3e-bca1-2e29644bd0bf tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77/action" status: 202 len: 0 microversion: 2.1 time: 9.246147 Jun 16 14:37:44.051301 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 118/254] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:37:34 2022] POST /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77/action => generated 0 bytes in 9253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:37:44.059925 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-61b03511-d53d-4294-8152-434ae6daad1b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:44.063311 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-61b03511-d53d-4294-8152-434ae6daad1b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:44.076148 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-61b03511-d53d-4294-8152-434ae6daad1b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:44.077821 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-61b03511-d53d-4294-8152-434ae6daad1b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:44.079465 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-61b03511-d53d-4294-8152-434ae6daad1b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:44.102523 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-228585a7-7d9c-427a-8418-31f01e4440d6 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.109645 Jun 16 14:37:44.103833 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 137/255] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jun 16 14:37:43 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:37:44.119525 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-61b03511-d53d-4294-8152-434ae6daad1b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:44.134655 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6f3a8364-f19e-4929-adcd-71ec0688af8c tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1458322807"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:44.137300 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:44.137300 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:44.139103 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.aggregate [None req-6f3a8364-f19e-4929-adcd-71ec0688af8c tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Generated uuid fa640ba4-8465-4be5-b4ef-cd0d31bb6938 for aggregate {{(pid=125863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:37:44.241245 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6f3a8364-f19e-4929-adcd-71ec0688af8c tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.130355 Jun 16 14:37:44.254813 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 138/256] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:37:44 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:44.280998 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b4fd9308-0936-4c34-9c31-32cf2168dd8d tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Calling method '.version_select at 0x7fdf0c6c7ee0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:44.283442 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:44.283442 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:44.286131 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4fd9308-0936-4c34-9c31-32cf2168dd8d tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:44.300967 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4fd9308-0936-4c34-9c31-32cf2168dd8d tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:44.306726 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4fd9308-0936-4c34-9c31-32cf2168dd8d tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:44.313474 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4fd9308-0936-4c34-9c31-32cf2168dd8d tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:44.445915 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b4fd9308-0936-4c34-9c31-32cf2168dd8d tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.182386 Jun 16 14:37:44.452984 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 139/257] 10.222.0.57 () {58 vars in 1127 bytes} [Thu Jun 16 14:37:44 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:44.459371 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f9930ad7-c9ca-43d5-95c4-c28161509d60 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:44.460638 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:44.460638 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:44.497817 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f9930ad7-c9ca-43d5-95c4-c28161509d60 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.043429 Jun 16 14:37:44.500682 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 140/258] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jun 16 14:37:44 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:37:44.514567 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a18d1e50-f9be-464d-8adc-347d86c3dba6 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Calling method '.version_select at 0x7fdf0c861ee0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:44.517806 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:44.517806 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:44.521623 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a18d1e50-f9be-464d-8adc-347d86c3dba6 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:44.525066 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a18d1e50-f9be-464d-8adc-347d86c3dba6 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:44.530599 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a18d1e50-f9be-464d-8adc-347d86c3dba6 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:44.531641 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a18d1e50-f9be-464d-8adc-347d86c3dba6 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:44.618626 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a18d1e50-f9be-464d-8adc-347d86c3dba6 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.116453 Jun 16 14:37:44.619847 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 141/259] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jun 16 14:37:44 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:44.634153 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f799cc2e-c097-49ec-8ff7-a9b92b79b691 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:44.635153 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:44.635153 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:44.645910 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-f799cc2e-c097-49ec-8ff7-a9b92b79b691 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f799cc2e-c097-49ec-8ff7-a9b92b79b691 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Request method failure captured: Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_ud1-e3HAbXsFMzdhqlNpAcG9NCME0234F7_BPX2XdPjjQe5QHAqowUAkyRNL0qE6HLxQ49MWOqgSAqZJXdcuR_CZD67xFq47tDKWOKvF3BKEqDsw9nLKvtjkYy_hah__O66yTSqko5HiyfMYNfOh_U8rMxreeMQO1V_TqkMSgIdQ Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: a965660c01c64589a0c1a81fa2fb223a Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-AggregatesAdminTestJSON-1220079489 Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:37:44.652375 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:37:44.655799 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a965660c01c64589a0c1a81fa2fb223a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a965660c01c64589a0c1a81fa2fb223a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a965660c01c64589a0c1a81fa2fb223a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a965660c01c64589a0c1a81fa2fb223a"}]}] Jun 16 14:37:44.655799 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-AggregatesAdminTestJSON-1220079489 Jun 16 14:37:44.655799 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: a965660c01c64589a0c1a81fa2fb223a Jun 16 14:37:44.655799 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1220079489 Jun 16 14:37:44.655799 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-AggregatesAdminTestJSON-1220079489-project-admin Jun 16 14:37:44.655799 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:37:44.655799 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:37:44.655799 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: df1c2debf62a4361bf5d9e8fb77052a8 Jun 16 14:37:44.655799 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-AggregatesAdminTestJSON-1220079489-project-admin Jun 16 14:37:44.655799 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:37:44.655799 n-d-836830-4 devstack@n-api.service[125863]: exception: Aggregate 12 could not be found. Jun 16 14:37:44.655799 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '12'} Jun 16 14:37:44.655799 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:44.657835 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jun 16 14:37:44.666080 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:44.674741 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f799cc2e-c097-49ec-8ff7-a9b92b79b691 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:44.674741 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f799cc2e-c097-49ec-8ff7-a9b92b79b691 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.033327 Jun 16 14:37:44.674741 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 142/260] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:37:44 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:37:44.674741 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a8b2dc86-af4a-4112-a2eb-1c276b6ee642 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Calling method '.version_select at 0x7fdf0c8df310>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:44.674741 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:44.674741 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:44.676093 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a8b2dc86-af4a-4112-a2eb-1c276b6ee642 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:44.676093 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a8b2dc86-af4a-4112-a2eb-1c276b6ee642 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:44.676093 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a8b2dc86-af4a-4112-a2eb-1c276b6ee642 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:44.682987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a8b2dc86-af4a-4112-a2eb-1c276b6ee642 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:44.741887 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a8b2dc86-af4a-4112-a2eb-1c276b6ee642 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.077091 Jun 16 14:37:44.742570 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 143/261] 10.222.0.57 () {58 vars in 1127 bytes} [Thu Jun 16 14:37:44 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:44.756765 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-15d23233-b8ba-44f3-8c4c-5e98b56dcb93 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:44.757916 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:44.757916 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:44.787441 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-15d23233-b8ba-44f3-8c4c-5e98b56dcb93 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-15d23233-b8ba-44f3-8c4c-5e98b56dcb93 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Request method failure captured: Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_ud1-e3HAbXsFMzdhqlNpAcG9NCME0234F7_BPX2XdPjjQe5QHAqowUAkyRNL0qE6HLxQ49MWOqgSAqZJXdcuR_CZD67xFq47tDKWOKvF3BKEqDsw9nLKvtjkYy_hah__O66yTSqko5HiyfMYNfOh_U8rMxreeMQO1V_TqkMSgIdQ Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: a965660c01c64589a0c1a81fa2fb223a Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-AggregatesAdminTestJSON-1220079489 Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:37:44.789337 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:37:44.790699 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a965660c01c64589a0c1a81fa2fb223a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a965660c01c64589a0c1a81fa2fb223a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a965660c01c64589a0c1a81fa2fb223a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a965660c01c64589a0c1a81fa2fb223a"}]}] Jun 16 14:37:44.790699 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-AggregatesAdminTestJSON-1220079489 Jun 16 14:37:44.790699 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: a965660c01c64589a0c1a81fa2fb223a Jun 16 14:37:44.790699 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1220079489 Jun 16 14:37:44.790699 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-AggregatesAdminTestJSON-1220079489-project-admin Jun 16 14:37:44.790699 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:37:44.790699 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:37:44.790699 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: df1c2debf62a4361bf5d9e8fb77052a8 Jun 16 14:37:44.790699 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-AggregatesAdminTestJSON-1220079489-project-admin Jun 16 14:37:44.790699 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:37:44.790699 n-d-836830-4 devstack@n-api.service[125863]: exception: Aggregate 12 could not be found. Jun 16 14:37:44.790699 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '12'} Jun 16 14:37:44.790699 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:37:44.791483 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:44.792640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:44.793970 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:44.793970 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:37:44.793970 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:37:44.793970 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jun 16 14:37:44.793970 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:44.796339 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-15d23233-b8ba-44f3-8c4c-5e98b56dcb93 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:44.799600 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-15d23233-b8ba-44f3-8c4c-5e98b56dcb93 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.054940 Jun 16 14:37:44.801888 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 144/262] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jun 16 14:37:44 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:37:44.821689 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-161f6133-7f07-45b8-805c-fc64f7889dcb tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-835571266"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:44.827894 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:44.827894 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:44.831724 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.aggregate [None req-161f6133-7f07-45b8-805c-fc64f7889dcb tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Generated uuid d178b8c1-d904-4a5f-a4d3-6614ed44b051 for aggregate {{(pid=125863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:37:44.888002 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-161f6133-7f07-45b8-805c-fc64f7889dcb tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.084755 Jun 16 14:37:44.895606 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 145/263] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:37:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:44.906025 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c0af0546-3916-4996-8a74-b08856dc2415 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Calling method '.version_select at 0x7fdf0c6c7820>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:44.913533 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:44.913533 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:44.929310 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c0af0546-3916-4996-8a74-b08856dc2415 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:44.934902 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c0af0546-3916-4996-8a74-b08856dc2415 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:44.977534 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c0af0546-3916-4996-8a74-b08856dc2415 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:44.980346 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c0af0546-3916-4996-8a74-b08856dc2415 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:45.051100 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c0af0546-3916-4996-8a74-b08856dc2415 tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts/n-h2-836830-4" status: 200 len: 467 microversion: 2.1 time: 0.153679 Jun 16 14:37:45.057225 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 146/264] 10.222.0.57 () {58 vars in 1169 bytes} [Thu Jun 16 14:37:44 2022] GET /compute/v2.1/os-hosts/n-h2-836830-4 => generated 467 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:45.066259 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-070f220e-709b-46fc-bcdb-a38f5c4aae26 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1158445919", "name": "tempest-test_aggregate-15785654"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:45.069661 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:45.069661 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:45.071214 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.aggregate [None req-070f220e-709b-46fc-bcdb-a38f5c4aae26 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Generated uuid 485b7d13-1f3e-4180-aab7-c49062923795 for aggregate {{(pid=125863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:37:45.121268 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-070f220e-709b-46fc-bcdb-a38f5c4aae26 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.061759 Jun 16 14:37:45.131111 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 147/265] 10.222.0.57 () {60 vars in 1164 bytes} [Thu Jun 16 14:37:45 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:45.135027 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9eec79c1-43fb-4937-a834-3c3e4184eb5d tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-836830-4"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:45.141300 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:45.141300 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:45.157356 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9eec79c1-43fb-4937-a834-3c3e4184eb5d tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:45.157818 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9eec79c1-43fb-4937-a834-3c3e4184eb5d tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:45.158293 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-61b03511-d53d-4294-8152-434ae6daad1b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:45.184549 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-61b03511-d53d-4294-8152-434ae6daad1b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1503 microversion: 2.1 time: 1.130680 Jun 16 14:37:45.192770 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 119/266] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:44 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1503 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:45.220522 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-20f5049d-38e9-4884-872b-95faf1abd86c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:45.221885 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-20f5049d-38e9-4884-872b-95faf1abd86c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:45.227510 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=8,nova_api:UPDATE=13 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:45.252872 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-20f5049d-38e9-4884-872b-95faf1abd86c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:45.254172 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-20f5049d-38e9-4884-872b-95faf1abd86c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:45.260822 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-20f5049d-38e9-4884-872b-95faf1abd86c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:45.262548 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-20f5049d-38e9-4884-872b-95faf1abd86c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:45.393717 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9eec79c1-43fb-4937-a834-3c3e4184eb5d tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.269984 Jun 16 14:37:45.404012 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 148/267] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 16 14:37:45 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:45.418660 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a108195a-9dbe-454d-9296-b4ef533c7d6f tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Calling method '.version_select at 0x7fdf0c7d4e50>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:45.419564 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:45.419564 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:45.437939 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a108195a-9dbe-454d-9296-b4ef533c7d6f tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:45.438732 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a108195a-9dbe-454d-9296-b4ef533c7d6f tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:45.458701 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a108195a-9dbe-454d-9296-b4ef533c7d6f tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:45.459150 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a108195a-9dbe-454d-9296-b4ef533c7d6f tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:45.479152 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a108195a-9dbe-454d-9296-b4ef533c7d6f tempest-HostsAdminTestJSON-1980077436 tempest-HostsAdminTestJSON-1980077436-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hosts/n-h1-836830-4" status: 200 len: 467 microversion: 2.1 time: 0.071271 Jun 16 14:37:45.480393 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 149/268] 10.222.0.57 () {58 vars in 1169 bytes} [Thu Jun 16 14:37:45 2022] GET /compute/v2.1/os-hosts/n-h1-836830-4 => generated 467 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:45.490468 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9fc3baae-6575-46f4-83b1-2822489e500e tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:45.491914 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:45.491914 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:45.567435 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9fc3baae-6575-46f4-83b1-2822489e500e tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.085617 Jun 16 14:37:45.568578 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 150/269] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jun 16 14:37:45 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:37:45.577265 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-268f31ec-5525-49f6-b210-f52d1db7bf45 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-4"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:45.579663 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:45.579663 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:45.581331 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-268f31ec-5525-49f6-b210-f52d1db7bf45 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'd23610eb709a411cb92d15207c43a1cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda8cac04b8b413cabeda47214d22b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-268f31ec-5525-49f6-b210-f52d1db7bf45 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Request method failure captured: Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 42 Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_qVvHjMCXYTg8L6nABQZUCRTUlkcLFE2lbj9ArH8Pxqzra1e4-pJ5Z1GG39CLdRSqqwhmLxQJ5qMxxMwZIaORMZvsd5yodGQ11l-ewZ8xunBrxwlWAZ_4kDd-H89Hc77pgfBRrR9WnKLptFY3KVSCEields_4VKGFbvcm1IH3yqCU Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: eda8cac04b8b413cabeda47214d22b48 Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:37:45.584238 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:37:45.585754 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eda8cac04b8b413cabeda47214d22b48", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eda8cac04b8b413cabeda47214d22b48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eda8cac04b8b413cabeda47214d22b48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eda8cac04b8b413cabeda47214d22b48"}]}] Jun 16 14:37:45.585754 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:37:45.585754 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: eda8cac04b8b413cabeda47214d22b48 Jun 16 14:37:45.585754 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702 Jun 16 14:37:45.585754 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1262169702-project Jun 16 14:37:45.585754 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:37:45.585754 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:37:45.585754 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: d23610eb709a411cb92d15207c43a1cd Jun 16 14:37:45.585754 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1262169702-project Jun 16 14:37:45.585754 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:37:45.585754 n-d-836830-4 devstack@n-api.service[125863]: {"remove_host": {"host": "n-h2-836830-4"}} Jun 16 14:37:45.585754 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:37:45.585754 n-d-836830-4 devstack@n-api.service[125863]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h2-836830-4'}}} Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:37:45.587566 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 16 14:37:45.588860 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:45.590365 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-268f31ec-5525-49f6-b210-f52d1db7bf45 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:45.597273 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-268f31ec-5525-49f6-b210-f52d1db7bf45 tempest-AggregatesAdminNegativeTestJSON-1262169702 tempest-AggregatesAdminNegativeTestJSON-1262169702-project] 10.222.0.57 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.020689 Jun 16 14:37:45.600126 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 151/270] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 16 14:37:45 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:37:45.633465 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-364d928c-a2ae-4dad-a381-32a7d6d6fb97 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:45.634443 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:45.634443 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:45.654656 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-364d928c-a2ae-4dad-a381-32a7d6d6fb97 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-364d928c-a2ae-4dad-a381-32a7d6d6fb97 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Request method failure captured: Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_ud1-e3HAbXsFMzdhqlNpAcG9NCME0234F7_BPX2XdPjjQe5QHAqowUAkyRNL0qE6HLxQ49MWOqgSAqZJXdcuR_CZD67xFq47tDKWOKvF3BKEqDsw9nLKvtjkYy_hah__O66yTSqko5HiyfMYNfOh_U8rMxreeMQO1V_TqkMSgIdQ Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: a965660c01c64589a0c1a81fa2fb223a Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-AggregatesAdminTestJSON-1220079489 Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:37:45.659865 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:37:45.662925 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a965660c01c64589a0c1a81fa2fb223a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a965660c01c64589a0c1a81fa2fb223a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a965660c01c64589a0c1a81fa2fb223a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a965660c01c64589a0c1a81fa2fb223a"}]}] Jun 16 14:37:45.662925 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-AggregatesAdminTestJSON-1220079489 Jun 16 14:37:45.662925 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: a965660c01c64589a0c1a81fa2fb223a Jun 16 14:37:45.662925 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1220079489 Jun 16 14:37:45.662925 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-AggregatesAdminTestJSON-1220079489-project-admin Jun 16 14:37:45.662925 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:37:45.662925 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:37:45.662925 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: df1c2debf62a4361bf5d9e8fb77052a8 Jun 16 14:37:45.662925 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-AggregatesAdminTestJSON-1220079489-project-admin Jun 16 14:37:45.662925 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:37:45.662925 n-d-836830-4 devstack@n-api.service[125863]: exception: Aggregate 14 could not be found. Jun 16 14:37:45.662925 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '14'} Jun 16 14:37:45.662925 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:45.664528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jun 16 14:37:45.667386 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:45.674330 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-364d928c-a2ae-4dad-a381-32a7d6d6fb97 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:45.674330 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-364d928c-a2ae-4dad-a381-32a7d6d6fb97 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.059733 Jun 16 14:37:45.674330 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 152/271] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:37:45 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:37:45.674330 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3427b0e7-1a82-4b93-8d2a-4526af06d9bf tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-836830-4"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:45.703477 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3427b0e7-1a82-4b93-8d2a-4526af06d9bf tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:45.704457 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3427b0e7-1a82-4b93-8d2a-4526af06d9bf tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:45.980184 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3427b0e7-1a82-4b93-8d2a-4526af06d9bf tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.312512 Jun 16 14:37:45.990178 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 153/272] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 16 14:37:45 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:46.005882 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-902f9e4a-ad30-4f3b-a1c2-014191ca1832 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:46.009662 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:46.009662 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:46.056422 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-902f9e4a-ad30-4f3b-a1c2-014191ca1832 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-902f9e4a-ad30-4f3b-a1c2-014191ca1832 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Request method failure captured: Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_ud1-e3HAbXsFMzdhqlNpAcG9NCME0234F7_BPX2XdPjjQe5QHAqowUAkyRNL0qE6HLxQ49MWOqgSAqZJXdcuR_CZD67xFq47tDKWOKvF3BKEqDsw9nLKvtjkYy_hah__O66yTSqko5HiyfMYNfOh_U8rMxreeMQO1V_TqkMSgIdQ Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: a965660c01c64589a0c1a81fa2fb223a Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-AggregatesAdminTestJSON-1220079489 Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:37:46.066154 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:37:46.067777 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a965660c01c64589a0c1a81fa2fb223a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a965660c01c64589a0c1a81fa2fb223a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a965660c01c64589a0c1a81fa2fb223a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a965660c01c64589a0c1a81fa2fb223a"}]}] Jun 16 14:37:46.067777 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-AggregatesAdminTestJSON-1220079489 Jun 16 14:37:46.067777 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: a965660c01c64589a0c1a81fa2fb223a Jun 16 14:37:46.067777 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1220079489 Jun 16 14:37:46.067777 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-AggregatesAdminTestJSON-1220079489-project-admin Jun 16 14:37:46.067777 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:37:46.067777 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:37:46.067777 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: df1c2debf62a4361bf5d9e8fb77052a8 Jun 16 14:37:46.067777 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-AggregatesAdminTestJSON-1220079489-project-admin Jun 16 14:37:46.067777 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:37:46.067777 n-d-836830-4 devstack@n-api.service[125863]: exception: Aggregate 14 could not be found. Jun 16 14:37:46.067777 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '14'} Jun 16 14:37:46.067777 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:37:46.068701 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:46.069983 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:46.071427 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:46.071427 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:37:46.071427 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:37:46.071427 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jun 16 14:37:46.071427 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:37:46.074987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-902f9e4a-ad30-4f3b-a1c2-014191ca1832 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:46.076212 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-902f9e4a-ad30-4f3b-a1c2-014191ca1832 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.084828 Jun 16 14:37:46.077406 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 154/273] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jun 16 14:37:45 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:37:46.082943 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2357590e-3d4f-43ec-b844-faa3003b456c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:46.129647 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2357590e-3d4f-43ec-b844-faa3003b456c tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.049179 Jun 16 14:37:46.135796 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 155/274] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jun 16 14:37:46 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:37:46.148334 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-df256e4f-8595-4584-bdd4-b6532674627d tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1450283718"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:46.153613 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:46.153613 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:46.157476 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.aggregate [None req-df256e4f-8595-4584-bdd4-b6532674627d tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Generated uuid 5b630206-afa9-4c0c-b7bb-14e9e40ebc56 for aggregate {{(pid=125863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:37:46.173034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=10 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:46.209096 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-df256e4f-8595-4584-bdd4-b6532674627d tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.071306 Jun 16 14:37:46.214983 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 156/275] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:37:46 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:46.219923 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-02fad7eb-6c1b-4c33-ba75-cdfeaa3a7dc0 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-742328549"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:46.230716 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:46.230716 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:37:46.232013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.aggregate [None req-02fad7eb-6c1b-4c33-ba75-cdfeaa3a7dc0 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Generated uuid eecd0b80-8498-4c3a-9466-074685356aed for aggregate {{(pid=125863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:37:46.303352 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-02fad7eb-6c1b-4c33-ba75-cdfeaa3a7dc0 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.091663 Jun 16 14:37:46.315691 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 157/276] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:37:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:46.329133 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-faa035c5-6aee-4b96-a482-9f604daf0177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:46.331422 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-faa035c5-6aee-4b96-a482-9f604daf0177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:46.351941 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-faa035c5-6aee-4b96-a482-9f604daf0177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:46.356178 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-faa035c5-6aee-4b96-a482-9f604daf0177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:46.358476 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-faa035c5-6aee-4b96-a482-9f604daf0177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:46.361039 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-faa035c5-6aee-4b96-a482-9f604daf0177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:46.407115 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-20f5049d-38e9-4884-872b-95faf1abd86c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:46.434762 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-20f5049d-38e9-4884-872b-95faf1abd86c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 200 len: 1320 microversion: 2.1 time: 1.229883 Jun 16 14:37:46.445143 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 120/277] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:45 2022] GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 1320 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:46.454530 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b5c80b15-638c-44bb-af8d-d2270c60bad5 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:46.460564 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:46.460564 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:46.504977 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b5c80b15-638c-44bb-af8d-d2270c60bad5 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 228 microversion: 2.1 time: 0.062922 Jun 16 14:37:46.512945 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 121/278] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:37:46 2022] GET /compute/v2.1/os-aggregates/15 => generated 228 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:46.536338 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ee810dff-869c-4349-9e84-bda6a425f2c8 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:46.538212 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:46.538212 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:46.549269 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ee810dff-869c-4349-9e84-bda6a425f2c8 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:46.549738 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ee810dff-869c-4349-9e84-bda6a425f2c8 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:46.560867 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ee810dff-869c-4349-9e84-bda6a425f2c8 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:46.562205 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ee810dff-869c-4349-9e84-bda6a425f2c8 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:46.591234 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.compute.aggregates [None req-ee810dff-869c-4349-9e84-bda6a425f2c8 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 16 14:37:46.593348 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-ee810dff-869c-4349-9e84-bda6a425f2c8 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ee810dff-869c-4349-9e84-bda6a425f2c8 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Request method failure captured: Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 42 Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_uTJYc_qiCMobHgBUvUm2R5ccoChJxTyUqlw1Vvch5jqGntOJSnaX7PKCzD4NERKeGCs-i6ok73XFMNjvEvMCbXhsbb1s8bWgYdVLVldtBKPpJJg1I10ymbbpmr_5y5IVBiUlMwLXFau970NrOLmGv0qlA2KLBrh7OTruRmkMCvuE Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:37:46.597041 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:37:46.598305 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f1eddbbee64342f2b7ec96646902faf2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1eddbbee64342f2b7ec96646902faf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f1eddbbee64342f2b7ec96646902faf2"}]}] Jun 16 14:37:46.598305 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:37:46.598305 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: f1eddbbee64342f2b7ec96646902faf2 Jun 16 14:37:46.598305 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898 Jun 16 14:37:46.598305 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:37:46.598305 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:37:46.598305 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:37:46.598305 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 980421e03edd4f6db8f2414f1bc307cb Jun 16 14:37:46.598305 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin Jun 16 14:37:46.598305 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:37:46.598305 n-d-836830-4 devstack@n-api.service[125862]: {"remove_host": {"host": "nonexist_host"}} Jun 16 14:37:46.598305 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:37:46.598305 n-d-836830-4 devstack@n-api.service[125862]: exception: Cannot remove host nonexist_host in aggregate 16 Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 16 14:37:46.599190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jun 16 14:37:46.601248 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:46.603773 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:46.606425 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:46.606425 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:46.606425 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:37:46.606425 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:37:46.606425 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Jun 16 14:37:46.606425 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:46.611287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ee810dff-869c-4349-9e84-bda6a425f2c8 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:46.615144 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ee810dff-869c-4349-9e84-bda6a425f2c8 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.108634 Jun 16 14:37:46.617004 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 122/279] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 16 14:37:46 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:37:46.626591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c1ab60c1-7636-45f8-a004-0e14b65d537c tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:46.628671 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:46.628671 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:46.671717 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c1ab60c1-7636-45f8-a004-0e14b65d537c tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 266 microversion: 2.1 time: 0.049844 Jun 16 14:37:46.673011 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 123/280] 10.222.0.57 () {60 vars in 1193 bytes} [Thu Jun 16 14:37:46 2022] POST /compute/v2.1/os-aggregates/15/action => generated 266 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:46.688007 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fd47269b-d2b0-4ab6-99dc-866ae5d934d2 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:46.707909 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:46.707909 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:46.812726 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fd47269b-d2b0-4ab6-99dc-866ae5d934d2 tempest-AggregatesAdminNegativeTestJSON-1827564898 tempest-AggregatesAdminNegativeTestJSON-1827564898-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.136113 Jun 16 14:37:46.818440 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 124/281] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jun 16 14:37:46 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:37:46.843184 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f9ee078f-3dd9-45c1-bb0f-4c3f0a780326 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:46.852127 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:46.852127 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:46.919017 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f9ee078f-3dd9-45c1-bb0f-4c3f0a780326 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 242 microversion: 2.1 time: 0.094806 Jun 16 14:37:46.939499 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 125/282] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:37:46 2022] GET /compute/v2.1/os-aggregates/15 => generated 242 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:46.962426 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-317fc871-7363-4c09-b4b3-cb0a061b8a14 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:46.966206 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:46.966206 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:47.058528 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-317fc871-7363-4c09-b4b3-cb0a061b8a14 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.117331 Jun 16 14:37:47.059516 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 126/283] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jun 16 14:37:46 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:37:47.094653 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-29952b6d-f306-4156-ad5f-557dbbf77f7e tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1084531551", "availability_zone": "tempest-test_az-2084387724"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:47.162911 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:47.162911 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:47.164096 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.aggregate [None req-29952b6d-f306-4156-ad5f-557dbbf77f7e tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Generated uuid 1bf50bb7-11bd-44b4-b6da-c01882d0bd9b for aggregate {{(pid=125862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:37:47.247112 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-29952b6d-f306-4156-ad5f-557dbbf77f7e tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.169601 Jun 16 14:37:47.249739 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 127/284] 10.222.0.57 () {60 vars in 1164 bytes} [Thu Jun 16 14:37:47 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:47.258007 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-faa035c5-6aee-4b96-a482-9f604daf0177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:47.270443 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0b6929d8-2e1c-4aa6-8960-8452327fbcd0 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1084531551_new", "availability_zone": "tempest-test_az-2084387724_new"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:47.273285 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:47.273285 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:47.277474 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-faa035c5-6aee-4b96-a482-9f604daf0177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1503 microversion: 2.1 time: 0.960550 Jun 16 14:37:47.285124 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 158/285] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:46 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1503 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:47.391138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b6929d8-2e1c-4aa6-8960-8452327fbcd0 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:47.392007 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b6929d8-2e1c-4aa6-8960-8452327fbcd0 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:47.466047 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-aa4e7946-2bd5-4274-a054-c461c4630f7b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:47.466735 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-aa4e7946-2bd5-4274-a054-c461c4630f7b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:47.488507 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aa4e7946-2bd5-4274-a054-c461c4630f7b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:47.489274 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aa4e7946-2bd5-4274-a054-c461c4630f7b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:47.490708 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aa4e7946-2bd5-4274-a054-c461c4630f7b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:47.491730 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aa4e7946-2bd5-4274-a054-c461c4630f7b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:47.516384 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0b6929d8-2e1c-4aa6-8960-8452327fbcd0 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.249828 Jun 16 14:37:47.518481 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 128/286] 10.222.0.57 () {60 vars in 1172 bytes} [Thu Jun 16 14:37:47 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:47.542861 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b8dedbc6-6e19-488b-a08f-f85701a17e71 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:47.544961 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:47.544961 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:47.562592 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b8dedbc6-6e19-488b-a08f-f85701a17e71 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.036212 Jun 16 14:37:47.563800 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 129/287] 10.222.0.57 () {58 vars in 1142 bytes} [Thu Jun 16 14:37:47 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:47.589910 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fb34bb9b-a6f2-40b2-9921-39700a924daa tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:47.595052 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:47.595052 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:47.649135 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=12 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:47.673974 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fb34bb9b-a6f2-40b2-9921-39700a924daa tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.098541 Jun 16 14:37:47.684020 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 130/288] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jun 16 14:37:47 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:37:47.690959 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c1db34c8-269e-4b32-a4b8-805c026f84c8 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1137003369"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:47.695592 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:47.695592 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:47.697139 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.aggregate [None req-c1db34c8-269e-4b32-a4b8-805c026f84c8 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Generated uuid bd7da78e-f8a0-483e-9a43-b0c3d2561fa2 for aggregate {{(pid=125862) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 16 14:37:47.745357 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c1db34c8-269e-4b32-a4b8-805c026f84c8 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.057870 Jun 16 14:37:47.747545 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 131/289] 10.222.0.57 () {60 vars in 1163 bytes} [Thu Jun 16 14:37:47 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:47.761768 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d516d157-d659-450f-a389-bb93f6dc53e2 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:47.770868 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:47.770868 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:47.783961 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d516d157-d659-450f-a389-bb93f6dc53e2 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.028183 Jun 16 14:37:47.785456 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 132/290] 10.222.0.57 () {58 vars in 1142 bytes} [Thu Jun 16 14:37:47 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:47.798819 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7cefe307-fdac-4555-aeeb-cb34dac19902 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:47.804344 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:47.804344 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:47.846977 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7cefe307-fdac-4555-aeeb-cb34dac19902 tempest-AggregatesAdminTestJSON-1220079489 tempest-AggregatesAdminTestJSON-1220079489-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.055016 Jun 16 14:37:47.852080 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 133/291] 10.222.0.57 () {58 vars in 1154 bytes} [Thu Jun 16 14:37:47 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:37:47.861053 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e7902393-04ae-45ed-8196-723e6b039a17 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:47.862067 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e7902393-04ae-45ed-8196-723e6b039a17 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:47.872119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e7902393-04ae-45ed-8196-723e6b039a17 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:47.874351 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e7902393-04ae-45ed-8196-723e6b039a17 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:47.878513 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e7902393-04ae-45ed-8196-723e6b039a17 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:47.879957 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e7902393-04ae-45ed-8196-723e6b039a17 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:47.903852 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-e7902393-04ae-45ed-8196-723e6b039a17 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] HTTP exception thrown: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e7902393-04ae-45ed-8196-723e6b039a17 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Request method failure captured: Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 HTTP/1.1 Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_qbE0RZs65nEWgVvjgeZjT_SfyCQ5sswadwiAgFscT3jfUmf5fECFQ4QigdLJaq0N7Z5GaF0ygdp6m47p5JkZvfdzQm9iQm_xRXGASyNlZeszFwuCDK4dOIgk8bOOLywjvvIe6XRLMadfXmhrnz5uuMSfXiWkjdq5wb_0nAco_XEQ Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 4cfdcf1f9642426b998a940c5e5c43fa Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-AggregatesAdminTestJSON-881429094 Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:37:47.909297 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:37:47.910940 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4cfdcf1f9642426b998a940c5e5c43fa", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cfdcf1f9642426b998a940c5e5c43fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cfdcf1f9642426b998a940c5e5c43fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4cfdcf1f9642426b998a940c5e5c43fa"}]}] Jun 16 14:37:47.910940 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-AggregatesAdminTestJSON-881429094 Jun 16 14:37:47.910940 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 4cfdcf1f9642426b998a940c5e5c43fa Jun 16 14:37:47.910940 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-881429094 Jun 16 14:37:47.910940 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-AggregatesAdminTestJSON-881429094-project Jun 16 14:37:47.910940 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:37:47.910940 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:37:47.910940 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: c0f2fd6f3d4745d9aa2db33414a43384 Jun 16 14:37:47.910940 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-AggregatesAdminTestJSON-881429094-project Jun 16 14:37:47.910940 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:37:47.910940 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. Jun 16 14:37:47.910940 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'a04c70b9-8bf4-4d60-98f7-bc846e5c2a09'} Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:47.911786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. Jun 16 14:37:47.913164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:47.918060 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e7902393-04ae-45ed-8196-723e6b039a17 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Returning 404 to user: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:47.920656 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e7902393-04ae-45ed-8196-723e6b039a17 tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 404 len: 111 microversion: 2.1 time: 0.064421 Jun 16 14:37:47.924551 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 134/292] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:37:47 2022] DELETE /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:37:47.941143 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e0b72045-16e2-4c03-a932-ac9c416b05ca tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:47.943962 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e0b72045-16e2-4c03-a932-ac9c416b05ca tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] [instance: a04c70b9-8bf4-4d60-98f7-bc846e5c2a09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:47.958046 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0b72045-16e2-4c03-a932-ac9c416b05ca tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:47.960815 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0b72045-16e2-4c03-a932-ac9c416b05ca tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:47.962728 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0b72045-16e2-4c03-a932-ac9c416b05ca tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:47.963360 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0b72045-16e2-4c03-a932-ac9c416b05ca tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:47.995996 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-e0b72045-16e2-4c03-a932-ac9c416b05ca tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] HTTP exception thrown: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e0b72045-16e2-4c03-a932-ac9c416b05ca tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Request method failure captured: Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 HTTP/1.1 Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_qbE0RZs65nEWgVvjgeZjT_SfyCQ5sswadwiAgFscT3jfUmf5fECFQ4QigdLJaq0N7Z5GaF0ygdp6m47p5JkZvfdzQm9iQm_xRXGASyNlZeszFwuCDK4dOIgk8bOOLywjvvIe6XRLMadfXmhrnz5uuMSfXiWkjdq5wb_0nAco_XEQ Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 4cfdcf1f9642426b998a940c5e5c43fa Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-AggregatesAdminTestJSON-881429094 Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:37:47.999493 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:37:48.001208 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4cfdcf1f9642426b998a940c5e5c43fa", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cfdcf1f9642426b998a940c5e5c43fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4cfdcf1f9642426b998a940c5e5c43fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4cfdcf1f9642426b998a940c5e5c43fa"}]}] Jun 16 14:37:48.001208 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-AggregatesAdminTestJSON-881429094 Jun 16 14:37:48.001208 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 4cfdcf1f9642426b998a940c5e5c43fa Jun 16 14:37:48.001208 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-881429094 Jun 16 14:37:48.001208 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-AggregatesAdminTestJSON-881429094-project Jun 16 14:37:48.001208 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:37:48.001208 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:37:48.001208 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: c0f2fd6f3d4745d9aa2db33414a43384 Jun 16 14:37:48.001208 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-AggregatesAdminTestJSON-881429094-project Jun 16 14:37:48.001208 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:37:48.001208 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. Jun 16 14:37:48.001208 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'a04c70b9-8bf4-4d60-98f7-bc846e5c2a09'} Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:37:48.002060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. Jun 16 14:37:48.003521 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:37:48.004738 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e0b72045-16e2-4c03-a932-ac9c416b05ca tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] Returning 404 to user: Instance a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:37:48.008023 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e0b72045-16e2-4c03-a932-ac9c416b05ca tempest-AggregatesAdminTestJSON-881429094 tempest-AggregatesAdminTestJSON-881429094-project] 10.222.0.57 "GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09" status: 404 len: 111 microversion: 2.1 time: 0.078826 Jun 16 14:37:48.009123 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 135/293] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:47 2022] GET /compute/v2.1/servers/a04c70b9-8bf4-4d60-98f7-bc846e5c2a09 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:37:48.380254 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-aa4e7946-2bd5-4274-a054-c461c4630f7b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:48.404366 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-aa4e7946-2bd5-4274-a054-c461c4630f7b tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 200 len: 1320 microversion: 2.1 time: 0.941556 Jun 16 14:37:48.425249 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 159/294] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:47 2022] GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 1320 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:37:48.434848 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-af3b3b33-288b-45ed-9a32-9f2aa8f7b7a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:48.438512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-af3b3b33-288b-45ed-9a32-9f2aa8f7b7a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:48.453308 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-af3b3b33-288b-45ed-9a32-9f2aa8f7b7a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:48.453960 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-af3b3b33-288b-45ed-9a32-9f2aa8f7b7a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:48.454804 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-af3b3b33-288b-45ed-9a32-9f2aa8f7b7a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:48.455243 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-af3b3b33-288b-45ed-9a32-9f2aa8f7b7a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:48.955102 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1001256505", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:49.044621 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] validate_networks() for None {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:37:49.248390 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-af3b3b33-288b-45ed-9a32-9f2aa8f7b7a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:49.277206 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-af3b3b33-288b-45ed-9a32-9f2aa8f7b7a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1503 microversion: 2.1 time: 0.856417 Jun 16 14:37:49.299270 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 160/295] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:48 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1503 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:49.316546 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-655779247", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "1808692178", "adminPass": "***", "networks": [{"uuid": "4683a45d-d69a-44d6-878a-f00c16dd6e9e"}], "security_groups": [{"name": "tempest-securitygroup--1422213890"}], "key_name": "tempest-keypair-1584692722", "user_data": "}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:49.629443 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:37:49.630090 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:37:49.631018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:37:49.631609 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:37:49.632152 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:37:49.673810 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:49.675212 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:49.686615 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:49.690790 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:49.770155 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Getting quotas for project 8fe5a789f66b4837b0c4f5f0c68ff7b1. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:37:49.805905 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Getting quotas for user f88bdba610f44f86aafb6bd31222fbcd and project 8fe5a789f66b4837b0c4f5f0c68ff7b1. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:37:49.843976 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:37:49.854193 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:37:49.948837 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a3e43b25-aeee-439d-9ad7-144ea9489b1f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.680696 Jun 16 14:37:49.949920 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 136/296] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:37:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:37:49.962711 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c900d148-0085-4dd0-ae61-78d79362044c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:49.965168 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c900d148-0085-4dd0-ae61-78d79362044c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:49.974036 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c900d148-0085-4dd0-ae61-78d79362044c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:49.980981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c900d148-0085-4dd0-ae61-78d79362044c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:49.989418 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c900d148-0085-4dd0-ae61-78d79362044c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:49.993865 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c900d148-0085-4dd0-ae61-78d79362044c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:50.156098 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] validate_networks() for [('4683a45d-d69a-44d6-878a-f00c16dd6e9e', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:37:50.509587 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c900d148-0085-4dd0-ae61-78d79362044c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:50.526319 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c900d148-0085-4dd0-ae61-78d79362044c tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 200 len: 1320 microversion: 2.1 time: 0.573143 Jun 16 14:37:50.528849 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 137/297] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:49 2022] GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 1320 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:50.543287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-8152b249-14fc-41ac-a4db-ef77421b1ebe req-5fbbf566-a996-4b11-9caa-edef92e2d948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08256156-566f-40b4-a2bf-7eb0a0e11a63", "name": "network-vif-plugged", "status": "completed", "tag": "b45b096e-0185-490d-9e2a-c85d1071e72e"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:50.570281 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-8152b249-14fc-41ac-a4db-ef77421b1ebe req-5fbbf566-a996-4b11-9caa-edef92e2d948 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:50.572201 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-8152b249-14fc-41ac-a4db-ef77421b1ebe req-5fbbf566-a996-4b11-9caa-edef92e2d948 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:50.599131 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-8152b249-14fc-41ac-a4db-ef77421b1ebe req-5fbbf566-a996-4b11-9caa-edef92e2d948 service nova] Creating event network-vif-plugged:b45b096e-0185-490d-9e2a-c85d1071e72e for instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 on n-h2-836830-4 Jun 16 14:37:50.626794 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-8152b249-14fc-41ac-a4db-ef77421b1ebe req-5fbbf566-a996-4b11-9caa-edef92e2d948 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091962 Jun 16 14:37:50.629017 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 138/298] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:50.645790 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8b081b6c-2f8f-41f2-9961-0430826c5302 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:50.647500 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8b081b6c-2f8f-41f2-9961-0430826c5302 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:50.922748 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8b081b6c-2f8f-41f2-9961-0430826c5302 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:50.951147 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8b081b6c-2f8f-41f2-9961-0430826c5302 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1222 microversion: 2.1 time: 0.318561 Jun 16 14:37:50.955130 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 139/299] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:50 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1222 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:51.610122 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:37:51.611117 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:37:51.612208 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:37:51.613097 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:37:51.614025 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:37:51.641669 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:51.642561 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:51.644581 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:51.645434 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:51.695234 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Getting quotas for project b3bb36eedcf640af98a6bc7f41473758. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:37:51.708265 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Getting quotas for user 2b7e98a72497450c98f5f05bf74213a0 and project b3bb36eedcf640af98a6bc7f41473758. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:37:51.738329 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:37:51.741979 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:37:51.818006 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5c4e432d-c6d7-4891-810c-6a415e92739e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.517012 Jun 16 14:37:51.819130 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 161/300] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:37:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 2519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:37:51.842043 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-94e0b850-679d-4604-9655-d8a4050f4fd5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:51.843004 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-94e0b850-679d-4604-9655-d8a4050f4fd5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:51.872552 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-94e0b850-679d-4604-9655-d8a4050f4fd5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:51.873013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-94e0b850-679d-4604-9655-d8a4050f4fd5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:51.874566 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-94e0b850-679d-4604-9655-d8a4050f4fd5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:51.875209 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-94e0b850-679d-4604-9655-d8a4050f4fd5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:51.886458 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-7e646f00-3c5b-40f3-bbd1-1c61db4982ef req-ef4f71b4-a68d-442b-92c9-8cf36e1ae42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3c31ac-af0e-4b6f-ab6a-36316a393d77", "name": "network-vif-unplugged", "status": "completed", "tag": "75ab1982-70e8-4bb1-a9d6-1f4b0b0997f2"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:51.921741 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-7e646f00-3c5b-40f3-bbd1-1c61db4982ef req-ef4f71b4-a68d-442b-92c9-8cf36e1ae42a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:51.922209 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-7e646f00-3c5b-40f3-bbd1-1c61db4982ef req-ef4f71b4-a68d-442b-92c9-8cf36e1ae42a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:51.963378 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-7e646f00-3c5b-40f3-bbd1-1c61db4982ef req-ef4f71b4-a68d-442b-92c9-8cf36e1ae42a service nova] Creating event network-vif-unplugged:75ab1982-70e8-4bb1-a9d6-1f4b0b0997f2 for instance ea3c31ac-af0e-4b6f-ab6a-36316a393d77 on n-h1-836830-4 Jun 16 14:37:51.989469 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-7e646f00-3c5b-40f3-bbd1-1c61db4982ef req-ef4f71b4-a68d-442b-92c9-8cf36e1ae42a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.032455 Jun 16 14:37:51.990580 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 140/301] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:52.014788 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-97a0ea59-1fdb-4b2a-83df-20f10fa16ec6 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:52.016200 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-97a0ea59-1fdb-4b2a-83df-20f10fa16ec6 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:52.052885 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97a0ea59-1fdb-4b2a-83df-20f10fa16ec6 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:52.053586 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97a0ea59-1fdb-4b2a-83df-20f10fa16ec6 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:52.059476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97a0ea59-1fdb-4b2a-83df-20f10fa16ec6 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:52.060548 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97a0ea59-1fdb-4b2a-83df-20f10fa16ec6 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:52.348601 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-94e0b850-679d-4604-9655-d8a4050f4fd5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:52.373645 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-94e0b850-679d-4604-9655-d8a4050f4fd5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1503 microversion: 2.1 time: 0.552308 Jun 16 14:37:52.385171 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 162/302] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:51 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1503 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:52.396577 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8ce9de30-d967-4bed-9995-31b41d37cb02 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:52.398369 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8ce9de30-d967-4bed-9995-31b41d37cb02 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:52.558252 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8ce9de30-d967-4bed-9995-31b41d37cb02 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:52.583880 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8ce9de30-d967-4bed-9995-31b41d37cb02 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 200 len: 1264 microversion: 2.1 time: 0.194130 Jun 16 14:37:52.587112 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 163/303] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:52 2022] GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:52.633724 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2d156995-f2ea-43a1-972b-56f128d3a565 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:52.636099 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2d156995-f2ea-43a1-972b-56f128d3a565 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:52.694134 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2d156995-f2ea-43a1-972b-56f128d3a565 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:52.697791 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2d156995-f2ea-43a1-972b-56f128d3a565 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:52.699789 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2d156995-f2ea-43a1-972b-56f128d3a565 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:52.700621 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2d156995-f2ea-43a1-972b-56f128d3a565 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:52.770151 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-97a0ea59-1fdb-4b2a-83df-20f10fa16ec6 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:52.784136 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-97a0ea59-1fdb-4b2a-83df-20f10fa16ec6 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 200 len: 1320 microversion: 2.1 time: 0.791751 Jun 16 14:37:52.788346 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 141/304] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:51 2022] GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 1320 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:53.043851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2d156995-f2ea-43a1-972b-56f128d3a565 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:53.071790 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2d156995-f2ea-43a1-972b-56f128d3a565 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1274 microversion: 2.1 time: 0.470858 Jun 16 14:37:53.086215 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 164/305] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:52 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1274 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:53.410890 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-912d568e-7a26-47bd-88d2-8876c38b7621 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:53.413494 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-912d568e-7a26-47bd-88d2-8876c38b7621 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:53.423404 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-912d568e-7a26-47bd-88d2-8876c38b7621 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:53.429116 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-912d568e-7a26-47bd-88d2-8876c38b7621 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:53.430905 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-912d568e-7a26-47bd-88d2-8876c38b7621 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:53.442353 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-912d568e-7a26-47bd-88d2-8876c38b7621 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:53.621424 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e90bb99f-d679-434c-ab74-b89f635394ae tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:53.622972 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e90bb99f-d679-434c-ab74-b89f635394ae tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:53.657931 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e90bb99f-d679-434c-ab74-b89f635394ae tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:53.662724 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e90bb99f-d679-434c-ab74-b89f635394ae tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:53.663911 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e90bb99f-d679-434c-ab74-b89f635394ae tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:53.669308 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e90bb99f-d679-434c-ab74-b89f635394ae tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:54.065533 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e90bb99f-d679-434c-ab74-b89f635394ae tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:54.078497 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e90bb99f-d679-434c-ab74-b89f635394ae tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 200 len: 1260 microversion: 2.1 time: 0.465886 Jun 16 14:37:54.105502 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 165/306] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:53 2022] GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 1260 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:54.113305 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-630881ff-3678-4c75-a997-ebb37932284f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:54.114256 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-630881ff-3678-4c75-a997-ebb37932284f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:54.139376 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-630881ff-3678-4c75-a997-ebb37932284f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:54.140073 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-630881ff-3678-4c75-a997-ebb37932284f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:54.143110 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-630881ff-3678-4c75-a997-ebb37932284f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:54.144255 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-630881ff-3678-4c75-a997-ebb37932284f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:54.263236 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-912d568e-7a26-47bd-88d2-8876c38b7621 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:54.304130 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-912d568e-7a26-47bd-88d2-8876c38b7621 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1503 microversion: 2.1 time: 0.896782 Jun 16 14:37:54.309903 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 142/307] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:53 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1503 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:54.339350 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:54.344146 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-559ff9ff-9736-4754-b331-d67916258eee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:54.353782 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-559ff9ff-9736-4754-b331-d67916258eee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:54.370135 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=8,nova_api:UPDATE=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:37:54.432449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-559ff9ff-9736-4754-b331-d67916258eee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:54.437500 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-559ff9ff-9736-4754-b331-d67916258eee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:54.445247 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-559ff9ff-9736-4754-b331-d67916258eee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:54.448197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-559ff9ff-9736-4754-b331-d67916258eee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:54.757190 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-559ff9ff-9736-4754-b331-d67916258eee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:54.774286 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-559ff9ff-9736-4754-b331-d67916258eee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1280 microversion: 2.1 time: 0.460888 Jun 16 14:37:54.785893 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 143/308] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:54 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1280 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:54.796858 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-5bba74a8-18dd-41ad-9781-02348c033d60 req-6e87d78d-17c4-4afd-949c-a81f81767240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea3c31ac-af0e-4b6f-ab6a-36316a393d77", "tag": "75ab1982-70e8-4bb1-a9d6-1f4b0b0997f2"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:54.821028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-5bba74a8-18dd-41ad-9781-02348c033d60 req-6e87d78d-17c4-4afd-949c-a81f81767240 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:54.821668 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-5bba74a8-18dd-41ad-9781-02348c033d60 req-6e87d78d-17c4-4afd-949c-a81f81767240 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:54.858165 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-5bba74a8-18dd-41ad-9781-02348c033d60 req-6e87d78d-17c4-4afd-949c-a81f81767240 service nova] Creating event network-changed:75ab1982-70e8-4bb1-a9d6-1f4b0b0997f2 for instance ea3c31ac-af0e-4b6f-ab6a-36316a393d77 on n-h1-836830-4 Jun 16 14:37:54.877005 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-5bba74a8-18dd-41ad-9781-02348c033d60 req-6e87d78d-17c4-4afd-949c-a81f81767240 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087643 Jun 16 14:37:54.879774 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 144/309] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:55.110238 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-79e4cbb6-51e9-4ed0-99d8-486237c159ec tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:55.111652 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-79e4cbb6-51e9-4ed0-99d8-486237c159ec tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:55.146761 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-79e4cbb6-51e9-4ed0-99d8-486237c159ec tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:55.148190 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-79e4cbb6-51e9-4ed0-99d8-486237c159ec tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:55.158345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-79e4cbb6-51e9-4ed0-99d8-486237c159ec tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:55.158911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-79e4cbb6-51e9-4ed0-99d8-486237c159ec tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:55.176474 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-630881ff-3678-4c75-a997-ebb37932284f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:55.199584 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-630881ff-3678-4c75-a997-ebb37932284f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 200 len: 1469 microversion: 2.1 time: 1.090318 Jun 16 14:37:55.202756 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 166/310] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:54 2022] GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 1469 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:55.224405 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c44cb6a9-64ae-40db-8c42-bda84efce686 tempest-DeleteServersAdminTestJSON-908878947 tempest-DeleteServersAdminTestJSON-908878947-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:55.227467 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c44cb6a9-64ae-40db-8c42-bda84efce686 tempest-DeleteServersAdminTestJSON-908878947 tempest-DeleteServersAdminTestJSON-908878947-project-admin] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:55.239874 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c44cb6a9-64ae-40db-8c42-bda84efce686 tempest-DeleteServersAdminTestJSON-908878947 tempest-DeleteServersAdminTestJSON-908878947-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:55.240679 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c44cb6a9-64ae-40db-8c42-bda84efce686 tempest-DeleteServersAdminTestJSON-908878947 tempest-DeleteServersAdminTestJSON-908878947-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:55.242719 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c44cb6a9-64ae-40db-8c42-bda84efce686 tempest-DeleteServersAdminTestJSON-908878947 tempest-DeleteServersAdminTestJSON-908878947-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:55.243560 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c44cb6a9-64ae-40db-8c42-bda84efce686 tempest-DeleteServersAdminTestJSON-908878947 tempest-DeleteServersAdminTestJSON-908878947-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:55.474635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-79e4cbb6-51e9-4ed0-99d8-486237c159ec tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:55.502556 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-79e4cbb6-51e9-4ed0-99d8-486237c159ec tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 200 len: 1322 microversion: 2.1 time: 0.404810 Jun 16 14:37:55.522548 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 145/311] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:55 2022] GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:55.543349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ed073795-b0a2-4846-b0a3-b110eeb39676 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:55.544588 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ed073795-b0a2-4846-b0a3-b110eeb39676 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:55.576996 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ed073795-b0a2-4846-b0a3-b110eeb39676 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:55.582322 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c44cb6a9-64ae-40db-8c42-bda84efce686 tempest-DeleteServersAdminTestJSON-908878947 tempest-DeleteServersAdminTestJSON-908878947-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63/action" status: 202 len: 0 microversion: 2.1 time: 0.363334 Jun 16 14:37:55.584889 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 167/312] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:37:55 2022] POST /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:37:55.597447 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-77838a72-8637-4de5-86a7-69929e0ebe54 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:55.599436 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-77838a72-8637-4de5-86a7-69929e0ebe54 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:55.610081 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ed073795-b0a2-4846-b0a3-b110eeb39676 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:55.611678 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ed073795-b0a2-4846-b0a3-b110eeb39676 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:55.612447 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ed073795-b0a2-4846-b0a3-b110eeb39676 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:55.619099 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-77838a72-8637-4de5-86a7-69929e0ebe54 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:55.619561 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-77838a72-8637-4de5-86a7-69929e0ebe54 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:55.620372 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-77838a72-8637-4de5-86a7-69929e0ebe54 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:55.621170 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-77838a72-8637-4de5-86a7-69929e0ebe54 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:55.705923 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-77838a72-8637-4de5-86a7-69929e0ebe54 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:55.708810 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-77838a72-8637-4de5-86a7-69929e0ebe54 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:55.711137 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-77838a72-8637-4de5-86a7-69929e0ebe54 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lazy-loading 'fault' on Instance uuid 08256156-566f-40b4-a2bf-7eb0a0e11a63 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:37:56.114775 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-77838a72-8637-4de5-86a7-69929e0ebe54 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:56.126619 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-77838a72-8637-4de5-86a7-69929e0ebe54 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 200 len: 1452 microversion: 2.1 time: 0.535966 Jun 16 14:37:56.130771 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 168/313] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:55 2022] GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 1452 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:56.147654 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-246623ef-148f-4965-9fa6-1936deaca8b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:56.148285 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-246623ef-148f-4965-9fa6-1936deaca8b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:56.159085 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-246623ef-148f-4965-9fa6-1936deaca8b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:56.159555 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-246623ef-148f-4965-9fa6-1936deaca8b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:56.162658 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-246623ef-148f-4965-9fa6-1936deaca8b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:56.165742 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-246623ef-148f-4965-9fa6-1936deaca8b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:56.696933 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-246623ef-148f-4965-9fa6-1936deaca8b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:56.734507 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-246623ef-148f-4965-9fa6-1936deaca8b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1280 microversion: 2.1 time: 0.591438 Jun 16 14:37:56.735725 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 169/314] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:56 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1280 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:56.772499 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-42d54b88-f153-4afa-b7db-2e2627cab59f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:56.773502 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-42d54b88-f153-4afa-b7db-2e2627cab59f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:56.802182 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-42d54b88-f153-4afa-b7db-2e2627cab59f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:56.803007 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-42d54b88-f153-4afa-b7db-2e2627cab59f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:56.804433 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-42d54b88-f153-4afa-b7db-2e2627cab59f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:56.805475 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-42d54b88-f153-4afa-b7db-2e2627cab59f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:56.929025 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-42d54b88-f153-4afa-b7db-2e2627cab59f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:37:57.100157 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ed073795-b0a2-4846-b0a3-b110eeb39676 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:57.144454 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ed073795-b0a2-4846-b0a3-b110eeb39676 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1503 microversion: 2.1 time: 1.629546 Jun 16 14:37:57.159801 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 146/315] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:55 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1503 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:57.192092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6f039a5a-daec-473a-b995-dab82f1aa811 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:57.210409 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6f039a5a-daec-473a-b995-dab82f1aa811 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:57.260495 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f039a5a-daec-473a-b995-dab82f1aa811 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:57.263613 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f039a5a-daec-473a-b995-dab82f1aa811 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:57.275532 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f039a5a-daec-473a-b995-dab82f1aa811 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:57.276339 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f039a5a-daec-473a-b995-dab82f1aa811 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:57.293300 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-42d54b88-f153-4afa-b7db-2e2627cab59f tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "DELETE /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 204 len: 0 microversion: 2.1 time: 0.543716 Jun 16 14:37:57.294274 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 170/316] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:37:56 2022] DELETE /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:37:57.310277 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-13c52e42-4336-425f-98f7-8c7831937c43 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:57.311066 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-13c52e42-4336-425f-98f7-8c7831937c43 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:57.341138 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13c52e42-4336-425f-98f7-8c7831937c43 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:57.341604 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13c52e42-4336-425f-98f7-8c7831937c43 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:57.342473 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13c52e42-4336-425f-98f7-8c7831937c43 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:57.344563 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13c52e42-4336-425f-98f7-8c7831937c43 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:57.477634 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13c52e42-4336-425f-98f7-8c7831937c43 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:57.478997 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13c52e42-4336-425f-98f7-8c7831937c43 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:57.480100 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-13c52e42-4336-425f-98f7-8c7831937c43 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lazy-loading 'fault' on Instance uuid 08256156-566f-40b4-a2bf-7eb0a0e11a63 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:37:57.619557 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6f039a5a-daec-473a-b995-dab82f1aa811 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:57.662053 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6f039a5a-daec-473a-b995-dab82f1aa811 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 200 len: 1322 microversion: 2.1 time: 0.490360 Jun 16 14:37:57.686943 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 147/317] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:57 2022] GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 1322 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:57.770135 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e6e46b24-48eb-4c45-8385-a37dce3a0353 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:57.774559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e6e46b24-48eb-4c45-8385-a37dce3a0353 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:57.802411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6e46b24-48eb-4c45-8385-a37dce3a0353 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:57.807599 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6e46b24-48eb-4c45-8385-a37dce3a0353 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:57.813130 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6e46b24-48eb-4c45-8385-a37dce3a0353 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:57.819486 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6e46b24-48eb-4c45-8385-a37dce3a0353 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:58.504743 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e6e46b24-48eb-4c45-8385-a37dce3a0353 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:58.537702 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e6e46b24-48eb-4c45-8385-a37dce3a0353 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1322 microversion: 2.1 time: 0.771312 Jun 16 14:37:58.538970 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 148/318] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:57 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1322 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:37:58.708140 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-13c52e42-4336-425f-98f7-8c7831937c43 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:37:58.718697 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-13c52e42-4336-425f-98f7-8c7831937c43 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 200 len: 1458 microversion: 2.1 time: 1.416796 Jun 16 14:37:58.727142 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 171/319] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:57 2022] GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 1458 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:37:58.742448 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3fe8b42d-2f16-4ff3-88d2-af1633ea75b3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:58.743200 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3fe8b42d-2f16-4ff3-88d2-af1633ea75b3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:58.763191 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3fe8b42d-2f16-4ff3-88d2-af1633ea75b3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:58.765157 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3fe8b42d-2f16-4ff3-88d2-af1633ea75b3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:58.766113 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3fe8b42d-2f16-4ff3-88d2-af1633ea75b3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:58.766678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3fe8b42d-2f16-4ff3-88d2-af1633ea75b3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:59.155269 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3e929480-1906-4a20-a22b-c39850fc479d tempest-FlavorMetadataValidation-809767508 tempest-FlavorMetadataValidation-809767508-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1923357464", "id": 1246701816, "os-flavor-access:is_public": "True"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:59.159500 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:37:59.159500 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:37:59.238269 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3e929480-1906-4a20-a22b-c39850fc479d tempest-FlavorMetadataValidation-809767508 tempest-FlavorMetadataValidation-809767508-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.692527 Jun 16 14:37:59.240698 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 149/320] 10.222.0.57 () {62 vars in 1187 bytes} [Thu Jun 16 14:37:58 2022] POST /compute/v2.1/flavors => generated 471 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:37:59.267957 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-53256981-6892-4a92-ad86-52e5731168ab req-82b0a0ac-0301-4bfb-9ec5-9594526410d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3c31ac-af0e-4b6f-ab6a-36316a393d77", "name": "network-vif-unplugged", "status": "completed", "tag": "75ab1982-70e8-4bb1-a9d6-1f4b0b0997f2"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:37:59.326817 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-53256981-6892-4a92-ad86-52e5731168ab req-82b0a0ac-0301-4bfb-9ec5-9594526410d2 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:59.329190 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-53256981-6892-4a92-ad86-52e5731168ab req-82b0a0ac-0301-4bfb-9ec5-9594526410d2 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:59.410460 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-53256981-6892-4a92-ad86-52e5731168ab req-82b0a0ac-0301-4bfb-9ec5-9594526410d2 service nova] Creating event network-vif-unplugged:75ab1982-70e8-4bb1-a9d6-1f4b0b0997f2 for instance ea3c31ac-af0e-4b6f-ab6a-36316a393d77 on n-h1-836830-4 Jun 16 14:37:59.420581 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-53256981-6892-4a92-ad86-52e5731168ab req-82b0a0ac-0301-4bfb-9ec5-9594526410d2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.175329 Jun 16 14:37:59.422955 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 150/321] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:37:59.435060 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-56a4e0be-e7d8-4c75-82d3-08b51a134a5f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:37:59.436808 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-56a4e0be-e7d8-4c75-82d3-08b51a134a5f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:37:59.450914 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56a4e0be-e7d8-4c75-82d3-08b51a134a5f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:59.452080 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56a4e0be-e7d8-4c75-82d3-08b51a134a5f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:59.454553 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56a4e0be-e7d8-4c75-82d3-08b51a134a5f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:37:59.455634 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56a4e0be-e7d8-4c75-82d3-08b51a134a5f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:37:59.729446 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:00.045011 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-56a4e0be-e7d8-4c75-82d3-08b51a134a5f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:00.066639 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-56a4e0be-e7d8-4c75-82d3-08b51a134a5f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 200 len: 1390 microversion: 2.1 time: 0.639466 Jun 16 14:38:00.067632 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 151/322] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:59 2022] GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 1390 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:00.199525 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3fe8b42d-2f16-4ff3-88d2-af1633ea75b3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:00.223357 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3fe8b42d-2f16-4ff3-88d2-af1633ea75b3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1503 microversion: 2.1 time: 1.494498 Jun 16 14:38:00.230700 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 172/323] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:37:58 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1503 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:00.250487 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2422a70b-5936-4f2d-9ea2-29c884414647 tempest-FlavorMetadataValidation-809767508 tempest-FlavorMetadataValidation-809767508-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:00.267316 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:00.267316 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:00.676920 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-39b8f17a-2d6f-4c17-a217-b131cd059a5f tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Calling method '.version_select at 0x7fdf0c7501f0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:00.678796 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:00.678796 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:00.681226 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39b8f17a-2d6f-4c17-a217-b131cd059a5f tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:00.688673 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39b8f17a-2d6f-4c17-a217-b131cd059a5f tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:00.748202 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39b8f17a-2d6f-4c17-a217-b131cd059a5f tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:00.750886 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39b8f17a-2d6f-4c17-a217-b131cd059a5f tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:00.804522 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39b8f17a-2d6f-4c17-a217-b131cd059a5f tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:00.810859 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39b8f17a-2d6f-4c17-a217-b131cd059a5f tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:00.834973 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-39b8f17a-2d6f-4c17-a217-b131cd059a5f tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.765029 Jun 16 14:38:00.837133 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 152/324] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:38:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:00.847881 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bea226f7-fe49-4c1e-bb29-8dce65d3e6df tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:00.853961 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bea226f7-fe49-4c1e-bb29-8dce65d3e6df tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:00.869110 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bea226f7-fe49-4c1e-bb29-8dce65d3e6df tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:00.875194 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bea226f7-fe49-4c1e-bb29-8dce65d3e6df tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:00.880131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bea226f7-fe49-4c1e-bb29-8dce65d3e6df tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:00.882968 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bea226f7-fe49-4c1e-bb29-8dce65d3e6df tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:00.946056 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:00.948074 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=8 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:00.959401 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2422a70b-5936-4f2d-9ea2-29c884414647 tempest-FlavorMetadataValidation-809767508 tempest-FlavorMetadataValidation-809767508-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/1246701816/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.726359 Jun 16 14:38:00.961225 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 173/325] 10.222.0.57 () {62 vars in 1264 bytes} [Thu Jun 16 14:38:00 2022] POST /compute/v2.1/flavors/1246701816/os-extra_specs => generated 62 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:00.987398 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2dd867af-4ace-401c-bd4a-bc6783609072 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:01.007977 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2dd867af-4ace-401c-bd4a-bc6783609072 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:01.036303 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2dd867af-4ace-401c-bd4a-bc6783609072 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:01.039376 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2dd867af-4ace-401c-bd4a-bc6783609072 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:01.041059 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2dd867af-4ace-401c-bd4a-bc6783609072 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:01.048154 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2dd867af-4ace-401c-bd4a-bc6783609072 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:01.184192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2dd867af-4ace-401c-bd4a-bc6783609072 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:01.185507 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2dd867af-4ace-401c-bd4a-bc6783609072 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:01.186576 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-2dd867af-4ace-401c-bd4a-bc6783609072 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lazy-loading 'fault' on Instance uuid 08256156-566f-40b4-a2bf-7eb0a0e11a63 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:38:01.527898 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2dd867af-4ace-401c-bd4a-bc6783609072 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6304cd29462244fc8559b2be905480c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdb8fc855c04708902f51318244b201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:01.543859 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2dd867af-4ace-401c-bd4a-bc6783609072 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 200 len: 1416 microversion: 2.1 time: 0.574851 Jun 16 14:38:01.549363 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 174/326] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:00 2022] GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 1416 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:01.665966 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=12 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:01.829670 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-aa79146b-7582-480c-afe3-c3903f6e1b1c tempest-AZAdminV2TestJSON-1344781660 tempest-AZAdminV2TestJSON-1344781660-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:01.840827 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aa79146b-7582-480c-afe3-c3903f6e1b1c tempest-AZAdminV2TestJSON-1344781660 tempest-AZAdminV2TestJSON-1344781660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:01.841637 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aa79146b-7582-480c-afe3-c3903f6e1b1c tempest-AZAdminV2TestJSON-1344781660 tempest-AZAdminV2TestJSON-1344781660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:01.857371 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aa79146b-7582-480c-afe3-c3903f6e1b1c tempest-AZAdminV2TestJSON-1344781660 tempest-AZAdminV2TestJSON-1344781660-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:01.866113 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aa79146b-7582-480c-afe3-c3903f6e1b1c tempest-AZAdminV2TestJSON-1344781660 tempest-AZAdminV2TestJSON-1344781660-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:01.980821 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-aa79146b-7582-480c-afe3-c3903f6e1b1c tempest-AZAdminV2TestJSON-1344781660 tempest-AZAdminV2TestJSON-1344781660-project-admin] 10.222.0.57 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.421498 Jun 16 14:38:01.989752 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 175/327] 10.222.0.57 () {58 vars in 1163 bytes} [Thu Jun 16 14:38:01 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:38:02.005652 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-03fcd928-f4dc-4f94-973b-a86f8b096662 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Calling method '.version_select at 0x7fdf0c8df3a0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:02.006875 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:02.006875 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:02.017444 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-03fcd928-f4dc-4f94-973b-a86f8b096662 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:02.018573 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-03fcd928-f4dc-4f94-973b-a86f8b096662 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:02.056386 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-03fcd928-f4dc-4f94-973b-a86f8b096662 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:02.059672 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-03fcd928-f4dc-4f94-973b-a86f8b096662 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:02.095240 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-03fcd928-f4dc-4f94-973b-a86f8b096662 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:02.096252 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-03fcd928-f4dc-4f94-973b-a86f8b096662 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:02.098150 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bea226f7-fe49-4c1e-bb29-8dce65d3e6df tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:02.116591 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-03fcd928-f4dc-4f94-973b-a86f8b096662 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.125128 Jun 16 14:38:02.119147 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 176/328] 10.222.0.57 () {58 vars in 1166 bytes} [Thu Jun 16 14:38:01 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:02.144603 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8a99fc5f-7840-4fc5-a657-e95346a7711e tempest-FlavorMetadataValidation-809767508 tempest-FlavorMetadataValidation-809767508-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:02.145903 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:02.145903 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:02.147013 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bea226f7-fe49-4c1e-bb29-8dce65d3e6df tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1322 microversion: 2.1 time: 1.307675 Jun 16 14:38:02.148597 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 153/329] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:00 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1322 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:02.153546 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:02.163497 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9cbbe234-3e22-4867-bbe7-e4c4e73592a8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:02.165257 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9cbbe234-3e22-4867-bbe7-e4c4e73592a8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:02.194607 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9cbbe234-3e22-4867-bbe7-e4c4e73592a8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:02.195792 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9cbbe234-3e22-4867-bbe7-e4c4e73592a8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:02.197567 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9cbbe234-3e22-4867-bbe7-e4c4e73592a8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:02.198565 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9cbbe234-3e22-4867-bbe7-e4c4e73592a8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:02.220726 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8a99fc5f-7840-4fc5-a657-e95346a7711e tempest-FlavorMetadataValidation-809767508 tempest-FlavorMetadataValidation-809767508-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1246701816" status: 202 len: 0 microversion: 2.86 time: 0.088659 Jun 16 14:38:02.224167 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 177/330] 10.222.0.57 () {60 vars in 1201 bytes} [Thu Jun 16 14:38:02 2022] DELETE /compute/v2.1/flavors/1246701816 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:38:02.248843 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-30e68ead-aa3a-4e64-8a67-d1d15713e6a3 req-5e505555-dc65-4008-808b-92acdff2969c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f15993a1-48b8-4267-869d-8e98bf19cdaa", "tag": "ca1af4e3-3d7e-4f00-ba23-5993bdef5ea5"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:02.276913 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-30e68ead-aa3a-4e64-8a67-d1d15713e6a3 req-5e505555-dc65-4008-808b-92acdff2969c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:02.277693 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-30e68ead-aa3a-4e64-8a67-d1d15713e6a3 req-5e505555-dc65-4008-808b-92acdff2969c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:02.303444 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-30e68ead-aa3a-4e64-8a67-d1d15713e6a3 req-5e505555-dc65-4008-808b-92acdff2969c service nova] Creating event network-changed:ca1af4e3-3d7e-4f00-ba23-5993bdef5ea5 for instance f15993a1-48b8-4267-869d-8e98bf19cdaa on n-h1-836830-4 Jun 16 14:38:02.311215 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-30e68ead-aa3a-4e64-8a67-d1d15713e6a3 req-5e505555-dc65-4008-808b-92acdff2969c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084015 Jun 16 14:38:02.313075 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 178/331] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:02.322533 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d2f8823b-73e1-49eb-a9d8-b0e810b4806a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:02.323630 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d2f8823b-73e1-49eb-a9d8-b0e810b4806a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:02.333710 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d2f8823b-73e1-49eb-a9d8-b0e810b4806a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:02.334581 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d2f8823b-73e1-49eb-a9d8-b0e810b4806a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:02.336451 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d2f8823b-73e1-49eb-a9d8-b0e810b4806a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:02.337149 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d2f8823b-73e1-49eb-a9d8-b0e810b4806a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:02.566761 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=8 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:02.834513 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9cbbe234-3e22-4867-bbe7-e4c4e73592a8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:02.848061 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9cbbe234-3e22-4867-bbe7-e4c4e73592a8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 200 len: 1390 microversion: 2.1 time: 0.697139 Jun 16 14:38:02.849989 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 154/332] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:02 2022] GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 1390 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:02.860061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-44c8eead-e6a4-45b7-bf72-bf58caddac69 req-734e5041-3fe7-48ae-bcff-cea8a3fd8a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b36c679-5452-4c35-ba4a-a19aa69e3fd8", "tag": "9f8be973-6750-49fd-8447-597286585736"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:02.899541 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d2f8823b-73e1-49eb-a9d8-b0e810b4806a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:02.906812 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-44c8eead-e6a4-45b7-bf72-bf58caddac69 req-734e5041-3fe7-48ae-bcff-cea8a3fd8a85 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:02.908179 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-44c8eead-e6a4-45b7-bf72-bf58caddac69 req-734e5041-3fe7-48ae-bcff-cea8a3fd8a85 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:02.933134 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-44c8eead-e6a4-45b7-bf72-bf58caddac69 req-734e5041-3fe7-48ae-bcff-cea8a3fd8a85 service nova] Creating event network-changed:9f8be973-6750-49fd-8447-597286585736 for instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 on n-h1-836830-4 Jun 16 14:38:02.933807 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d2f8823b-73e1-49eb-a9d8-b0e810b4806a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1503 microversion: 2.1 time: 0.618583 Jun 16 14:38:02.943687 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 179/333] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:02 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1503 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:02.944666 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-44c8eead-e6a4-45b7-bf72-bf58caddac69 req-734e5041-3fe7-48ae-bcff-cea8a3fd8a85 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092051 Jun 16 14:38:02.946318 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 155/334] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:02.952373 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-822cd81e-a81d-44b3-80df-608cf47723aa tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Calling method '.version_select at 0x7fdf0c762ca0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:02.954497 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:02.954497 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:02.956837 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-822cd81e-a81d-44b3-80df-608cf47723aa tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:02.960805 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-822cd81e-a81d-44b3-80df-608cf47723aa tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:02.974352 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-28be1038-5d98-41f9-9326-d9192155f318 tempest-AZAdminV2TestJSON-1344781660 tempest-AZAdminV2TestJSON-1344781660-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:02.981900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-822cd81e-a81d-44b3-80df-608cf47723aa tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:02.983107 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-822cd81e-a81d-44b3-80df-608cf47723aa tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:02.985572 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:02.985572 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:02.988050 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28be1038-5d98-41f9-9326-d9192155f318 tempest-AZAdminV2TestJSON-1344781660 tempest-AZAdminV2TestJSON-1344781660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:02.988894 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28be1038-5d98-41f9-9326-d9192155f318 tempest-AZAdminV2TestJSON-1344781660 tempest-AZAdminV2TestJSON-1344781660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:02.995820 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28be1038-5d98-41f9-9326-d9192155f318 tempest-AZAdminV2TestJSON-1344781660 tempest-AZAdminV2TestJSON-1344781660-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:02.996649 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28be1038-5d98-41f9-9326-d9192155f318 tempest-AZAdminV2TestJSON-1344781660 tempest-AZAdminV2TestJSON-1344781660-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.008505 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-822cd81e-a81d-44b3-80df-608cf47723aa tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.009321 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-822cd81e-a81d-44b3-80df-608cf47723aa tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.040905 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-822cd81e-a81d-44b3-80df-608cf47723aa tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.093025 Jun 16 14:38:03.042607 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 156/335] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:38:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:03.054083 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4ea9e5e4-99c8-473e-9364-c1d806998301 tempest-FlavorMetadataValidation-809767508 tempest-FlavorMetadataValidation-809767508-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:03.102119 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4ea9e5e4-99c8-473e-9364-c1d806998301 tempest-FlavorMetadataValidation-809767508 tempest-FlavorMetadataValidation-809767508-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 6683 microversion: 2.86 time: 0.057680 Jun 16 14:38:03.103822 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 157/336] 10.222.0.57 () {60 vars in 1186 bytes} [Thu Jun 16 14:38:03 2022] GET /compute/v2.1/flavors/detail => generated 6683 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:38:03.111947 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-28be1038-5d98-41f9-9326-d9192155f318 tempest-AZAdminV2TestJSON-1344781660 tempest-AZAdminV2TestJSON-1344781660-project-admin] 10.222.0.57 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.165299 Jun 16 14:38:03.112439 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-81ead616-4782-4460-873d-0c9f83c96a60 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:03.112999 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 180/337] 10.222.0.57 () {58 vars in 1184 bytes} [Thu Jun 16 14:38:02 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:03.113587 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-81ead616-4782-4460-873d-0c9f83c96a60 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:03.124605 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-81ead616-4782-4460-873d-0c9f83c96a60 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.125842 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-81ead616-4782-4460-873d-0c9f83c96a60 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.137724 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-81ead616-4782-4460-873d-0c9f83c96a60 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.141094 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-81ead616-4782-4460-873d-0c9f83c96a60 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.143190 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-31732a1b-2589-4245-8375-366d83416bfa tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Calling method '.version_select at 0x7fdf0c96fdc0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:03.144967 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:03.144967 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:03.147370 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31732a1b-2589-4245-8375-366d83416bfa tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.148141 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31732a1b-2589-4245-8375-366d83416bfa tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.227225 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-81ead616-4782-4460-873d-0c9f83c96a60 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] HTTP exception thrown: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. Jun 16 14:38:03.235727 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31732a1b-2589-4245-8375-366d83416bfa tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.241242 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31732a1b-2589-4245-8375-366d83416bfa tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-81ead616-4782-4460-873d-0c9f83c96a60 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Request method failure captured: Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 HTTP/1.1 Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_pkzkcJLO2D273eJhu4tW-8DvT7jvzGX4uw9lWuBU7Lu-_ig0-3dvrcxc1ImMi338YDOhJlcyvGMP0OM0v0MEkR4_2yrASQHGIooR_AY_UqGpoedr8Mat21CySIL6xsiG3qjyGhsDM2BTEiQSJwYLsU6YSHJAZ_aJuzKnkuvy2vu8 Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 8fdb8fc855c04708902f51318244b201 Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:38:03.246114 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:38:03.248632 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fdb8fc855c04708902f51318244b201", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fdb8fc855c04708902f51318244b201"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fdb8fc855c04708902f51318244b201"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fdb8fc855c04708902f51318244b201"}]}] Jun 16 14:38:03.248632 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:38:03.248632 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 8fdb8fc855c04708902f51318244b201 Jun 16 14:38:03.248632 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:38:03.248632 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-DeleteServersAdminTestJSON-51983624-project Jun 16 14:38:03.248632 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:38:03.248632 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:38:03.248632 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 6304cd29462244fc8559b2be905480c5 Jun 16 14:38:03.248632 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-DeleteServersAdminTestJSON-51983624-project Jun 16 14:38:03.248632 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:38:03.248632 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. Jun 16 14:38:03.248632 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '08256156-566f-40b4-a2bf-7eb0a0e11a63'} Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:03.252192 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. Jun 16 14:38:03.255846 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.261075 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-81ead616-4782-4460-873d-0c9f83c96a60 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Returning 404 to user: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:03.261075 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-81ead616-4782-4460-873d-0c9f83c96a60 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 404 len: 111 microversion: 2.1 time: 0.151006 Jun 16 14:38:03.262738 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 158/338] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:03 2022] GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:03.287514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-10ef5d78-244f-4127-84bf-606ab30a97d0 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:03.292450 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-10ef5d78-244f-4127-84bf-606ab30a97d0 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:03.293748 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-31732a1b-2589-4245-8375-366d83416bfa tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.178480 Jun 16 14:38:03.296929 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 181/339] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:38:03 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:03.318185 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10ef5d78-244f-4127-84bf-606ab30a97d0 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.321355 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1fe85aee-6480-4733-ab96-e94ab879e1bd tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:03.326215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10ef5d78-244f-4127-84bf-606ab30a97d0 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.327275 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1fe85aee-6480-4733-ab96-e94ab879e1bd tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:03.329538 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10ef5d78-244f-4127-84bf-606ab30a97d0 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.330685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10ef5d78-244f-4127-84bf-606ab30a97d0 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.365120 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1fe85aee-6480-4733-ab96-e94ab879e1bd tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.365933 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1fe85aee-6480-4733-ab96-e94ab879e1bd tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.369933 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1fe85aee-6480-4733-ab96-e94ab879e1bd tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.373638 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1fe85aee-6480-4733-ab96-e94ab879e1bd tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.429262 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-1fe85aee-6480-4733-ab96-e94ab879e1bd tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] HTTP exception thrown: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1fe85aee-6480-4733-ab96-e94ab879e1bd tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Request method failure captured: Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 HTTP/1.1 Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_pkzkcJLO2D273eJhu4tW-8DvT7jvzGX4uw9lWuBU7Lu-_ig0-3dvrcxc1ImMi338YDOhJlcyvGMP0OM0v0MEkR4_2yrASQHGIooR_AY_UqGpoedr8Mat21CySIL6xsiG3qjyGhsDM2BTEiQSJwYLsU6YSHJAZ_aJuzKnkuvy2vu8 Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 8fdb8fc855c04708902f51318244b201 Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:38:03.432755 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:38:03.434243 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fdb8fc855c04708902f51318244b201", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fdb8fc855c04708902f51318244b201"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fdb8fc855c04708902f51318244b201"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fdb8fc855c04708902f51318244b201"}]}] Jun 16 14:38:03.434243 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:38:03.434243 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 8fdb8fc855c04708902f51318244b201 Jun 16 14:38:03.434243 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:38:03.434243 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-DeleteServersAdminTestJSON-51983624-project Jun 16 14:38:03.434243 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:03.434243 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:03.434243 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 6304cd29462244fc8559b2be905480c5 Jun 16 14:38:03.434243 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-DeleteServersAdminTestJSON-51983624-project Jun 16 14:38:03.434243 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:38:03.434243 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. Jun 16 14:38:03.434243 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '08256156-566f-40b4-a2bf-7eb0a0e11a63'} Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:03.435128 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. Jun 16 14:38:03.437631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.440530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1fe85aee-6480-4733-ab96-e94ab879e1bd tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Returning 404 to user: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:03.440530 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1fe85aee-6480-4733-ab96-e94ab879e1bd tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "DELETE /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 404 len: 111 microversion: 2.1 time: 0.136484 Jun 16 14:38:03.447615 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 182/340] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:38:03 2022] DELETE /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:03.465838 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c1d5dd54-2fe1-4798-9688-a801ed3fa247 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Calling method '.version_select at 0x7fdf0c5c5af0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:03.469386 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:03.469386 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:03.472195 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c1d5dd54-2fe1-4798-9688-a801ed3fa247 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.473003 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c1d5dd54-2fe1-4798-9688-a801ed3fa247 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.554973 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c1d5dd54-2fe1-4798-9688-a801ed3fa247 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.105162 Jun 16 14:38:03.570102 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 183/341] 10.222.0.57 () {58 vars in 1178 bytes} [Thu Jun 16 14:38:03 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:03.599967 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2893751f-d406-4081-b424-0caeec95af63 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:03.600671 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2893751f-d406-4081-b424-0caeec95af63 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 08256156-566f-40b4-a2bf-7eb0a0e11a63] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:03.613494 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2893751f-d406-4081-b424-0caeec95af63 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.613962 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2893751f-d406-4081-b424-0caeec95af63 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.614726 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2893751f-d406-4081-b424-0caeec95af63 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.615701 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2893751f-d406-4081-b424-0caeec95af63 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.647579 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-2893751f-d406-4081-b424-0caeec95af63 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] HTTP exception thrown: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2893751f-d406-4081-b424-0caeec95af63 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Request method failure captured: Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 HTTP/1.1 Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_pkzkcJLO2D273eJhu4tW-8DvT7jvzGX4uw9lWuBU7Lu-_ig0-3dvrcxc1ImMi338YDOhJlcyvGMP0OM0v0MEkR4_2yrASQHGIooR_AY_UqGpoedr8Mat21CySIL6xsiG3qjyGhsDM2BTEiQSJwYLsU6YSHJAZ_aJuzKnkuvy2vu8 Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 8fdb8fc855c04708902f51318244b201 Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:38:03.649672 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:38:03.651076 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fdb8fc855c04708902f51318244b201", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fdb8fc855c04708902f51318244b201"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fdb8fc855c04708902f51318244b201"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fdb8fc855c04708902f51318244b201"}]}] Jun 16 14:38:03.651076 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:38:03.651076 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 8fdb8fc855c04708902f51318244b201 Jun 16 14:38:03.651076 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:38:03.651076 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-DeleteServersAdminTestJSON-51983624-project Jun 16 14:38:03.651076 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:03.651076 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:03.651076 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 6304cd29462244fc8559b2be905480c5 Jun 16 14:38:03.651076 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-DeleteServersAdminTestJSON-51983624-project Jun 16 14:38:03.651076 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:38:03.651076 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. Jun 16 14:38:03.651076 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '08256156-566f-40b4-a2bf-7eb0a0e11a63'} Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:03.651739 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. Jun 16 14:38:03.652912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.657116 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2893751f-d406-4081-b424-0caeec95af63 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Returning 404 to user: Instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:03.659092 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2893751f-d406-4081-b424-0caeec95af63 tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63" status: 404 len: 111 microversion: 2.1 time: 0.087030 Jun 16 14:38:03.665732 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 184/342] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:03 2022] GET /compute/v2.1/servers/08256156-566f-40b4-a2bf-7eb0a0e11a63 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:03.676985 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-daf2f20b-9888-486b-99a5-8cc352b82a93 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Calling method '.version_select at 0x7fdf0c718940>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:03.679368 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:03.679368 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:03.681866 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-daf2f20b-9888-486b-99a5-8cc352b82a93 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.683134 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-daf2f20b-9888-486b-99a5-8cc352b82a93 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.689365 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:03.730972 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-daf2f20b-9888-486b-99a5-8cc352b82a93 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.738215 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-daf2f20b-9888-486b-99a5-8cc352b82a93 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.756162 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-daf2f20b-9888-486b-99a5-8cc352b82a93 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.757887 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-daf2f20b-9888-486b-99a5-8cc352b82a93 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.767630 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-daf2f20b-9888-486b-99a5-8cc352b82a93 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.099426 Jun 16 14:38:03.768972 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 185/343] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:38:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:03.783168 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-57bc26dd-7f72-49d4-a66d-99208e11005d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:03.783932 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-57bc26dd-7f72-49d4-a66d-99208e11005d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:03.800902 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57bc26dd-7f72-49d4-a66d-99208e11005d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.802338 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57bc26dd-7f72-49d4-a66d-99208e11005d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.803405 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57bc26dd-7f72-49d4-a66d-99208e11005d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.804087 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57bc26dd-7f72-49d4-a66d-99208e11005d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.832207 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-57bc26dd-7f72-49d4-a66d-99208e11005d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] HTTP exception thrown: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-57bc26dd-7f72-49d4-a66d-99208e11005d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Request method failure captured: Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 HTTP/1.1 Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_pkzkcJLO2D273eJhu4tW-8DvT7jvzGX4uw9lWuBU7Lu-_ig0-3dvrcxc1ImMi338YDOhJlcyvGMP0OM0v0MEkR4_2yrASQHGIooR_AY_UqGpoedr8Mat21CySIL6xsiG3qjyGhsDM2BTEiQSJwYLsU6YSHJAZ_aJuzKnkuvy2vu8 Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 8fdb8fc855c04708902f51318244b201 Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:38:03.835162 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:38:03.836590 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fdb8fc855c04708902f51318244b201", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fdb8fc855c04708902f51318244b201"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fdb8fc855c04708902f51318244b201"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fdb8fc855c04708902f51318244b201"}]}] Jun 16 14:38:03.836590 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:38:03.836590 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 8fdb8fc855c04708902f51318244b201 Jun 16 14:38:03.836590 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:38:03.836590 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-DeleteServersAdminTestJSON-51983624-project Jun 16 14:38:03.836590 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:03.836590 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:03.836590 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 6304cd29462244fc8559b2be905480c5 Jun 16 14:38:03.836590 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-DeleteServersAdminTestJSON-51983624-project Jun 16 14:38:03.836590 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:38:03.836590 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. Jun 16 14:38:03.836590 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '6537907c-347c-4c0e-85c2-10b57fd8fd50'} Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:03.837270 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. Jun 16 14:38:03.838398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.839683 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-57bc26dd-7f72-49d4-a66d-99208e11005d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Returning 404 to user: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:03.839683 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-57bc26dd-7f72-49d4-a66d-99208e11005d tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 404 len: 111 microversion: 2.1 time: 0.067242 Jun 16 14:38:03.843972 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 186/344] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:38:03 2022] DELETE /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:03.850082 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-12990a2a-0232-4a5d-919f-9f94247e0264 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Calling method '.version_select at 0x7fdf0c655f70>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:03.851254 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:03.851254 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:03.853708 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-12990a2a-0232-4a5d-919f-9f94247e0264 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.854225 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-12990a2a-0232-4a5d-919f-9f94247e0264 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.879851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-12990a2a-0232-4a5d-919f-9f94247e0264 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.880307 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-12990a2a-0232-4a5d-919f-9f94247e0264 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.903047 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-12990a2a-0232-4a5d-919f-9f94247e0264 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.056668 Jun 16 14:38:03.905513 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 187/345] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:38:03 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:03.915630 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-424fe390-1c21-498a-ba16-a78db1894b8a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:03.916902 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-424fe390-1c21-498a-ba16-a78db1894b8a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] [instance: 6537907c-347c-4c0e-85c2-10b57fd8fd50] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:03.928543 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-424fe390-1c21-498a-ba16-a78db1894b8a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.929416 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-424fe390-1c21-498a-ba16-a78db1894b8a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.930448 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-424fe390-1c21-498a-ba16-a78db1894b8a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:03.931245 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-424fe390-1c21-498a-ba16-a78db1894b8a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:03.957186 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-424fe390-1c21-498a-ba16-a78db1894b8a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] HTTP exception thrown: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-424fe390-1c21-498a-ba16-a78db1894b8a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Request method failure captured: Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 HTTP/1.1 Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiqz_pkzkcJLO2D273eJhu4tW-8DvT7jvzGX4uw9lWuBU7Lu-_ig0-3dvrcxc1ImMi338YDOhJlcyvGMP0OM0v0MEkR4_2yrASQHGIooR_AY_UqGpoedr8Mat21CySIL6xsiG3qjyGhsDM2BTEiQSJwYLsU6YSHJAZ_aJuzKnkuvy2vu8 Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 8fdb8fc855c04708902f51318244b201 Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:38:03.959365 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:38:03.960734 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fdb8fc855c04708902f51318244b201", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fdb8fc855c04708902f51318244b201"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fdb8fc855c04708902f51318244b201"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fdb8fc855c04708902f51318244b201"}]}] Jun 16 14:38:03.960734 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:38:03.960734 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 8fdb8fc855c04708902f51318244b201 Jun 16 14:38:03.960734 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-51983624 Jun 16 14:38:03.960734 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-DeleteServersAdminTestJSON-51983624-project Jun 16 14:38:03.960734 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:03.960734 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:03.960734 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 6304cd29462244fc8559b2be905480c5 Jun 16 14:38:03.960734 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-DeleteServersAdminTestJSON-51983624-project Jun 16 14:38:03.960734 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:38:03.960734 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. Jun 16 14:38:03.960734 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '6537907c-347c-4c0e-85c2-10b57fd8fd50'} Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:03.961430 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. Jun 16 14:38:03.962528 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:03.966992 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-424fe390-1c21-498a-ba16-a78db1894b8a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] Returning 404 to user: Instance 6537907c-347c-4c0e-85c2-10b57fd8fd50 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:03.968250 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-424fe390-1c21-498a-ba16-a78db1894b8a tempest-DeleteServersAdminTestJSON-51983624 tempest-DeleteServersAdminTestJSON-51983624-project] 10.222.0.57 "GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50" status: 404 len: 111 microversion: 2.1 time: 0.059720 Jun 16 14:38:03.975059 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 188/346] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:03 2022] GET /compute/v2.1/servers/6537907c-347c-4c0e-85c2-10b57fd8fd50 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:03.985530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4b36eb15-c568-4721-a51a-196955f2d1dd tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:03.986095 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-10ef5d78-244f-4127-84bf-606ab30a97d0 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:03.986249 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4b36eb15-c568-4721-a51a-196955f2d1dd tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:04.003509 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b36eb15-c568-4721-a51a-196955f2d1dd tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:04.004252 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b36eb15-c568-4721-a51a-196955f2d1dd tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:04.006641 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b36eb15-c568-4721-a51a-196955f2d1dd tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:04.007932 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b36eb15-c568-4721-a51a-196955f2d1dd tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:04.019532 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-10ef5d78-244f-4127-84bf-606ab30a97d0 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1322 microversion: 2.1 time: 0.751078 Jun 16 14:38:04.033551 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 159/347] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:03 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1322 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:04.045506 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9e66bdc9-90d2-49e4-8539-3acacd0f6736 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Calling method '.version_select at 0x7fdf0c943940>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:04.059286 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:04.059286 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:04.062736 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9e66bdc9-90d2-49e4-8539-3acacd0f6736 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:04.063911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9e66bdc9-90d2-49e4-8539-3acacd0f6736 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:04.117058 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9e66bdc9-90d2-49e4-8539-3acacd0f6736 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:04.118000 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9e66bdc9-90d2-49e4-8539-3acacd0f6736 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:04.137832 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9e66bdc9-90d2-49e4-8539-3acacd0f6736 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.102405 Jun 16 14:38:04.138849 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 160/348] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:38:04 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:04.149248 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-649f8c7d-8ec6-41cf-b923-5e862ce8492a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:04.149908 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-649f8c7d-8ec6-41cf-b923-5e862ce8492a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:04.164555 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-649f8c7d-8ec6-41cf-b923-5e862ce8492a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:04.165359 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-649f8c7d-8ec6-41cf-b923-5e862ce8492a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:04.166393 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-649f8c7d-8ec6-41cf-b923-5e862ce8492a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:04.167252 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-649f8c7d-8ec6-41cf-b923-5e862ce8492a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:04.346083 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4b36eb15-c568-4721-a51a-196955f2d1dd tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:04.372869 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4b36eb15-c568-4721-a51a-196955f2d1dd tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 200 len: 1390 microversion: 2.1 time: 0.392788 Jun 16 14:38:04.376912 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 189/349] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:03 2022] GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 1390 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:04.387953 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fd699398-216c-4ce7-a9ea-a919d2ed7c74 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Calling method '.version_select at 0x7fdf0c843670>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:04.392394 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:04.392394 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:04.399542 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fd699398-216c-4ce7-a9ea-a919d2ed7c74 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:04.400754 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fd699398-216c-4ce7-a9ea-a919d2ed7c74 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:04.440897 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fd699398-216c-4ce7-a9ea-a919d2ed7c74 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:04.442916 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fd699398-216c-4ce7-a9ea-a919d2ed7c74 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:04.469471 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fd699398-216c-4ce7-a9ea-a919d2ed7c74 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:04.477020 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fd699398-216c-4ce7-a9ea-a919d2ed7c74 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:04.519363 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fd699398-216c-4ce7-a9ea-a919d2ed7c74 tempest-HypervisorAdminTestJSON-456224448 tempest-HypervisorAdminTestJSON-456224448-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.138007 Jun 16 14:38:04.522934 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 190/350] 10.222.0.57 () {58 vars in 1172 bytes} [Thu Jun 16 14:38:04 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:04.943729 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-547ef10d-05bc-47cb-9152-c7ead701ecbb req-a32684a1-983c-4294-9673-e6d3042ac04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08256156-566f-40b4-a2bf-7eb0a0e11a63", "name": "network-vif-deleted", "tag": "b45b096e-0185-490d-9e2a-c85d1071e72e"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:04.979390 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-547ef10d-05bc-47cb-9152-c7ead701ecbb req-a32684a1-983c-4294-9673-e6d3042ac04e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:04.981341 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-547ef10d-05bc-47cb-9152-c7ead701ecbb req-a32684a1-983c-4294-9673-e6d3042ac04e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:05.007214 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-547ef10d-05bc-47cb-9152-c7ead701ecbb req-a32684a1-983c-4294-9673-e6d3042ac04e service nova] Creating event network-vif-deleted:b45b096e-0185-490d-9e2a-c85d1071e72e for instance 08256156-566f-40b4-a2bf-7eb0a0e11a63 on n-h2-836830-4 Jun 16 14:38:05.015486 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-547ef10d-05bc-47cb-9152-c7ead701ecbb req-a32684a1-983c-4294-9673-e6d3042ac04e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079536 Jun 16 14:38:05.019145 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 191/351] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:05.049751 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4fb800fe-bcbf-4d46-bd45-f94e508654e9 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:05.051817 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4fb800fe-bcbf-4d46-bd45-f94e508654e9 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:05.094723 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4fb800fe-bcbf-4d46-bd45-f94e508654e9 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:05.096290 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4fb800fe-bcbf-4d46-bd45-f94e508654e9 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:05.099529 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4fb800fe-bcbf-4d46-bd45-f94e508654e9 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:05.101697 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4fb800fe-bcbf-4d46-bd45-f94e508654e9 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:05.317817 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-649f8c7d-8ec6-41cf-b923-5e862ce8492a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:05.330174 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-649f8c7d-8ec6-41cf-b923-5e862ce8492a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1503 microversion: 2.1 time: 1.189875 Jun 16 14:38:05.339038 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 161/352] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:04 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1503 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:05.405944 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-68ca516e-9ca3-4b50-8b0e-1e044a7804e3 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:05.411697 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-68ca516e-9ca3-4b50-8b0e-1e044a7804e3 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:05.455154 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-68ca516e-9ca3-4b50-8b0e-1e044a7804e3 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:05.456106 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-68ca516e-9ca3-4b50-8b0e-1e044a7804e3 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:05.457630 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-68ca516e-9ca3-4b50-8b0e-1e044a7804e3 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:05.464775 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-68ca516e-9ca3-4b50-8b0e-1e044a7804e3 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:05.714813 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4fb800fe-bcbf-4d46-bd45-f94e508654e9 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:05.731341 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4fb800fe-bcbf-4d46-bd45-f94e508654e9 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1322 microversion: 2.1 time: 0.695698 Jun 16 14:38:05.733210 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 192/353] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:05 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1322 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:38:06.237996 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-68ca516e-9ca3-4b50-8b0e-1e044a7804e3 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:06.250325 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-68ca516e-9ca3-4b50-8b0e-1e044a7804e3 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 200 len: 1390 microversion: 2.1 time: 0.859017 Jun 16 14:38:06.253459 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 162/354] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:05 2022] GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 1390 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:06.354744 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e25fc31b-ca24-4f8f-a6ec-eb9adc93f63d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:06.357956 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e25fc31b-ca24-4f8f-a6ec-eb9adc93f63d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:06.378965 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e25fc31b-ca24-4f8f-a6ec-eb9adc93f63d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:06.386601 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e25fc31b-ca24-4f8f-a6ec-eb9adc93f63d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:06.390826 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e25fc31b-ca24-4f8f-a6ec-eb9adc93f63d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:06.391800 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e25fc31b-ca24-4f8f-a6ec-eb9adc93f63d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:06.752966 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-10747792-6bab-4cf6-b7ec-7325f561d765 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:06.754550 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-10747792-6bab-4cf6-b7ec-7325f561d765 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:06.773330 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10747792-6bab-4cf6-b7ec-7325f561d765 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:06.776134 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10747792-6bab-4cf6-b7ec-7325f561d765 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:06.779379 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10747792-6bab-4cf6-b7ec-7325f561d765 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:06.780283 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10747792-6bab-4cf6-b7ec-7325f561d765 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:07.085114 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e25fc31b-ca24-4f8f-a6ec-eb9adc93f63d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:07.112199 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e25fc31b-ca24-4f8f-a6ec-eb9adc93f63d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1493 microversion: 2.1 time: 0.765506 Jun 16 14:38:07.115397 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 193/355] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:06 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1493 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:07.149670 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f79e5932-8c1f-4173-b85b-949d61cd6235 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '.version_select at 0x7fdf0c655e50>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:07.157638 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f79e5932-8c1f-4173-b85b-949d61cd6235 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:07.159439 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f79e5932-8c1f-4173-b85b-949d61cd6235 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:07.185289 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f79e5932-8c1f-4173-b85b-949d61cd6235 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.043449 Jun 16 14:38:07.186733 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 194/356] 10.222.0.57 () {58 vars in 1142 bytes} [Thu Jun 16 14:38:07 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:07.201784 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a749fe6f-83a3-4ebb-943c-3b2d06454a17 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:07.202534 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a749fe6f-83a3-4ebb-943c-3b2d06454a17 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:07.216252 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a749fe6f-83a3-4ebb-943c-3b2d06454a17 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:07.217123 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a749fe6f-83a3-4ebb-943c-3b2d06454a17 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:07.220336 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a749fe6f-83a3-4ebb-943c-3b2d06454a17 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:07.223034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a749fe6f-83a3-4ebb-943c-3b2d06454a17 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:07.400786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-10747792-6bab-4cf6-b7ec-7325f561d765 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:07.417505 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-10747792-6bab-4cf6-b7ec-7325f561d765 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1322 microversion: 2.1 time: 0.671489 Jun 16 14:38:07.418208 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 163/357] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:06 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1322 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:38:07.429698 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-25655014-0e55-4248-8eaf-b98b4233d080 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:07.431438 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-25655014-0e55-4248-8eaf-b98b4233d080 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:07.441749 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25655014-0e55-4248-8eaf-b98b4233d080 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:07.443397 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25655014-0e55-4248-8eaf-b98b4233d080 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:07.445233 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25655014-0e55-4248-8eaf-b98b4233d080 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:07.446021 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25655014-0e55-4248-8eaf-b98b4233d080 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:07.600431 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a749fe6f-83a3-4ebb-943c-3b2d06454a17 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1644 microversion: 2.1 time: 0.405863 Jun 16 14:38:07.602296 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 195/358] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:07 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1644 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:38:07.774772 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-819766822", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "f57fcde4-c3c0-449f-9871-02a5578b92d2"}]}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:07.905806 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] validate_networks() for [('f57fcde4-c3c0-449f-9871-02a5578b92d2', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:38:07.925332 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-25655014-0e55-4248-8eaf-b98b4233d080 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:07.933944 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-25655014-0e55-4248-8eaf-b98b4233d080 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 200 len: 1390 microversion: 2.1 time: 0.513275 Jun 16 14:38:07.936322 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 164/359] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:07 2022] GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 1390 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:08.440589 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a55c8a75-5143-47dd-bc35-0932b82ec613 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:08.442624 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a55c8a75-5143-47dd-bc35-0932b82ec613 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:08.454524 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a55c8a75-5143-47dd-bc35-0932b82ec613 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:08.456931 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a55c8a75-5143-47dd-bc35-0932b82ec613 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:08.458266 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a55c8a75-5143-47dd-bc35-0932b82ec613 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:08.459187 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a55c8a75-5143-47dd-bc35-0932b82ec613 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:09.419222 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:38:09.422945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:38:09.423456 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:38:09.423873 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:38:09.424293 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:38:09.477008 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:09.478012 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:09.479720 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:09.480507 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:09.519872 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Getting quotas for project b0484f4c1c304b84a88b7d2be3b9483c. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:38:09.523492 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a55c8a75-5143-47dd-bc35-0932b82ec613 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:09.540933 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a55c8a75-5143-47dd-bc35-0932b82ec613 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1322 microversion: 2.1 time: 1.104522 Jun 16 14:38:09.544215 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 165/360] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:08 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1322 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:09.545521 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Getting quotas for user 96fb5660c35642ad9da6d8bb34e393f4 and project b0484f4c1c304b84a88b7d2be3b9483c. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:38:09.556407 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-bb4946ac-6e71-4774-96c4-31fbda1b4400 req-b5246241-a936-4909-adfb-b55a66f7adb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b36c679-5452-4c35-ba4a-a19aa69e3fd8", "name": "network-vif-plugged", "status": "completed", "tag": "9f8be973-6750-49fd-8447-597286585736"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:09.583968 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-bb4946ac-6e71-4774-96c4-31fbda1b4400 req-b5246241-a936-4909-adfb-b55a66f7adb2 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:09.586486 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:38:09.587714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-bb4946ac-6e71-4774-96c4-31fbda1b4400 req-b5246241-a936-4909-adfb-b55a66f7adb2 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:09.596598 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:38:09.621317 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-bb4946ac-6e71-4774-96c4-31fbda1b4400 req-b5246241-a936-4909-adfb-b55a66f7adb2 service nova] Creating event network-vif-plugged:9f8be973-6750-49fd-8447-597286585736 for instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 on n-h1-836830-4 Jun 16 14:38:09.634986 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-bb4946ac-6e71-4774-96c4-31fbda1b4400 req-b5246241-a936-4909-adfb-b55a66f7adb2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089073 Jun 16 14:38:09.640359 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 166/361] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:09.648860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-eea5fcfd-65c8-43fe-8daa-dd674b81315e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:09.650169 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-eea5fcfd-65c8-43fe-8daa-dd674b81315e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:09.662901 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eea5fcfd-65c8-43fe-8daa-dd674b81315e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:09.663680 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eea5fcfd-65c8-43fe-8daa-dd674b81315e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:09.666864 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eea5fcfd-65c8-43fe-8daa-dd674b81315e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:09.667688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eea5fcfd-65c8-43fe-8daa-dd674b81315e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:09.782096 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2392f8e1-faf7-47c0-a9ee-ca67f5e98a48 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.011861 Jun 16 14:38:09.788197 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 196/362] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:38:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:38:09.801963 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a3e2f48d-ee89-417c-b850-13f0bdf7a1f2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:09.807511 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a3e2f48d-ee89-417c-b850-13f0bdf7a1f2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:10.065073 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a3e2f48d-ee89-417c-b850-13f0bdf7a1f2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:10.088398 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a3e2f48d-ee89-417c-b850-13f0bdf7a1f2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1210 microversion: 2.1 time: 0.290264 Jun 16 14:38:10.091664 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 197/363] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:09 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1210 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:38:10.573041 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5d43b9fe-5173-44df-b3b2-712443f5be1a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:10.574596 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5d43b9fe-5173-44df-b3b2-712443f5be1a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:10.592318 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5d43b9fe-5173-44df-b3b2-712443f5be1a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:10.595614 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5d43b9fe-5173-44df-b3b2-712443f5be1a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:10.596981 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5d43b9fe-5173-44df-b3b2-712443f5be1a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:10.598096 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5d43b9fe-5173-44df-b3b2-712443f5be1a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:10.935078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-eea5fcfd-65c8-43fe-8daa-dd674b81315e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:10.969758 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-eea5fcfd-65c8-43fe-8daa-dd674b81315e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 200 len: 1390 microversion: 2.1 time: 1.318341 Jun 16 14:38:10.982898 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 167/364] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:09 2022] GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 1390 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:11.121252 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0cecd133-4887-4f95-8ace-2ea1732c3acd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:11.122137 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0cecd133-4887-4f95-8ace-2ea1732c3acd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:11.163162 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0cecd133-4887-4f95-8ace-2ea1732c3acd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:11.163720 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0cecd133-4887-4f95-8ace-2ea1732c3acd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:11.165540 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0cecd133-4887-4f95-8ace-2ea1732c3acd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:11.167011 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0cecd133-4887-4f95-8ace-2ea1732c3acd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:11.190492 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5d43b9fe-5173-44df-b3b2-712443f5be1a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:11.224272 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5d43b9fe-5173-44df-b3b2-712443f5be1a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1322 microversion: 2.1 time: 0.649293 Jun 16 14:38:11.231649 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 198/365] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:10 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1322 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:38:11.349162 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0cecd133-4887-4f95-8ace-2ea1732c3acd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:11.386910 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0cecd133-4887-4f95-8ace-2ea1732c3acd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1206 microversion: 2.1 time: 0.278351 Jun 16 14:38:11.418336 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 168/366] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:11 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1206 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:12.004571 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-06b1f6cd-3f28-4620-ad3b-090f07b231d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:12.005918 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-06b1f6cd-3f28-4620-ad3b-090f07b231d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:12.051755 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06b1f6cd-3f28-4620-ad3b-090f07b231d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:12.052353 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06b1f6cd-3f28-4620-ad3b-090f07b231d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:12.053218 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06b1f6cd-3f28-4620-ad3b-090f07b231d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:12.053666 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06b1f6cd-3f28-4620-ad3b-090f07b231d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:12.247008 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-06c3e62e-93e6-4a0a-8ce8-dd90e749e125 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:12.248455 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-06c3e62e-93e6-4a0a-8ce8-dd90e749e125 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:12.260331 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06c3e62e-93e6-4a0a-8ce8-dd90e749e125 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:12.261058 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06c3e62e-93e6-4a0a-8ce8-dd90e749e125 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:12.262207 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06c3e62e-93e6-4a0a-8ce8-dd90e749e125 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:12.262941 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06c3e62e-93e6-4a0a-8ce8-dd90e749e125 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:12.653005 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-06c3e62e-93e6-4a0a-8ce8-dd90e749e125 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:12.711998 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-06c3e62e-93e6-4a0a-8ce8-dd90e749e125 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1322 microversion: 2.1 time: 0.469815 Jun 16 14:38:12.713373 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 169/367] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:12 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:38:12.731011 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fb61273b-6ac4-4c2a-904e-007803fe9d38 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:12.731885 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fb61273b-6ac4-4c2a-904e-007803fe9d38 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:12.744589 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb61273b-6ac4-4c2a-904e-007803fe9d38 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:12.745310 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb61273b-6ac4-4c2a-904e-007803fe9d38 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:12.746707 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb61273b-6ac4-4c2a-904e-007803fe9d38 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:12.747422 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb61273b-6ac4-4c2a-904e-007803fe9d38 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:12.753612 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-06b1f6cd-3f28-4620-ad3b-090f07b231d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:12.767127 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-06b1f6cd-3f28-4620-ad3b-090f07b231d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 200 len: 1589 microversion: 2.1 time: 0.768848 Jun 16 14:38:12.777899 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 199/368] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:11 2022] GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 1589 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:38:12.792202 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f92be4ea-1aa5-455a-8d49-ae2e0654ae92 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:12.793023 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f92be4ea-1aa5-455a-8d49-ae2e0654ae92 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:12.803365 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f92be4ea-1aa5-455a-8d49-ae2e0654ae92 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:12.804214 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f92be4ea-1aa5-455a-8d49-ae2e0654ae92 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:12.813500 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f92be4ea-1aa5-455a-8d49-ae2e0654ae92 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:12.814374 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f92be4ea-1aa5-455a-8d49-ae2e0654ae92 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:12.951879 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fb61273b-6ac4-4c2a-904e-007803fe9d38 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:12.965209 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fb61273b-6ac4-4c2a-904e-007803fe9d38 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1268 microversion: 2.1 time: 0.250227 Jun 16 14:38:12.967444 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 170/369] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:12 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1268 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:13.159648 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f92be4ea-1aa5-455a-8d49-ae2e0654ae92 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.371858 Jun 16 14:38:13.161688 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 200/370] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 16 14:38:12 2022] GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8/os-interface => generated 285 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:13.611231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-e331783c-4ebc-4d0b-b7ae-e17634b6c420 req-3df82b48-4251-4e07-9e7c-f5a1b1443235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f15993a1-48b8-4267-869d-8e98bf19cdaa", "name": "network-vif-plugged", "status": "completed", "tag": "ca1af4e3-3d7e-4f00-ba23-5993bdef5ea5"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:13.655903 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-e331783c-4ebc-4d0b-b7ae-e17634b6c420 req-3df82b48-4251-4e07-9e7c-f5a1b1443235 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:13.657199 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-e331783c-4ebc-4d0b-b7ae-e17634b6c420 req-3df82b48-4251-4e07-9e7c-f5a1b1443235 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:13.714555 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-e331783c-4ebc-4d0b-b7ae-e17634b6c420 req-3df82b48-4251-4e07-9e7c-f5a1b1443235 service nova] Creating event network-vif-plugged:ca1af4e3-3d7e-4f00-ba23-5993bdef5ea5 for instance f15993a1-48b8-4267-869d-8e98bf19cdaa on n-h1-836830-4 Jun 16 14:38:13.730239 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-e331783c-4ebc-4d0b-b7ae-e17634b6c420 req-3df82b48-4251-4e07-9e7c-f5a1b1443235 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125780 Jun 16 14:38:13.731887 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 171/371] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:13.747529 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-70f8273a-5d3b-42d1-83e5-fd6b7a0e268c tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:13.748283 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-70f8273a-5d3b-42d1-83e5-fd6b7a0e268c tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:13.780948 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-70f8273a-5d3b-42d1-83e5-fd6b7a0e268c tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:13.789201 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-70f8273a-5d3b-42d1-83e5-fd6b7a0e268c tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:13.790359 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-70f8273a-5d3b-42d1-83e5-fd6b7a0e268c tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:13.799520 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-70f8273a-5d3b-42d1-83e5-fd6b7a0e268c tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:13.997876 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f761ea13-f0ff-4285-a0aa-1971412beb9a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:14.004917 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f761ea13-f0ff-4285-a0aa-1971412beb9a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:14.026136 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f761ea13-f0ff-4285-a0aa-1971412beb9a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:14.027313 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f761ea13-f0ff-4285-a0aa-1971412beb9a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:14.029123 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f761ea13-f0ff-4285-a0aa-1971412beb9a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:14.030650 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f761ea13-f0ff-4285-a0aa-1971412beb9a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:14.423318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f761ea13-f0ff-4285-a0aa-1971412beb9a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:14.464626 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f761ea13-f0ff-4285-a0aa-1971412beb9a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1268 microversion: 2.1 time: 0.478690 Jun 16 14:38:14.479049 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 172/372] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:13 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1268 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:15.148273 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-70f8273a-5d3b-42d1-83e5-fd6b7a0e268c tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:15.159838 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-70f8273a-5d3b-42d1-83e5-fd6b7a0e268c tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1322 microversion: 2.1 time: 1.420291 Jun 16 14:38:15.161235 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 201/373] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:13 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1322 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:15.506301 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-379eac9a-afc1-4d9f-9b78-8c0f24c3e888 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:15.508629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-379eac9a-afc1-4d9f-9b78-8c0f24c3e888 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:15.534203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-379eac9a-afc1-4d9f-9b78-8c0f24c3e888 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:15.537264 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-379eac9a-afc1-4d9f-9b78-8c0f24c3e888 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:15.539597 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-379eac9a-afc1-4d9f-9b78-8c0f24c3e888 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:15.548793 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-379eac9a-afc1-4d9f-9b78-8c0f24c3e888 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:16.243184 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-379eac9a-afc1-4d9f-9b78-8c0f24c3e888 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:16.286053 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-379eac9a-afc1-4d9f-9b78-8c0f24c3e888 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1268 microversion: 2.1 time: 0.801805 Jun 16 14:38:16.287543 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 173/374] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:15 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1268 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:16.737037 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4b2d126d-cca5-4bb7-bb17-1a749d628428 tempest-AZAdminNegativeTestJSON-1005315845 tempest-AZAdminNegativeTestJSON-1005315845-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:16.740474 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:16.740474 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:16.743444 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4b2d126d-cca5-4bb7-bb17-1a749d628428 tempest-AZAdminNegativeTestJSON-1005315845 tempest-AZAdminNegativeTestJSON-1005315845-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'c7dbcf0e5c4843779bdbf4861b36d458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63d95a80f424320981a1b83d70cccc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4b2d126d-cca5-4bb7-bb17-1a749d628428 tempest-AZAdminNegativeTestJSON-1005315845 tempest-AZAdminNegativeTestJSON-1005315845-project] Request method failure captured: Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0BUGGwfcVI4JBWZXxZPUGq0WK1rnchuftMO0cft0fSdmYpPmNgY8LEX5Jz_t1VXEFYE4HY4wvzLoTZ4X0azKWnLnE03Zv2QMIZ-ebAUSmNy94B5n-FstQhu7F78VbvUiogAf_U_0VWtnZYNhr4YHle1ov-z9kRHvrpDtooH1ooRz_o Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: a63d95a80f424320981a1b83d70cccc7 Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1005315845 Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:38:16.751471 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:38:16.753099 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a63d95a80f424320981a1b83d70cccc7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a63d95a80f424320981a1b83d70cccc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a63d95a80f424320981a1b83d70cccc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a63d95a80f424320981a1b83d70cccc7"}]}] Jun 16 14:38:16.753099 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-AZAdminNegativeTestJSON-1005315845 Jun 16 14:38:16.753099 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: a63d95a80f424320981a1b83d70cccc7 Jun 16 14:38:16.753099 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1005315845 Jun 16 14:38:16.753099 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-AZAdminNegativeTestJSON-1005315845-project Jun 16 14:38:16.753099 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:16.753099 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:16.753099 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: c7dbcf0e5c4843779bdbf4861b36d458 Jun 16 14:38:16.753099 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-AZAdminNegativeTestJSON-1005315845-project Jun 16 14:38:16.753099 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:38:16.753099 n-d-836830-4 devstack@n-api.service[125863]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 16 14:38:16.753099 n-d-836830-4 devstack@n-api.service[125863]: action_args: {} Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:38:16.754136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 16 14:38:16.755631 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:16.759496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4b2d126d-cca5-4bb7-bb17-1a749d628428 tempest-AZAdminNegativeTestJSON-1005315845 tempest-AZAdminNegativeTestJSON-1005315845-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:16.762760 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4b2d126d-cca5-4bb7-bb17-1a749d628428 tempest-AZAdminNegativeTestJSON-1005315845 tempest-AZAdminNegativeTestJSON-1005315845-project] 10.222.0.57 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.132276 Jun 16 14:38:16.770525 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 202/375] 10.222.0.57 () {58 vars in 1184 bytes} [Thu Jun 16 14:38:15 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1142 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:16.782606 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0ef2cc50-4aeb-4aa9-bef4-b7db81a3a4c8 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:16.784792 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0ef2cc50-4aeb-4aa9-bef4-b7db81a3a4c8 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:16.802612 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0ef2cc50-4aeb-4aa9-bef4-b7db81a3a4c8 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:16.807106 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0ef2cc50-4aeb-4aa9-bef4-b7db81a3a4c8 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:16.810250 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0ef2cc50-4aeb-4aa9-bef4-b7db81a3a4c8 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:16.815258 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0ef2cc50-4aeb-4aa9-bef4-b7db81a3a4c8 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:17.098812 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0ef2cc50-4aeb-4aa9-bef4-b7db81a3a4c8 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:17.113980 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0ef2cc50-4aeb-4aa9-bef4-b7db81a3a4c8 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1472 microversion: 2.1 time: 0.341762 Jun 16 14:38:17.117420 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 203/376] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:16 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1472 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:17.283852 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-08db856e-cadc-47ac-a398-a25962e67c80 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1083425515", "ram": 512, "vcpus": 1, "disk": 10, "id": 687569494, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:17.286024 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:17.286024 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:17.323823 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-08db856e-cadc-47ac-a398-a25962e67c80 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 1.033284 Jun 16 14:38:17.328937 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 174/377] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:38:16 2022] POST /compute/v2.1/flavors => generated 413 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:17.342842 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-812e74e5-2e57-4b24-82f5-6a04f8e6a0f1 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:17.346093 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-812e74e5-2e57-4b24-82f5-6a04f8e6a0f1 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:17.366954 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-812e74e5-2e57-4b24-82f5-6a04f8e6a0f1 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:17.367577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-812e74e5-2e57-4b24-82f5-6a04f8e6a0f1 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:17.368433 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-812e74e5-2e57-4b24-82f5-6a04f8e6a0f1 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:17.370130 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-812e74e5-2e57-4b24-82f5-6a04f8e6a0f1 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:17.385468 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:17.862425 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-812e74e5-2e57-4b24-82f5-6a04f8e6a0f1 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:17.906024 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-812e74e5-2e57-4b24-82f5-6a04f8e6a0f1 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 200 len: 1589 microversion: 2.1 time: 0.570779 Jun 16 14:38:17.919836 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 175/378] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:17 2022] GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 1589 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:17.942870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-4d5fd231-006a-44db-bf3c-2284a89ae209 req-64b6181c-4b51-4f39-ae05-68fe43d7ed3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b36c679-5452-4c35-ba4a-a19aa69e3fd8", "tag": "9f8be973-6750-49fd-8447-597286585736"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:17.972351 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-4d5fd231-006a-44db-bf3c-2284a89ae209 req-64b6181c-4b51-4f39-ae05-68fe43d7ed3a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:17.976103 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-4d5fd231-006a-44db-bf3c-2284a89ae209 req-64b6181c-4b51-4f39-ae05-68fe43d7ed3a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:18.053575 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-4d5fd231-006a-44db-bf3c-2284a89ae209 req-64b6181c-4b51-4f39-ae05-68fe43d7ed3a service nova] Creating event network-changed:9f8be973-6750-49fd-8447-597286585736 for instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 on n-h1-836830-4 Jun 16 14:38:18.063654 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-4d5fd231-006a-44db-bf3c-2284a89ae209 req-64b6181c-4b51-4f39-ae05-68fe43d7ed3a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153313 Jun 16 14:38:18.070676 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 176/379] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:18.089961 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-145dac85-fc9f-4b19-aeb5-cdb2b0a284a8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:18.090276 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-145dac85-fc9f-4b19-aeb5-cdb2b0a284a8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:18.118860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-145dac85-fc9f-4b19-aeb5-cdb2b0a284a8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:18.131674 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-145dac85-fc9f-4b19-aeb5-cdb2b0a284a8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:18.133196 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-145dac85-fc9f-4b19-aeb5-cdb2b0a284a8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:18.134631 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-145dac85-fc9f-4b19-aeb5-cdb2b0a284a8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:18.563365 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fbbbac37-f5e1-4818-9fa1-f3bb3a1c9e9f tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:18.565864 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fbbbac37-f5e1-4818-9fa1-f3bb3a1c9e9f tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] [instance: c1e3bbff-ebb1-4c98-830f-988389fd196f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:18.591548 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-fbbbac37-f5e1-4818-9fa1-f3bb3a1c9e9f tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] HTTP exception thrown: Instance c1e3bbff-ebb1-4c98-830f-988389fd196f could not be found. Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fbbbac37-f5e1-4818-9fa1-f3bb3a1c9e9f tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Request method failure captured: Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/servers/c1e3bbff-ebb1-4c98-830f-988389fd196f/action HTTP/1.1 Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 15 Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0A767KNhSJc6uXyQRNaCL2BkqH3h6vPtR6Szn_44glO3vdfPKKsC7TUgrH8QMB9XfXY_W4BJVykKpOGlcaKtL8b5JcCxMHWwQumvrgfidVsHXtlqc6qogVTNn_XgFbPex2zJOkUEhTITKA1Z7MxH2ltVDxeM0IsfWNNz00wVc7aQ0o Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 4f1b33829bfe4961a70fd14fa3e78adf Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1462614927 Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:38:18.600090 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:38:18.601517 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f1b33829bfe4961a70fd14fa3e78adf", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f1b33829bfe4961a70fd14fa3e78adf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f1b33829bfe4961a70fd14fa3e78adf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f1b33829bfe4961a70fd14fa3e78adf"}]}] Jun 16 14:38:18.601517 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1462614927 Jun 16 14:38:18.601517 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 4f1b33829bfe4961a70fd14fa3e78adf Jun 16 14:38:18.601517 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1462614927 Jun 16 14:38:18.601517 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersAdminNegativeTestJSON-1462614927-project-admin Jun 16 14:38:18.601517 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:18.601517 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:18.601517 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 18caeaed4c2242efb0508548d8126a49 Jun 16 14:38:18.601517 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1462614927-project-admin Jun 16 14:38:18.601517 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:38:18.601517 n-d-836830-4 devstack@n-api.service[125863]: {"migrate": {}} Jun 16 14:38:18.601517 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:38:18.601517 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance c1e3bbff-ebb1-4c98-830f-988389fd196f could not be found. Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'c1e3bbff-ebb1-4c98-830f-988389fd196f', 'body': {'migrate': {}}} Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e3bbff-ebb1-4c98-830f-988389fd196f could not be found. Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:18.602517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e3bbff-ebb1-4c98-830f-988389fd196f could not be found. Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e3bbff-ebb1-4c98-830f-988389fd196f could not be found. Jun 16 14:38:18.603717 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:18.605150 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fbbbac37-f5e1-4818-9fa1-f3bb3a1c9e9f tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Returning 404 to user: Instance c1e3bbff-ebb1-4c98-830f-988389fd196f could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:18.605150 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fbbbac37-f5e1-4818-9fa1-f3bb3a1c9e9f tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/c1e3bbff-ebb1-4c98-830f-988389fd196f/action" status: 404 len: 111 microversion: 2.1 time: 1.467280 Jun 16 14:38:18.630885 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 204/380] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:38:17 2022] POST /compute/v2.1/servers/c1e3bbff-ebb1-4c98-830f-988389fd196f/action => generated 111 bytes in 1496 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:38:18.994909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-145dac85-fc9f-4b19-aeb5-cdb2b0a284a8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:19.005507 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-145dac85-fc9f-4b19-aeb5-cdb2b0a284a8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1310 microversion: 2.1 time: 0.932405 Jun 16 14:38:19.012101 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 177/381] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:18 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1310 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:19.034495 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-fe0b8d84-8a7d-4b94-a5bc-b222d537700f req-2028b978-fe7e-44b8-8bb4-2ea674632217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041bdae6-9e2f-4508-bd7b-51bcc2666b7f", "tag": "96b3e2f5-fedd-4636-8ce3-e8b768044f69"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:19.071655 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-fe0b8d84-8a7d-4b94-a5bc-b222d537700f req-2028b978-fe7e-44b8-8bb4-2ea674632217 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:19.077050 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-fe0b8d84-8a7d-4b94-a5bc-b222d537700f req-2028b978-fe7e-44b8-8bb4-2ea674632217 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:19.132956 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-fe0b8d84-8a7d-4b94-a5bc-b222d537700f req-2028b978-fe7e-44b8-8bb4-2ea674632217 service nova] Creating event network-changed:96b3e2f5-fedd-4636-8ce3-e8b768044f69 for instance 041bdae6-9e2f-4508-bd7b-51bcc2666b7f on n-h2-836830-4 Jun 16 14:38:19.143625 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-fe0b8d84-8a7d-4b94-a5bc-b222d537700f req-2028b978-fe7e-44b8-8bb4-2ea674632217 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129000 Jun 16 14:38:19.151496 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 178/382] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:19.499342 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=6 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:20.085056 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=8 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:20.328046 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2b939340-754c-4a4c-9a43-1b828d8314b3 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:20.373855 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-2b939340-754c-4a4c-9a43-1b828d8314b3 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] HTTP exception thrown: Flavor 687569494 has no extra specs with key hw:cpu_thread_policy. Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2b939340-754c-4a4c-9a43-1b828d8314b3 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] Request method failure captured: Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/flavors/687569494/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0BTEsVw9VPwLfHubbFfNvjoHNBoiTP1grP5Azj38_E-FR1pJt3-LJnytEanKawCzYeh2qj8NNNqH5G1LMwitSns7oEEUcQGDJrDyOOUSVPbinCx5wvsbpAOsIqvPQVgNDL4nGDhhpGp_EsFNYjAt_3nlpMo9Y9732G3omPmTbXcWmg Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 14343bd1ea724d63bfce2ba2f9d9d24a Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:38:20.393349 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:38:20.394751 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_14343bd1ea724d63bfce2ba2f9d9d24a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14343bd1ea724d63bfce2ba2f9d9d24a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14343bd1ea724d63bfce2ba2f9d9d24a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/14343bd1ea724d63bfce2ba2f9d9d24a"}]}] Jun 16 14:38:20.394751 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 Jun 16 14:38:20.394751 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 14343bd1ea724d63bfce2ba2f9d9d24a Jun 16 14:38:20.394751 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 Jun 16 14:38:20.394751 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project Jun 16 14:38:20.394751 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:20.394751 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:20.394751 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: a918d81871504dfb880728e3112420f6 Jun 16 14:38:20.394751 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project Jun 16 14:38:20.394751 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:38:20.394751 n-d-836830-4 devstack@n-api.service[125863]: exception: Flavor 687569494 has no extra specs with key hw:cpu_thread_policy. Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'flavor_id': '687569494', 'id': 'hw:cpu_thread_policy'} Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 687569494 has no extra specs with key hw:cpu_thread_policy. Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:20.395447 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:20.396793 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:20.396793 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:20.396793 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:20.396793 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:38:20.396793 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:38:20.396793 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 687569494 has no extra specs with key hw:cpu_thread_policy. Jun 16 14:38:20.396793 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:20.396793 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2b939340-754c-4a4c-9a43-1b828d8314b3 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] Returning 404 to user: Flavor 687569494 has no extra specs with key hw:cpu_thread_policy. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:20.402203 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2b939340-754c-4a4c-9a43-1b828d8314b3 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] 10.222.0.57 "GET /compute/v2.1/flavors/687569494/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 1.769018 Jun 16 14:38:20.402880 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 205/383] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jun 16 14:38:18 2022] GET /compute/v2.1/flavors/687569494/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 1771 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:20.428363 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-104949980", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:20.456141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d4fdc3f7-beb4-4a6d-b3e7-779fd31883d8 tempest-FlavorsV261TestJSON-219280434 tempest-FlavorsV261TestJSON-219280434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-717490196", "id": 1716792037, "os-flavor-access:is_public": "True"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:20.459203 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:20.459203 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:20.593393 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d4fdc3f7-beb4-4a6d-b3e7-779fd31883d8 tempest-FlavorsV261TestJSON-219280434 tempest-FlavorsV261TestJSON-219280434-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 1.439477 Jun 16 14:38:20.609567 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 179/384] 10.222.0.57 () {62 vars in 1187 bytes} [Thu Jun 16 14:38:19 2022] POST /compute/v2.1/flavors => generated 467 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:38:20.653382 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c3a3ffba-1400-4b62-94e8-f1584a58f093 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:20.655138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c3a3ffba-1400-4b62-94e8-f1584a58f093 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:20.690762 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:38:20.712018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c3a3ffba-1400-4b62-94e8-f1584a58f093 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:20.715465 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c3a3ffba-1400-4b62-94e8-f1584a58f093 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:20.719099 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c3a3ffba-1400-4b62-94e8-f1584a58f093 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:20.723895 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c3a3ffba-1400-4b62-94e8-f1584a58f093 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:21.511451 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c3a3ffba-1400-4b62-94e8-f1584a58f093 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:21.579347 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c3a3ffba-1400-4b62-94e8-f1584a58f093 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1310 microversion: 2.1 time: 0.964856 Jun 16 14:38:21.583686 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 180/385] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:20 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1310 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:21.621612 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8808643e-63d5-4be1-950a-a2d4ec674a6a tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:21.632901 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:21.632901 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:21.637514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8808643e-63d5-4be1-950a-a2d4ec674a6a tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'a918d81871504dfb880728e3112420f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14343bd1ea724d63bfce2ba2f9d9d24a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8808643e-63d5-4be1-950a-a2d4ec674a6a tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] Request method failure captured: Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/flavors/687569494/os-extra_specs HTTP/1.1 Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 66 Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0BTEsVw9VPwLfHubbFfNvjoHNBoiTP1grP5Azj38_E-FR1pJt3-LJnytEanKawCzYeh2qj8NNNqH5G1LMwitSns7oEEUcQGDJrDyOOUSVPbinCx5wvsbpAOsIqvPQVgNDL4nGDhhpGp_EsFNYjAt_3nlpMo9Y9732G3omPmTbXcWmg Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 14343bd1ea724d63bfce2ba2f9d9d24a Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:38:21.649568 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:38:21.652158 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_14343bd1ea724d63bfce2ba2f9d9d24a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14343bd1ea724d63bfce2ba2f9d9d24a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14343bd1ea724d63bfce2ba2f9d9d24a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/14343bd1ea724d63bfce2ba2f9d9d24a"}]}] Jun 16 14:38:21.652158 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 Jun 16 14:38:21.652158 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 14343bd1ea724d63bfce2ba2f9d9d24a Jun 16 14:38:21.652158 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 Jun 16 14:38:21.652158 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project Jun 16 14:38:21.652158 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:38:21.652158 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:38:21.652158 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: a918d81871504dfb880728e3112420f6 Jun 16 14:38:21.652158 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project Jun 16 14:38:21.652158 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:38:21.652158 n-d-836830-4 devstack@n-api.service[125862]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jun 16 14:38:21.652158 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'flavor_id': '687569494', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:38:21.653668 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 16 14:38:21.660698 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:21.666560 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8808643e-63d5-4be1-950a-a2d4ec674a6a tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:21.667869 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8808643e-63d5-4be1-950a-a2d4ec674a6a tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] 10.222.0.57 "POST /compute/v2.1/flavors/687569494/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.081955 Jun 16 14:38:21.669525 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 181/386] 10.222.0.57 () {60 vars in 1220 bytes} [Thu Jun 16 14:38:21 2022] POST /compute/v2.1/flavors/687569494/os-extra_specs => generated 124 bytes in 85 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:22.238079 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:38:22.239403 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:38:22.240038 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:38:22.240655 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:38:22.241300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:38:22.264684 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:22.265453 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:22.266294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4fc48d21-b0a3-4a27-b070-d3a175672bf9 tempest-FlavorsV261TestJSON-2014838247 tempest-FlavorsV261TestJSON-2014838247-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:22.268242 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:22.268709 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:22.318636 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4fc48d21-b0a3-4a27-b070-d3a175672bf9 tempest-FlavorsV261TestJSON-2014838247 tempest-FlavorsV261TestJSON-2014838247-project] 10.222.0.57 "GET /compute/v2.1/flavors/1716792037" status: 200 len: 467 microversion: 2.61 time: 0.632501 Jun 16 14:38:22.327995 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Getting quotas for project 8fe5a789f66b4837b0c4f5f0c68ff7b1. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:38:22.335343 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 182/387] 10.222.0.57 () {60 vars in 1198 bytes} [Thu Jun 16 14:38:21 2022] GET /compute/v2.1/flavors/1716792037 => generated 467 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:38:22.347554 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Getting quotas for user f88bdba610f44f86aafb6bd31222fbcd and project 8fe5a789f66b4837b0c4f5f0c68ff7b1. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:38:22.408587 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:38:22.410981 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:38:22.574610 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fa63ad82-1aeb-4722-bba0-7e885dffac48 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.166295 Jun 16 14:38:22.583158 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 206/388] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:38:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:38:22.589878 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-44be59e5-86b8-4d00-aff3-0949c9f71ee2 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:22.592220 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:22.592220 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:22.619690 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=3,nova_api:INSERT=7,nova_api:SAVEPOINT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:22.639472 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-44be59e5-86b8-4d00-aff3-0949c9f71ee2 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/687569494/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.052722 Jun 16 14:38:22.640761 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 207/389] 10.222.0.57 () {60 vars in 1220 bytes} [Thu Jun 16 14:38:22 2022] POST /compute/v2.1/flavors/687569494/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:38:22.660573 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6c5d5d05-f2c3-4c9a-b54c-cfb29604b5f2 tempest-FlavorsV261TestJSON-219280434 tempest-FlavorsV261TestJSON-219280434-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0ecac9d0>, body: {"flavor": {"description": "new"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:22.677745 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:22.677745 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:22.777686 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6c5d5d05-f2c3-4c9a-b54c-cfb29604b5f2 tempest-FlavorsV261TestJSON-219280434 tempest-FlavorsV261TestJSON-219280434-project-admin] 10.222.0.57 "PUT /compute/v2.1/flavors/1716792037" status: 200 len: 468 microversion: 2.61 time: 0.134616 Jun 16 14:38:22.786635 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 208/390] 10.222.0.57 () {62 vars in 1218 bytes} [Thu Jun 16 14:38:22 2022] PUT /compute/v2.1/flavors/1716792037 => generated 468 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:38:22.793273 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-15840150-1889-4b79-9108-952db168f2c9 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:22.794279 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-15840150-1889-4b79-9108-952db168f2c9 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:23.060069 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e95f746f-b940-49a3-a52c-6b2b504efd07 tempest-InstanceUsageAuditLogNegativeTestJSON-1102541821 tempest-InstanceUsageAuditLogNegativeTestJSON-1102541821-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:23.061632 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:23.061632 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:23.063451 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-e95f746f-b940-49a3-a52c-6b2b504efd07 tempest-InstanceUsageAuditLogNegativeTestJSON-1102541821 tempest-InstanceUsageAuditLogNegativeTestJSON-1102541821-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e95f746f-b940-49a3-a52c-6b2b504efd07 tempest-InstanceUsageAuditLogNegativeTestJSON-1102541821 tempest-InstanceUsageAuditLogNegativeTestJSON-1102541821-project-admin] Request method failure captured: Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0BcS8GQ5l-Xbxbi1ftwe_1_v_IAv5YC5WsY9FHZeJLWRe9dJrCQgn2JieWfdFDhaPjdF9HDEqN8k3NvxRb3blYU8OPUOnXo5igIEL_xLzj2HpP_d_GTaSG0UQYlzrasiHBWjEWygK-T-yl83VxaSpayJYjoX6HE9ZDC0FbudCekKW8 Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 7a3b7d354ac249a890b76968d0f3fbd9 Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1102541821 Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:38:23.082764 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:38:23.084259 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7a3b7d354ac249a890b76968d0f3fbd9", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7a3b7d354ac249a890b76968d0f3fbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7a3b7d354ac249a890b76968d0f3fbd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7a3b7d354ac249a890b76968d0f3fbd9"}]}] Jun 16 14:38:23.084259 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1102541821 Jun 16 14:38:23.084259 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 7a3b7d354ac249a890b76968d0f3fbd9 Jun 16 14:38:23.084259 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1102541821 Jun 16 14:38:23.084259 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1102541821-project-admin Jun 16 14:38:23.084259 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:38:23.084259 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:38:23.084259 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 4b2441abe1d24a0a876081c7f3a22f68 Jun 16 14:38:23.084259 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1102541821-project-admin Jun 16 14:38:23.084259 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:38:23.084259 n-d-836830-4 devstack@n-api.service[125862]: exception: Invalid timestamp for date invalid_time Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'invalid_time'} Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:23.085004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:23.086161 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jun 16 14:38:23.086161 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jun 16 14:38:23.086161 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jun 16 14:38:23.086161 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:23.086161 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:23.086161 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:23.086161 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:23.086161 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:23.086161 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:23.086161 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:38:23.086161 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:38:23.086161 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jun 16 14:38:23.086161 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:23.089355 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e95f746f-b940-49a3-a52c-6b2b504efd07 tempest-InstanceUsageAuditLogNegativeTestJSON-1102541821 tempest-InstanceUsageAuditLogNegativeTestJSON-1102541821-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:23.090533 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e95f746f-b940-49a3-a52c-6b2b504efd07 tempest-InstanceUsageAuditLogNegativeTestJSON-1102541821 tempest-InstanceUsageAuditLogNegativeTestJSON-1102541821-project-admin] 10.222.0.57 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.753608 Jun 16 14:38:23.097208 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 183/391] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jun 16 14:38:22 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 761 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:38:23.111668 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8fec5f9f-70ea-45c7-9465-8aa1c6a6f6ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:23.112755 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8fec5f9f-70ea-45c7-9465-8aa1c6a6f6ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:23.143467 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-15840150-1889-4b79-9108-952db168f2c9 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:23.168513 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-15840150-1889-4b79-9108-952db168f2c9 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1221 microversion: 2.1 time: 0.371084 Jun 16 14:38:23.170160 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8fec5f9f-70ea-45c7-9465-8aa1c6a6f6ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:23.176683 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 209/392] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:22 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1221 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:23.180728 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8fec5f9f-70ea-45c7-9465-8aa1c6a6f6ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:23.181733 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8fec5f9f-70ea-45c7-9465-8aa1c6a6f6ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:23.182200 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8fec5f9f-70ea-45c7-9465-8aa1c6a6f6ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:23.193484 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e7196d22-4c96-4d45-9370-272ae445344f tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:23.198739 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:23.198739 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:23.208589 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e7196d22-4c96-4d45-9370-272ae445344f tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'a918d81871504dfb880728e3112420f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14343bd1ea724d63bfce2ba2f9d9d24a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e7196d22-4c96-4d45-9370-272ae445344f tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] Request method failure captured: Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/flavors/687569494/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0BTEsVw9VPwLfHubbFfNvjoHNBoiTP1grP5Azj38_E-FR1pJt3-LJnytEanKawCzYeh2qj8NNNqH5G1LMwitSns7oEEUcQGDJrDyOOUSVPbinCx5wvsbpAOsIqvPQVgNDL4nGDhhpGp_EsFNYjAt_3nlpMo9Y9732G3omPmTbXcWmg Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 14343bd1ea724d63bfce2ba2f9d9d24a Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:38:23.217970 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:38:23.219561 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_14343bd1ea724d63bfce2ba2f9d9d24a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14343bd1ea724d63bfce2ba2f9d9d24a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14343bd1ea724d63bfce2ba2f9d9d24a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/14343bd1ea724d63bfce2ba2f9d9d24a"}]}] Jun 16 14:38:23.219561 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 Jun 16 14:38:23.219561 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 14343bd1ea724d63bfce2ba2f9d9d24a Jun 16 14:38:23.219561 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 Jun 16 14:38:23.219561 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project Jun 16 14:38:23.219561 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:23.219561 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:23.219561 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: a918d81871504dfb880728e3112420f6 Jun 16 14:38:23.219561 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project Jun 16 14:38:23.219561 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:38:23.219561 n-d-836830-4 devstack@n-api.service[125863]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'flavor_id': '687569494', 'id': 'hw:numa_nodes'} Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:38:23.220569 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 16 14:38:23.221692 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:23.225788 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e7196d22-4c96-4d45-9370-272ae445344f tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:23.232774 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e7196d22-4c96-4d45-9370-272ae445344f tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] 10.222.0.57 "DELETE /compute/v2.1/flavors/687569494/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.054614 Jun 16 14:38:23.240446 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 210/393] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 16 14:38:23 2022] DELETE /compute/v2.1/flavors/687569494/os-extra_specs/hw:numa_nodes => generated 124 bytes in 63 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:23.276506 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a3983c03-f366-4c2f-b258-424f8e1c016f tempest-FlavorsV261TestJSON-2014838247 tempest-FlavorsV261TestJSON-2014838247-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:23.421990 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a3983c03-f366-4c2f-b258-424f8e1c016f tempest-FlavorsV261TestJSON-2014838247 tempest-FlavorsV261TestJSON-2014838247-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 7647 microversion: 2.61 time: 0.177687 Jun 16 14:38:23.425010 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 211/394] 10.222.0.57 () {60 vars in 1186 bytes} [Thu Jun 16 14:38:23 2022] GET /compute/v2.1/flavors/detail => generated 7647 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:38:24.169009 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8fec5f9f-70ea-45c7-9465-8aa1c6a6f6ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:24.180912 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-23f20244-8a2e-45ff-832f-af5eaa9fa9cb tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:24.183655 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:24.183655 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:24.188556 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-23f20244-8a2e-45ff-832f-af5eaa9fa9cb tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '698d13d57de54f1689c0e6460c1a58bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e845798d0ce54496adba03e434ad9847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-23f20244-8a2e-45ff-832f-af5eaa9fa9cb tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591-project] Request method failure captured: Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0BXyAq9bcq0sehP-ZFzd7ZkvrXGOSF4Rv6gkvNBRZjnTGxitUPsvod8R_35_5haa-ow7JJ2Wap6GyT0PxTtF2WeZm2J2yOihcJ1vkNBSbZL_ifdTYyRfkT_N_WEppHD86keEWByjNKs1WT_Pi8HX90bziGKzBuqEJ0mmSURvxBt7GU Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: e845798d0ce54496adba03e434ad9847 Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:38:24.197543 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:38:24.200395 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e845798d0ce54496adba03e434ad9847", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e845798d0ce54496adba03e434ad9847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e845798d0ce54496adba03e434ad9847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e845798d0ce54496adba03e434ad9847"}]}] Jun 16 14:38:24.200395 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 Jun 16 14:38:24.200395 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: e845798d0ce54496adba03e434ad9847 Jun 16 14:38:24.200395 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 Jun 16 14:38:24.200395 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591-project Jun 16 14:38:24.200395 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:24.200395 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:24.200395 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 698d13d57de54f1689c0e6460c1a58bc Jun 16 14:38:24.200395 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591-project Jun 16 14:38:24.200395 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:38:24.200395 n-d-836830-4 devstack@n-api.service[125863]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: action_args: {} Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:38:24.201830 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 16 14:38:24.204932 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.211464 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8fec5f9f-70ea-45c7-9465-8aa1c6a6f6ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1310 microversion: 2.1 time: 1.106128 Jun 16 14:38:24.211632 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-23f20244-8a2e-45ff-832f-af5eaa9fa9cb tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:24.211632 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-23f20244-8a2e-45ff-832f-af5eaa9fa9cb tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591-project] 10.222.0.57 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.783876 Jun 16 14:38:24.217705 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 184/395] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:23 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1310 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:24.218828 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 212/396] 10.222.0.57 () {58 vars in 1184 bytes} [Thu Jun 16 14:38:23 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 793 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:24.225279 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-64778315-9068-4f20-af9e-9aa04b2a739f tempest-FlavorsV261TestJSON-2014838247 tempest-FlavorsV261TestJSON-2014838247-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:24.240886 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-41d6b7f7-1652-4d80-aa51-71b2b8dd77f1 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:24.244342 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:24.244342 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:24.367200 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-64778315-9068-4f20-af9e-9aa04b2a739f tempest-FlavorsV261TestJSON-2014838247 tempest-FlavorsV261TestJSON-2014838247-project] 10.222.0.57 "GET /compute/v2.1/flavors" status: 200 len: 3934 microversion: 2.61 time: 0.146294 Jun 16 14:38:24.392531 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 213/397] 10.222.0.57 () {60 vars in 1165 bytes} [Thu Jun 16 14:38:24 2022] GET /compute/v2.1/flavors => generated 3934 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:38:24.397895 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f019085f-7dd1-4cde-bd48-bf0b4ce19f0e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:24.398536 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-41d6b7f7-1652-4d80-aa51-71b2b8dd77f1 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/687569494/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.173473 Jun 16 14:38:24.399378 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 185/398] 10.222.0.57 () {60 vars in 1220 bytes} [Thu Jun 16 14:38:24 2022] POST /compute/v2.1/flavors/687569494/os-extra_specs => generated 66 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:38:24.404944 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f019085f-7dd1-4cde-bd48-bf0b4ce19f0e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:24.418028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-45c6cd60-f383-4210-be4d-d022dc036b53 tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:24.418948 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:24.418948 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:24.450963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-45c6cd60-f383-4210-be4d-d022dc036b53 tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '698d13d57de54f1689c0e6460c1a58bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e845798d0ce54496adba03e434ad9847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-45c6cd60-f383-4210-be4d-d022dc036b53 tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591-project] Request method failure captured: Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-06-16%2014:38:24 HTTP/1.1 Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0BXyAq9bcq0sehP-ZFzd7ZkvrXGOSF4Rv6gkvNBRZjnTGxitUPsvod8R_35_5haa-ow7JJ2Wap6GyT0PxTtF2WeZm2J2yOihcJ1vkNBSbZL_ifdTYyRfkT_N_WEppHD86keEWByjNKs1WT_Pi8HX90bziGKzBuqEJ0mmSURvxBt7GU Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: e845798d0ce54496adba03e434ad9847 Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:38:24.456441 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:38:24.457694 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e845798d0ce54496adba03e434ad9847", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e845798d0ce54496adba03e434ad9847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e845798d0ce54496adba03e434ad9847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e845798d0ce54496adba03e434ad9847"}]}] Jun 16 14:38:24.457694 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 Jun 16 14:38:24.457694 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: e845798d0ce54496adba03e434ad9847 Jun 16 14:38:24.457694 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 Jun 16 14:38:24.457694 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591-project Jun 16 14:38:24.457694 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:38:24.457694 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:38:24.457694 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 698d13d57de54f1689c0e6460c1a58bc Jun 16 14:38:24.457694 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591-project Jun 16 14:38:24.457694 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:38:24.457694 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '2022-06-16 14:38:24'} Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:38:24.458345 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.459705 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-45c6cd60-f383-4210-be4d-d022dc036b53 tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:24.462977 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-45c6cd60-f383-4210-be4d-d022dc036b53 tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591 tempest-InstanceUsageAuditLogNegativeTestJSON-1623000591-project] 10.222.0.57 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-16 14:38:24" status: 403 len: 128 microversion: 2.1 time: 0.057276 Jun 16 14:38:24.471948 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f019085f-7dd1-4cde-bd48-bf0b4ce19f0e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:24.472827 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f019085f-7dd1-4cde-bd48-bf0b4ce19f0e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:24.474745 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 186/399] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jun 16 14:38:24 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-16%2014%3A38%3A24 => generated 128 bytes in 74 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:24.484536 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f019085f-7dd1-4cde-bd48-bf0b4ce19f0e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:24.494833 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f019085f-7dd1-4cde-bd48-bf0b4ce19f0e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:24.511164 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-88406670-fec9-4e2d-aff5-3775f12e13f0 tempest-FlavorsV261TestJSON-219280434 tempest-FlavorsV261TestJSON-219280434-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:24.512404 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:24.512404 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:24.546299 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:24.562071 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-88406670-fec9-4e2d-aff5-3775f12e13f0 tempest-FlavorsV261TestJSON-219280434 tempest-FlavorsV261TestJSON-219280434-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1716792037" status: 202 len: 0 microversion: 2.61 time: 0.085671 Jun 16 14:38:24.564934 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 187/400] 10.222.0.57 () {60 vars in 1201 bytes} [Thu Jun 16 14:38:24 2022] DELETE /compute/v2.1/flavors/1716792037 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:38:24.598477 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b44f9a32-ddd8-4bcb-9160-1e0161e5412d tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:24.616263 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:24.616263 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:24.623534 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b44f9a32-ddd8-4bcb-9160-1e0161e5412d tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'a918d81871504dfb880728e3112420f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14343bd1ea724d63bfce2ba2f9d9d24a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b44f9a32-ddd8-4bcb-9160-1e0161e5412d tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] Request method failure captured: Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: request: PUT /compute/v2.1/flavors/687569494/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 22 Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0BTEsVw9VPwLfHubbFfNvjoHNBoiTP1grP5Azj38_E-FR1pJt3-LJnytEanKawCzYeh2qj8NNNqH5G1LMwitSns7oEEUcQGDJrDyOOUSVPbinCx5wvsbpAOsIqvPQVgNDL4nGDhhpGp_EsFNYjAt_3nlpMo9Y9732G3omPmTbXcWmg Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 14343bd1ea724d63bfce2ba2f9d9d24a Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:38:24.629070 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:38:24.630365 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_14343bd1ea724d63bfce2ba2f9d9d24a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14343bd1ea724d63bfce2ba2f9d9d24a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/14343bd1ea724d63bfce2ba2f9d9d24a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/14343bd1ea724d63bfce2ba2f9d9d24a"}]}] Jun 16 14:38:24.630365 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 Jun 16 14:38:24.630365 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 14343bd1ea724d63bfce2ba2f9d9d24a Jun 16 14:38:24.630365 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 Jun 16 14:38:24.630365 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project Jun 16 14:38:24.630365 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:38:24.630365 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:38:24.630365 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: a918d81871504dfb880728e3112420f6 Jun 16 14:38:24.630365 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project Jun 16 14:38:24.630365 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:38:24.630365 n-d-836830-4 devstack@n-api.service[125862]: {"hw:numa_nodes": "1"} Jun 16 14:38:24.630365 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:38:24.630365 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'flavor_id': '687569494', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:38:24.631211 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 16 14:38:24.632243 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.649092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b44f9a32-ddd8-4bcb-9160-1e0161e5412d tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:24.655506 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b44f9a32-ddd8-4bcb-9160-1e0161e5412d tempest-FlavorsExtraSpecsNegativeTestJSON-812712498 tempest-FlavorsExtraSpecsNegativeTestJSON-812712498-project] 10.222.0.57 "PUT /compute/v2.1/flavors/687569494/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.088662 Jun 16 14:38:24.677033 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 188/401] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jun 16 14:38:24 2022] PUT /compute/v2.1/flavors/687569494/os-extra_specs/hw:numa_nodes => generated 124 bytes in 104 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:24.694745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-345a41b5-6b49-4821-91d1-8c11f3601659 tempest-FlavorsV261TestJSON-219280434 tempest-FlavorsV261TestJSON-219280434-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:24.811355 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-345a41b5-6b49-4821-91d1-8c11f3601659 tempest-FlavorsV261TestJSON-219280434 tempest-FlavorsV261TestJSON-219280434-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 7189 microversion: 2.61 time: 0.132643 Jun 16 14:38:24.831104 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 189/402] 10.222.0.57 () {60 vars in 1186 bytes} [Thu Jun 16 14:38:24 2022] GET /compute/v2.1/flavors/detail => generated 7189 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:38:24.872244 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5c4e5cfc-03c8-49a2-a191-9bbceefa2cfd tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:24.874317 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:24.874317 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:24.912807 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-5c4e5cfc-03c8-49a2-a191-9bbceefa2cfd tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] HTTP exception thrown: Flavor 687569494 has no extra specs with key hw:cpu_thread_policy. Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5c4e5cfc-03c8-49a2-a191-9bbceefa2cfd tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] Request method failure captured: Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/flavors/687569494/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0BXdmG8OViJUFCmaTT8WbFhDCT5ilnhr0Xaks5uVVToPFfS-XuIp5LKa3qiXfJXdz64qOxGvWaxs44o9UeTK8XTi_bzK9DOv_Yc7FEtqfDaE_Erg5n1TUKXd8_WmVpHGfNgtjU57rGJ5O_5xO6Vz9JggitIy3PF3sw6CsUQYjilSpA Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 5786d1af09c04ffc8b366992a0450a2c Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:38:24.916689 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:38:24.918361 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5786d1af09c04ffc8b366992a0450a2c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5786d1af09c04ffc8b366992a0450a2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5786d1af09c04ffc8b366992a0450a2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5786d1af09c04ffc8b366992a0450a2c"}]}] Jun 16 14:38:24.918361 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 Jun 16 14:38:24.918361 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 5786d1af09c04ffc8b366992a0450a2c Jun 16 14:38:24.918361 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 Jun 16 14:38:24.918361 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin Jun 16 14:38:24.918361 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:38:24.918361 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:38:24.918361 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 6ce2926ae67d44eaac10e57ade064b11 Jun 16 14:38:24.918361 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin Jun 16 14:38:24.918361 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:38:24.918361 n-d-836830-4 devstack@n-api.service[125862]: exception: Flavor 687569494 has no extra specs with key hw:cpu_thread_policy. Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'flavor_id': '687569494', 'id': 'hw:cpu_thread_policy'} Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 687569494 has no extra specs with key hw:cpu_thread_policy. Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:24.919313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.920847 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:24.920847 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:24.920847 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:24.920847 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:38:24.920847 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:38:24.920847 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 687569494 has no extra specs with key hw:cpu_thread_policy. Jun 16 14:38:24.920847 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.925331 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5c4e5cfc-03c8-49a2-a191-9bbceefa2cfd tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] Returning 404 to user: Flavor 687569494 has no extra specs with key hw:cpu_thread_policy. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:24.927014 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5c4e5cfc-03c8-49a2-a191-9bbceefa2cfd tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/687569494/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.087135 Jun 16 14:38:24.937326 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 190/403] 10.222.0.57 () {58 vars in 1265 bytes} [Thu Jun 16 14:38:24 2022] DELETE /compute/v2.1/flavors/687569494/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:24.943505 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f019085f-7dd1-4cde-bd48-bf0b4ce19f0e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:24.957546 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-35718fc5-64ad-452a-a539-fc7146cf9db5 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:24.971782 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f019085f-7dd1-4cde-bd48-bf0b4ce19f0e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1225 microversion: 2.1 time: 0.573552 Jun 16 14:38:24.977845 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-35718fc5-64ad-452a-a539-fc7146cf9db5 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] HTTP exception thrown: Request body and URI mismatch Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-35718fc5-64ad-452a-a539-fc7146cf9db5 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] Request method failure captured: Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: request: PUT /compute/v2.1/flavors/687569494/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 27 Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0BXdmG8OViJUFCmaTT8WbFhDCT5ilnhr0Xaks5uVVToPFfS-XuIp5LKa3qiXfJXdz64qOxGvWaxs44o9UeTK8XTi_bzK9DOv_Yc7FEtqfDaE_Erg5n1TUKXd8_WmVpHGfNgtjU57rGJ5O_5xO6Vz9JggitIy3PF3sw6CsUQYjilSpA Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 5786d1af09c04ffc8b366992a0450a2c Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:38:24.983928 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:38:24.986535 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5786d1af09c04ffc8b366992a0450a2c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5786d1af09c04ffc8b366992a0450a2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5786d1af09c04ffc8b366992a0450a2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5786d1af09c04ffc8b366992a0450a2c"}]}] Jun 16 14:38:24.986535 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 Jun 16 14:38:24.986535 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 5786d1af09c04ffc8b366992a0450a2c Jun 16 14:38:24.986535 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 Jun 16 14:38:24.986535 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin Jun 16 14:38:24.986535 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:38:24.986535 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:38:24.986535 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 6ce2926ae67d44eaac10e57ade064b11 Jun 16 14:38:24.986535 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin Jun 16 14:38:24.986535 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:38:24.986535 n-d-836830-4 devstack@n-api.service[125862]: {"hw:cpu_policy": "shared"} Jun 16 14:38:24.986535 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:38:24.986535 n-d-836830-4 devstack@n-api.service[125862]: exception: Request body and URI mismatch Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'flavor_id': '687569494', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:24.987576 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:24.988997 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:38:24.988997 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:38:24.988997 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jun 16 14:38:24.988997 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:24.989294 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 214/404] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:24 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1225 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:24.991221 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-35718fc5-64ad-452a-a539-fc7146cf9db5 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:24.993288 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-35718fc5-64ad-452a-a539-fc7146cf9db5 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] 10.222.0.57 "PUT /compute/v2.1/flavors/687569494/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.053262 Jun 16 14:38:24.996750 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 191/405] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jun 16 14:38:24 2022] PUT /compute/v2.1/flavors/687569494/os-extra_specs/hw:numa_nodes => generated 73 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:38:25.010626 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ad13c0e9-b5d5-4ced-9429-88cb89957ee8 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ad13c0e9-b5d5-4ced-9429-88cb89957ee8 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] Request method failure captured: Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: request: PUT /compute/v2.1/flavors/687569494/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 49 Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0BXdmG8OViJUFCmaTT8WbFhDCT5ilnhr0Xaks5uVVToPFfS-XuIp5LKa3qiXfJXdz64qOxGvWaxs44o9UeTK8XTi_bzK9DOv_Yc7FEtqfDaE_Erg5n1TUKXd8_WmVpHGfNgtjU57rGJ5O_5xO6Vz9JggitIy3PF3sw6CsUQYjilSpA Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 5786d1af09c04ffc8b366992a0450a2c Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:38:25.030996 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:38:25.033866 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5786d1af09c04ffc8b366992a0450a2c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5786d1af09c04ffc8b366992a0450a2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5786d1af09c04ffc8b366992a0450a2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5786d1af09c04ffc8b366992a0450a2c"}]}] Jun 16 14:38:25.033866 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 Jun 16 14:38:25.033866 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 5786d1af09c04ffc8b366992a0450a2c Jun 16 14:38:25.033866 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 Jun 16 14:38:25.033866 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin Jun 16 14:38:25.033866 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:25.033866 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:25.033866 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 6ce2926ae67d44eaac10e57ade064b11 Jun 16 14:38:25.033866 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin Jun 16 14:38:25.033866 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:38:25.033866 n-d-836830-4 devstack@n-api.service[125863]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jun 16 14:38:25.033866 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'flavor_id': '687569494', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'type': ['string', Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'number']}}, Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi On instance: Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jun 16 14:38:25.034931 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:25.036723 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:25.038217 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:25.038217 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:25.038217 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:38:25.038217 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:38:25.038217 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 16 14:38:25.038217 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:25.044647 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ad13c0e9-b5d5-4ced-9429-88cb89957ee8 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:25.047227 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ad13c0e9-b5d5-4ced-9429-88cb89957ee8 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] 10.222.0.57 "PUT /compute/v2.1/flavors/687569494/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.042897 Jun 16 14:38:25.053893 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 215/406] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jun 16 14:38:25 2022] PUT /compute/v2.1/flavors/687569494/os-extra_specs/hw:numa_nodes => generated 117 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:38:25.062927 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-334292cc-2669-4ea1-bc5b-0f24c6344744 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:25.141129 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-334292cc-2669-4ea1-bc5b-0f24c6344744 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/687569494" status: 202 len: 0 microversion: 2.1 time: 0.083696 Jun 16 14:38:25.145722 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 192/407] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:38:25 2022] DELETE /compute/v2.1/flavors/687569494 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 14:38:25.153328 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9b7ea260-0baf-45ac-add8-8b5a7b45c3ea tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:25.224913 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9b7ea260-0baf-45ac-add8-8b5a7b45c3ea tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742 tempest-FlavorsExtraSpecsNegativeTestJSON-1765997742-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.076505 Jun 16 14:38:25.236923 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 216/408] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:38:25 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:25.245852 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-78cde414-a8c3-4927-9277-71f440caf695 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:25.247420 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-78cde414-a8c3-4927-9277-71f440caf695 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:25.254504 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78cde414-a8c3-4927-9277-71f440caf695 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:25.256747 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78cde414-a8c3-4927-9277-71f440caf695 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:25.259026 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78cde414-a8c3-4927-9277-71f440caf695 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:25.266744 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78cde414-a8c3-4927-9277-71f440caf695 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:25.858938 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-78cde414-a8c3-4927-9277-71f440caf695 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:25.900875 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-78cde414-a8c3-4927-9277-71f440caf695 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1310 microversion: 2.1 time: 0.659384 Jun 16 14:38:25.919620 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 193/409] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:25 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1310 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:26.002528 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-66203c02-6f87-44f9-9e03-729216b3bc94 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:26.003428 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-66203c02-6f87-44f9-9e03-729216b3bc94 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:26.039596 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-66203c02-6f87-44f9-9e03-729216b3bc94 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:26.040198 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-66203c02-6f87-44f9-9e03-729216b3bc94 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:26.043245 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-66203c02-6f87-44f9-9e03-729216b3bc94 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:26.047024 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-66203c02-6f87-44f9-9e03-729216b3bc94 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:26.304200 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-66203c02-6f87-44f9-9e03-729216b3bc94 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:26.320259 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-66203c02-6f87-44f9-9e03-729216b3bc94 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1279 microversion: 2.1 time: 0.323143 Jun 16 14:38:26.331256 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 217/410] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:25 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1279 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:26.343803 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-d0fde76f-fe71-41f2-83cc-f6c38f6fee4f req-3a5fea41-ea07-40c9-b1ad-b1cdb917974d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041bdae6-9e2f-4508-bd7b-51bcc2666b7f", "name": "network-vif-plugged", "status": "completed", "tag": "96b3e2f5-fedd-4636-8ce3-e8b768044f69"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:26.360145 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-d0fde76f-fe71-41f2-83cc-f6c38f6fee4f req-3a5fea41-ea07-40c9-b1ad-b1cdb917974d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:26.360755 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-d0fde76f-fe71-41f2-83cc-f6c38f6fee4f req-3a5fea41-ea07-40c9-b1ad-b1cdb917974d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:26.383393 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-d0fde76f-fe71-41f2-83cc-f6c38f6fee4f req-3a5fea41-ea07-40c9-b1ad-b1cdb917974d service nova] Creating event network-vif-plugged:96b3e2f5-fedd-4636-8ce3-e8b768044f69 for instance 041bdae6-9e2f-4508-bd7b-51bcc2666b7f on n-h2-836830-4 Jun 16 14:38:26.410857 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-d0fde76f-fe71-41f2-83cc-f6c38f6fee4f req-3a5fea41-ea07-40c9-b1ad-b1cdb917974d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072051 Jun 16 14:38:26.414983 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 194/411] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:26.927835 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a7508f16-2663-4edd-b830-7b84551c12d3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:26.928984 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a7508f16-2663-4edd-b830-7b84551c12d3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:26.943683 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7508f16-2663-4edd-b830-7b84551c12d3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:26.946750 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7508f16-2663-4edd-b830-7b84551c12d3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:26.949561 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7508f16-2663-4edd-b830-7b84551c12d3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:26.953266 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7508f16-2663-4edd-b830-7b84551c12d3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:27.345267 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-513b472d-8c6a-4c72-bb05-186622786c7a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:27.346260 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-513b472d-8c6a-4c72-bb05-186622786c7a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:27.360853 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-513b472d-8c6a-4c72-bb05-186622786c7a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:27.366169 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-513b472d-8c6a-4c72-bb05-186622786c7a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:27.367513 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-513b472d-8c6a-4c72-bb05-186622786c7a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:27.370826 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-513b472d-8c6a-4c72-bb05-186622786c7a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:27.420008 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a7508f16-2663-4edd-b830-7b84551c12d3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:27.432088 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a7508f16-2663-4edd-b830-7b84551c12d3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1310 microversion: 2.1 time: 0.509254 Jun 16 14:38:27.440328 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 218/412] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:26 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1310 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:27.690179 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-513b472d-8c6a-4c72-bb05-186622786c7a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:27.702533 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-513b472d-8c6a-4c72-bb05-186622786c7a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1279 microversion: 2.1 time: 0.362260 Jun 16 14:38:27.712092 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 195/413] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:27 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1279 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:28.462066 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b913f691-e508-4b43-a6ce-5325eaac298e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:28.465107 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b913f691-e508-4b43-a6ce-5325eaac298e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:28.496682 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b913f691-e508-4b43-a6ce-5325eaac298e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:28.499812 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b913f691-e508-4b43-a6ce-5325eaac298e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:28.509163 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b913f691-e508-4b43-a6ce-5325eaac298e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:28.509989 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b913f691-e508-4b43-a6ce-5325eaac298e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:28.591345 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:28.733542 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-948ccb9c-c00f-42e9-84bf-2cdba2601382 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:28.739713 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-948ccb9c-c00f-42e9-84bf-2cdba2601382 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:28.778931 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-948ccb9c-c00f-42e9-84bf-2cdba2601382 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:28.789398 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-948ccb9c-c00f-42e9-84bf-2cdba2601382 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:28.799713 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-948ccb9c-c00f-42e9-84bf-2cdba2601382 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:28.804883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-948ccb9c-c00f-42e9-84bf-2cdba2601382 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:28.977457 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b913f691-e508-4b43-a6ce-5325eaac298e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:28.998195 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b913f691-e508-4b43-a6ce-5325eaac298e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1494 microversion: 2.1 time: 0.544938 Jun 16 14:38:28.999947 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 219/414] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:28 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1494 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:29.026887 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fb40d2cb-bfea-43c5-880e-e95f724b604d tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:29.030957 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fb40d2cb-bfea-43c5-880e-e95f724b604d tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:29.069140 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fb40d2cb-bfea-43c5-880e-e95f724b604d tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:29.070170 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fb40d2cb-bfea-43c5-880e-e95f724b604d tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:29.075861 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fb40d2cb-bfea-43c5-880e-e95f724b604d tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:29.076691 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fb40d2cb-bfea-43c5-880e-e95f724b604d tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:29.410170 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fb40d2cb-bfea-43c5-880e-e95f724b604d tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1645 microversion: 2.1 time: 0.397382 Jun 16 14:38:29.419143 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 220/415] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:29 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1645 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:38:29.435837 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4454c322-32e6-4897-9429-bd572614f968 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:29.437169 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4454c322-32e6-4897-9429-bd572614f968 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:29.452038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-948ccb9c-c00f-42e9-84bf-2cdba2601382 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:29.458713 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4454c322-32e6-4897-9429-bd572614f968 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:29.461368 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4454c322-32e6-4897-9429-bd572614f968 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:29.462801 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4454c322-32e6-4897-9429-bd572614f968 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:29.464296 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4454c322-32e6-4897-9429-bd572614f968 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:29.497344 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-948ccb9c-c00f-42e9-84bf-2cdba2601382 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1321 microversion: 2.1 time: 0.769104 Jun 16 14:38:29.505755 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 196/416] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:28 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1321 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:30.212613 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4454c322-32e6-4897-9429-bd572614f968 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1645 microversion: 2.1 time: 0.786924 Jun 16 14:38:30.213510 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 221/417] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:29 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1645 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:30.256754 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3145b7d5-7026-4065-b12c-914cf3833cf4 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:30.258176 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:30.258176 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:30.259606 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3145b7d5-7026-4065-b12c-914cf3833cf4 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:30.260064 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3145b7d5-7026-4065-b12c-914cf3833cf4 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:30.260880 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3145b7d5-7026-4065-b12c-914cf3833cf4 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:30.261319 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3145b7d5-7026-4065-b12c-914cf3833cf4 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:30.394959 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3145b7d5-7026-4065-b12c-914cf3833cf4 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.142196 Jun 16 14:38:30.406270 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 222/418] 10.222.0.57 () {58 vars in 1175 bytes} [Thu Jun 16 14:38:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:30.421446 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d28ddc07-6e3a-44bd-84f7-8977b70ebcf1 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:30.421997 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d28ddc07-6e3a-44bd-84f7-8977b70ebcf1 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:30.466545 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d28ddc07-6e3a-44bd-84f7-8977b70ebcf1 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:30.468746 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d28ddc07-6e3a-44bd-84f7-8977b70ebcf1 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:30.474955 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d28ddc07-6e3a-44bd-84f7-8977b70ebcf1 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:30.480788 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d28ddc07-6e3a-44bd-84f7-8977b70ebcf1 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:30.803228 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d28ddc07-6e3a-44bd-84f7-8977b70ebcf1 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f/action" status: 202 len: 0 microversion: 2.1 time: 0.395003 Jun 16 14:38:30.810968 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 223/419] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:38:30 2022] POST /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:38:30.827834 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0f83c451-b3ad-462e-b94d-1b0d3484cf2e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:30.835790 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0f83c451-b3ad-462e-b94d-1b0d3484cf2e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:30.849697 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0f83c451-b3ad-462e-b94d-1b0d3484cf2e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:30.855398 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0f83c451-b3ad-462e-b94d-1b0d3484cf2e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:30.858589 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0f83c451-b3ad-462e-b94d-1b0d3484cf2e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:30.862759 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0f83c451-b3ad-462e-b94d-1b0d3484cf2e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:31.227445 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-64568691-bb8d-4637-9da4-25c46d6d834a tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2060918002", "id": 950220028, "os-flavor-access:is_public": "False"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:31.229893 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:31.229893 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:31.280249 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-64568691-bb8d-4637-9da4-25c46d6d834a tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 1.297453 Jun 16 14:38:31.296781 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 197/420] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:38:29 2022] POST /compute/v2.1/flavors => generated 428 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:38:31.322485 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-eb876df9-8dae-47e7-8dcc-040072bd2de0 req-6b4db02f-3b00-4d86-9762-0b2156ee8561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f66e919a-163e-401b-8211-4711f5ce7e07", "tag": "fb7f9870-cb65-4faa-b023-61d84c6e5436"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:31.400174 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-eb876df9-8dae-47e7-8dcc-040072bd2de0 req-6b4db02f-3b00-4d86-9762-0b2156ee8561 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:31.404933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-eb876df9-8dae-47e7-8dcc-040072bd2de0 req-6b4db02f-3b00-4d86-9762-0b2156ee8561 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:31.449249 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-eb876df9-8dae-47e7-8dcc-040072bd2de0 req-6b4db02f-3b00-4d86-9762-0b2156ee8561 service nova] Creating event network-changed:fb7f9870-cb65-4faa-b023-61d84c6e5436 for instance f66e919a-163e-401b-8211-4711f5ce7e07 on n-h1-836830-4 Jun 16 14:38:31.497870 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-eb876df9-8dae-47e7-8dcc-040072bd2de0 req-6b4db02f-3b00-4d86-9762-0b2156ee8561 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204044 Jun 16 14:38:31.508727 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 198/421] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:31.539010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dbf674a6-82c0-41e9-9c4a-3a69ec13403e tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:31.539894 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-dbf674a6-82c0-41e9-9c4a-3a69ec13403e tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:31.558621 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dbf674a6-82c0-41e9-9c4a-3a69ec13403e tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:31.559350 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dbf674a6-82c0-41e9-9c4a-3a69ec13403e tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:31.560732 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dbf674a6-82c0-41e9-9c4a-3a69ec13403e tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:31.561325 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dbf674a6-82c0-41e9-9c4a-3a69ec13403e tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:31.726112 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0f83c451-b3ad-462e-b94d-1b0d3484cf2e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:31.740060 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0f83c451-b3ad-462e-b94d-1b0d3484cf2e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1321 microversion: 2.1 time: 0.923667 Jun 16 14:38:31.747447 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 224/422] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:30 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1321 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:31.757838 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f89881e9-d848-42ed-86a7-44787a0e54cb tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0050f16c1ea241a39297a38e2ec6836f"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:31.759676 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:31.759676 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:31.947313 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f89881e9-d848-42ed-86a7-44787a0e54cb tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/950220028/action" status: 200 len: 96 microversion: 2.1 time: 0.198300 Jun 16 14:38:31.948232 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 225/423] 10.222.0.57 () {60 vars in 1196 bytes} [Thu Jun 16 14:38:31 2022] POST /compute/v2.1/flavors/950220028/action => generated 96 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:38:32.262179 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-dbf674a6-82c0-41e9-9c4a-3a69ec13403e tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1650 microversion: 2.1 time: 0.751256 Jun 16 14:38:32.271068 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 199/424] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:31 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1650 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:32.344020 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e3fe6ce3-263d-4dc6-902e-60199d4ab824 tempest-FlavorsAccessTestJSON-1928660928 tempest-FlavorsAccessTestJSON-1928660928-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:32.386353 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e3fe6ce3-263d-4dc6-902e-60199d4ab824 tempest-FlavorsAccessTestJSON-1928660928 tempest-FlavorsAccessTestJSON-1928660928-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 6237 microversion: 2.1 time: 0.422973 Jun 16 14:38:32.396113 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 226/425] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:38:31 2022] GET /compute/v2.1/flavors/detail => generated 6237 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:38:32.410766 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bb5d677e-adc3-4683-8424-bf45c71b1091 tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0050f16c1ea241a39297a38e2ec6836f"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:32.412245 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:32.412245 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:32.766060 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-eff1bef1-a885-426e-b115-a1b3f530080e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:32.769053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-eff1bef1-a885-426e-b115-a1b3f530080e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:32.784883 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eff1bef1-a885-426e-b115-a1b3f530080e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:32.786163 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eff1bef1-a885-426e-b115-a1b3f530080e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:32.787918 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eff1bef1-a885-426e-b115-a1b3f530080e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:32.789004 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eff1bef1-a885-426e-b115-a1b3f530080e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:33.156635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=8 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:33.181206 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-eff1bef1-a885-426e-b115-a1b3f530080e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:33.207415 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-eff1bef1-a885-426e-b115-a1b3f530080e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1321 microversion: 2.1 time: 0.446963 Jun 16 14:38:33.208533 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 227/426] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:32 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:33.290548 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f330713f-054c-4ee2-b564-9a5ed0e42582 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:33.292179 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f330713f-054c-4ee2-b564-9a5ed0e42582 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:33.307199 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f330713f-054c-4ee2-b564-9a5ed0e42582 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:33.308891 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f330713f-054c-4ee2-b564-9a5ed0e42582 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:33.311030 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f330713f-054c-4ee2-b564-9a5ed0e42582 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:33.312149 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f330713f-054c-4ee2-b564-9a5ed0e42582 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:33.505978 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bb5d677e-adc3-4683-8424-bf45c71b1091 tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/950220028/action" status: 200 len: 21 microversion: 2.1 time: 1.099133 Jun 16 14:38:33.509266 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 200/427] 10.222.0.57 () {60 vars in 1196 bytes} [Thu Jun 16 14:38:32 2022] POST /compute/v2.1/flavors/950220028/action => generated 21 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:38:33.548475 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8c183543-b46b-4261-8e76-8febded0717d tempest-FlavorsAccessTestJSON-1928660928 tempest-FlavorsAccessTestJSON-1928660928-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:33.648232 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8c183543-b46b-4261-8e76-8febded0717d tempest-FlavorsAccessTestJSON-1928660928 tempest-FlavorsAccessTestJSON-1928660928-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.122634 Jun 16 14:38:33.650117 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 201/428] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:38:33 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:33.695064 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-93ad6f21-e547-40a7-9252-1b9530483b02 tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:33.699658 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:33.699658 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:33.722026 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f330713f-054c-4ee2-b564-9a5ed0e42582 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1630 microversion: 2.1 time: 0.440181 Jun 16 14:38:33.723486 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 228/429] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:33 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1630 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:33.766592 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-043b098c-9fa3-41f6-9f73-ef97af61b0fd tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-4", "block_migration": true, "disk_over_commit": false}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:33.772761 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-043b098c-9fa3-41f6-9f73-ef97af61b0fd tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:33.791234 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-043b098c-9fa3-41f6-9f73-ef97af61b0fd tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:33.792670 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-043b098c-9fa3-41f6-9f73-ef97af61b0fd tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:33.794734 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-043b098c-9fa3-41f6-9f73-ef97af61b0fd tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:33.795783 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-043b098c-9fa3-41f6-9f73-ef97af61b0fd tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:33.821122 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-93ad6f21-e547-40a7-9252-1b9530483b02 tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/950220028" status: 202 len: 0 microversion: 2.1 time: 0.135486 Jun 16 14:38:33.822279 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 202/430] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:38:33 2022] DELETE /compute/v2.1/flavors/950220028 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:38:33.853549 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8d8c8c3d-50f7-4c21-92bd-af67e3513868 tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:33.944385 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8d8c8c3d-50f7-4c21-92bd-af67e3513868 tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.114644 Jun 16 14:38:33.946315 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 203/431] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:38:33 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:33.981952 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-043b098c-9fa3-41f6-9f73-ef97af61b0fd tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lazy-loading 'flavor' on Instance uuid 041bdae6-9e2f-4508-bd7b-51bcc2666b7f {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:38:34.016317 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b6080ede-d951-4dc5-afcc-61fbc4d39fb0 tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-705919375", "id": 123450848, "os-flavor-access:is_public": "False"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:34.024815 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:34.024815 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:34.073871 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b6080ede-d951-4dc5-afcc-61fbc4d39fb0 tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.067127 Jun 16 14:38:34.076392 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 204/432] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:38:34 2022] POST /compute/v2.1/flavors => generated 427 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:38:34.124407 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e572ed8d-7734-45e0-88d1-87528a0f7a68 tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:34.125800 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:34.125800 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:34.132076 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-043b098c-9fa3-41f6-9f73-ef97af61b0fd tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Going to try to live migrate instance to n-h1-836830-4 {{(pid=125863) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 14:38:34.183434 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e572ed8d-7734-45e0-88d1-87528a0f7a68 tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/123450848/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.075649 Jun 16 14:38:34.186044 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 205/433] 10.222.0.57 () {58 vars in 1205 bytes} [Thu Jun 16 14:38:34 2022] GET /compute/v2.1/flavors/123450848/os-flavor-access => generated 21 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:38:34.208836 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e571beea-cc5d-4780-8559-cc79b6725782 tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:34.326589 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e571beea-cc5d-4780-8559-cc79b6725782 tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/123450848" status: 202 len: 0 microversion: 2.1 time: 0.132555 Jun 16 14:38:34.335014 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 206/434] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:38:34 2022] DELETE /compute/v2.1/flavors/123450848 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:38:34.349513 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f49f1994-f142-4d2b-9af7-4b763e299bee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:34.353384 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f49f1994-f142-4d2b-9af7-4b763e299bee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:34.372258 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f49f1994-f142-4d2b-9af7-4b763e299bee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:34.373600 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f49f1994-f142-4d2b-9af7-4b763e299bee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:34.375864 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f49f1994-f142-4d2b-9af7-4b763e299bee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:34.378148 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f49f1994-f142-4d2b-9af7-4b763e299bee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:34.727906 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f49f1994-f142-4d2b-9af7-4b763e299bee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:34.737082 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f49f1994-f142-4d2b-9af7-4b763e299bee tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1321 microversion: 2.1 time: 0.402373 Jun 16 14:38:34.738920 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 207/435] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:34 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1321 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:34.760462 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4999ef6f-59b9-4362-a557-0141b639ed63 tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:34.802460 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4999ef6f-59b9-4362-a557-0141b639ed63 tempest-FlavorsAccessTestJSON-264067825 tempest-FlavorsAccessTestJSON-264067825-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.061454 Jun 16 14:38:34.803610 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 208/436] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:38:34 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:35.770914 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-273edb5c-e026-4721-89cb-507a8af308ce tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:35.774975 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-273edb5c-e026-4721-89cb-507a8af308ce tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:35.794843 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-273edb5c-e026-4721-89cb-507a8af308ce tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:35.795105 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-273edb5c-e026-4721-89cb-507a8af308ce tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:35.796855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-273edb5c-e026-4721-89cb-507a8af308ce tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:35.797680 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-273edb5c-e026-4721-89cb-507a8af308ce tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:36.302076 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-273edb5c-e026-4721-89cb-507a8af308ce tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:36.338070 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-273edb5c-e026-4721-89cb-507a8af308ce tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1321 microversion: 2.1 time: 0.579746 Jun 16 14:38:36.338755 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 209/437] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:35 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1321 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:37.369851 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-453ec8cf-57f4-4786-986e-81763924ed0f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:37.372498 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-453ec8cf-57f4-4786-986e-81763924ed0f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:37.392473 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-453ec8cf-57f4-4786-986e-81763924ed0f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:37.401602 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-453ec8cf-57f4-4786-986e-81763924ed0f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:37.403578 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-453ec8cf-57f4-4786-986e-81763924ed0f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:37.404800 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-453ec8cf-57f4-4786-986e-81763924ed0f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:37.613522 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-043b098c-9fa3-41f6-9f73-ef97af61b0fd tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f/action" status: 202 len: 0 microversion: 2.1 time: 3.853594 Jun 16 14:38:37.615729 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 229/438] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:38:33 2022] POST /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f/action => generated 0 bytes in 3857 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:38:37.641090 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-27b4e085-eb37-43de-8334-93d9c55398ab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:37.643248 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-27b4e085-eb37-43de-8334-93d9c55398ab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:37.708949 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-27b4e085-eb37-43de-8334-93d9c55398ab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:37.716501 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-27b4e085-eb37-43de-8334-93d9c55398ab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:37.718261 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-27b4e085-eb37-43de-8334-93d9c55398ab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:37.734266 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-27b4e085-eb37-43de-8334-93d9c55398ab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:37.976013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-453ec8cf-57f4-4786-986e-81763924ed0f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:37.998952 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-453ec8cf-57f4-4786-986e-81763924ed0f tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1321 microversion: 2.1 time: 0.632100 Jun 16 14:38:38.006906 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 210/439] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:37 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1321 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:38:38.233261 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-27b4e085-eb37-43de-8334-93d9c55398ab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:38.248910 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-27b4e085-eb37-43de-8334-93d9c55398ab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1504 microversion: 2.1 time: 0.625048 Jun 16 14:38:38.265118 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 230/440] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:37 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1504 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:38.854023 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-63c842aa-cddf-4a23-a0ed-e9aaeb5f01d6 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Calling method '.version_select at 0x7fdf0c87f700>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:38.855736 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:38.855736 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:38.857951 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-63c842aa-cddf-4a23-a0ed-e9aaeb5f01d6 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:38.859424 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-63c842aa-cddf-4a23-a0ed-e9aaeb5f01d6 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:38.923596 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-63c842aa-cddf-4a23-a0ed-e9aaeb5f01d6 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:38.924814 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-63c842aa-cddf-4a23-a0ed-e9aaeb5f01d6 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:38.966373 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-63c842aa-cddf-4a23-a0ed-e9aaeb5f01d6 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:38.967364 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-63c842aa-cddf-4a23-a0ed-e9aaeb5f01d6 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:38.994856 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-63c842aa-cddf-4a23-a0ed-e9aaeb5f01d6 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.588353 Jun 16 14:38:38.996247 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 211/441] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:38:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:39.011900 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-43264e93-201d-4962-9ed3-b730f9ceb0d7 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Calling method '.version_select at 0x7fdf0c655160>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:39.013933 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:39.013933 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:39.017380 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-43264e93-201d-4962-9ed3-b730f9ceb0d7 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:39.018268 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-43264e93-201d-4962-9ed3-b730f9ceb0d7 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:39.026864 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1d1dfcf0-843b-4a17-b8a2-fa38d12f0538 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:39.027603 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1d1dfcf0-843b-4a17-b8a2-fa38d12f0538 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:39.065757 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1d1dfcf0-843b-4a17-b8a2-fa38d12f0538 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:39.066693 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1d1dfcf0-843b-4a17-b8a2-fa38d12f0538 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:39.068679 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1d1dfcf0-843b-4a17-b8a2-fa38d12f0538 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:39.069808 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1d1dfcf0-843b-4a17-b8a2-fa38d12f0538 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:39.118254 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-43264e93-201d-4962-9ed3-b730f9ceb0d7 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:39.118944 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-43264e93-201d-4962-9ed3-b730f9ceb0d7 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:39.180975 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-43264e93-201d-4962-9ed3-b730f9ceb0d7 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:39.187791 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-43264e93-201d-4962-9ed3-b730f9ceb0d7 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:39.201341 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-43264e93-201d-4962-9ed3-b730f9ceb0d7 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/n-h2-836830-4/servers" status: 200 len: 275 microversion: 2.1 time: 0.195001 Jun 16 14:38:39.213816 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 231/442] 10.222.0.57 () {58 vars in 1211 bytes} [Thu Jun 16 14:38:39 2022] GET /compute/v2.1/os-hypervisors/n-h2-836830-4/servers => generated 275 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:39.224680 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c18b5e82-477f-4808-b220-a34e8e0e5165 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Calling method '.version_select at 0x7fdf0c718280>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:39.226106 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:39.226106 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:39.230604 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c18b5e82-477f-4808-b220-a34e8e0e5165 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:39.242350 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c18b5e82-477f-4808-b220-a34e8e0e5165 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:39.289374 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c18b5e82-477f-4808-b220-a34e8e0e5165 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:39.290485 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c18b5e82-477f-4808-b220-a34e8e0e5165 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:39.331751 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c18b5e82-477f-4808-b220-a34e8e0e5165 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:39.336784 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c18b5e82-477f-4808-b220-a34e8e0e5165 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:39.344636 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c18b5e82-477f-4808-b220-a34e8e0e5165 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.124084 Jun 16 14:38:39.346819 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 232/443] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:38:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:39.352216 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c548b5c3-f077-47b3-8b02-2f51de32643a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:39.353273 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c548b5c3-f077-47b3-8b02-2f51de32643a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:39.360395 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c548b5c3-f077-47b3-8b02-2f51de32643a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:39.362070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c548b5c3-f077-47b3-8b02-2f51de32643a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:39.363453 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c548b5c3-f077-47b3-8b02-2f51de32643a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:39.364151 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c548b5c3-f077-47b3-8b02-2f51de32643a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:39.772016 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c548b5c3-f077-47b3-8b02-2f51de32643a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:39.800609 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c548b5c3-f077-47b3-8b02-2f51de32643a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1504 microversion: 2.1 time: 0.452238 Jun 16 14:38:39.803737 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 233/444] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:39 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1504 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:39.825880 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f8738b79-b805-4149-b648-6bea20293c74 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Calling method '.version_select at 0x7fdf0c43faf0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:39.826564 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:39.826564 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:39.832029 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f8738b79-b805-4149-b648-6bea20293c74 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:39.837946 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f8738b79-b805-4149-b648-6bea20293c74 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:39.872734 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f8738b79-b805-4149-b648-6bea20293c74 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:39.873306 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f8738b79-b805-4149-b648-6bea20293c74 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:39.896816 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f8738b79-b805-4149-b648-6bea20293c74 tempest-HypervisorAdminUnderV252Test-478875595 tempest-HypervisorAdminUnderV252Test-478875595-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/n-h2-836830-4/search" status: 200 len: 104 microversion: 2.1 time: 0.091833 Jun 16 14:38:39.911151 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 234/445] 10.222.0.57 () {58 vars in 1208 bytes} [Thu Jun 16 14:38:39 2022] GET /compute/v2.1/os-hypervisors/n-h2-836830-4/search => generated 104 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:40.057590 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1d1dfcf0-843b-4a17-b8a2-fa38d12f0538 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:40.072863 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1d1dfcf0-843b-4a17-b8a2-fa38d12f0538 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1321 microversion: 2.1 time: 1.052915 Jun 16 14:38:40.073798 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 212/446] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:39 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1321 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:40.831341 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=4 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:40.839475 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-73e59e5d-0dab-48f8-855a-d05c85ac40aa tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:40.840453 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-73e59e5d-0dab-48f8-855a-d05c85ac40aa tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:40.874677 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-73e59e5d-0dab-48f8-855a-d05c85ac40aa tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:40.880824 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-73e59e5d-0dab-48f8-855a-d05c85ac40aa tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:40.900766 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-73e59e5d-0dab-48f8-855a-d05c85ac40aa tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:40.902418 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-73e59e5d-0dab-48f8-855a-d05c85ac40aa tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:41.106956 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9994a0ef-e698-4788-80b5-18cbb34193b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:41.121379 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9994a0ef-e698-4788-80b5-18cbb34193b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:41.207689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9994a0ef-e698-4788-80b5-18cbb34193b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:41.209476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9994a0ef-e698-4788-80b5-18cbb34193b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:41.213819 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9994a0ef-e698-4788-80b5-18cbb34193b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:41.215017 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9994a0ef-e698-4788-80b5-18cbb34193b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:41.572032 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-73e59e5d-0dab-48f8-855a-d05c85ac40aa tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:41.578160 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:41.612755 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-73e59e5d-0dab-48f8-855a-d05c85ac40aa tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1504 microversion: 2.1 time: 0.782394 Jun 16 14:38:41.627061 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 235/447] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:40 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1504 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:38:41.890914 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9994a0ef-e698-4788-80b5-18cbb34193b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:41.934963 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9994a0ef-e698-4788-80b5-18cbb34193b3 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1321 microversion: 2.1 time: 0.828060 Jun 16 14:38:41.937534 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 213/448] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:41 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1321 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:42.089675 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-4e9474dc-ce0b-43cb-8efd-fef60caf6575 req-a661fe0a-187c-4b5e-9e87-f5b5681601bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66e919a-163e-401b-8211-4711f5ce7e07", "name": "network-vif-plugged", "status": "completed", "tag": "fb7f9870-cb65-4faa-b023-61d84c6e5436"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:42.131111 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-4e9474dc-ce0b-43cb-8efd-fef60caf6575 req-a661fe0a-187c-4b5e-9e87-f5b5681601bf service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:42.131560 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-4e9474dc-ce0b-43cb-8efd-fef60caf6575 req-a661fe0a-187c-4b5e-9e87-f5b5681601bf service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:42.204543 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-4e9474dc-ce0b-43cb-8efd-fef60caf6575 req-a661fe0a-187c-4b5e-9e87-f5b5681601bf service nova] Creating event network-vif-plugged:fb7f9870-cb65-4faa-b023-61d84c6e5436 for instance f66e919a-163e-401b-8211-4711f5ce7e07 on n-h1-836830-4 Jun 16 14:38:42.221347 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-4e9474dc-ce0b-43cb-8efd-fef60caf6575 req-a661fe0a-187c-4b5e-9e87-f5b5681601bf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144369 Jun 16 14:38:42.223570 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 236/449] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:42.650499 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a9871714-5608-4e1c-8099-1720e5feb745 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:42.652694 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a9871714-5608-4e1c-8099-1720e5feb745 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:42.676671 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9871714-5608-4e1c-8099-1720e5feb745 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:42.678023 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9871714-5608-4e1c-8099-1720e5feb745 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:42.679402 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9871714-5608-4e1c-8099-1720e5feb745 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:42.680457 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9871714-5608-4e1c-8099-1720e5feb745 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:42.966098 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-576f12eb-5ba6-4335-a9a9-2d0d85c1289a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:42.966960 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-576f12eb-5ba6-4335-a9a9-2d0d85c1289a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:42.996723 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-576f12eb-5ba6-4335-a9a9-2d0d85c1289a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:42.997269 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-576f12eb-5ba6-4335-a9a9-2d0d85c1289a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:43.002201 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-576f12eb-5ba6-4335-a9a9-2d0d85c1289a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:43.003404 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-576f12eb-5ba6-4335-a9a9-2d0d85c1289a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:44.401291 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a9871714-5608-4e1c-8099-1720e5feb745 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:44.422712 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a9871714-5608-4e1c-8099-1720e5feb745 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1504 microversion: 2.1 time: 1.778112 Jun 16 14:38:44.440136 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 214/450] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:42 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1504 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:44.773317 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-576f12eb-5ba6-4335-a9a9-2d0d85c1289a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:44.791943 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-576f12eb-5ba6-4335-a9a9-2d0d85c1289a tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1321 microversion: 2.1 time: 1.837563 Jun 16 14:38:44.806949 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 237/451] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:42 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1321 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:38:44.820747 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-ba95ac69-8e65-499b-8886-34c3f630bf9e req-c984b360-ba60-43d3-97f2-64faac17ab04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041bdae6-9e2f-4508-bd7b-51bcc2666b7f", "name": "network-vif-unplugged", "status": "completed", "tag": "96b3e2f5-fedd-4636-8ce3-e8b768044f69"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:44.869085 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-ba95ac69-8e65-499b-8886-34c3f630bf9e req-c984b360-ba60-43d3-97f2-64faac17ab04 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:44.889194 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-ba95ac69-8e65-499b-8886-34c3f630bf9e req-c984b360-ba60-43d3-97f2-64faac17ab04 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:44.958503 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-ba95ac69-8e65-499b-8886-34c3f630bf9e req-c984b360-ba60-43d3-97f2-64faac17ab04 service nova] Creating event network-vif-unplugged:96b3e2f5-fedd-4636-8ce3-e8b768044f69 for instance 041bdae6-9e2f-4508-bd7b-51bcc2666b7f on n-h2-836830-4 Jun 16 14:38:44.981188 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-ba95ac69-8e65-499b-8886-34c3f630bf9e req-c984b360-ba60-43d3-97f2-64faac17ab04 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154673 Jun 16 14:38:44.982138 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 238/452] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:45.474498 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-30dece4c-34a8-4bd1-a054-7980cb1ff68f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:45.480980 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-30dece4c-34a8-4bd1-a054-7980cb1ff68f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:45.541210 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-49f2384d-ede4-431a-8d73-daac2b53eb47 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-120275944", "ram": 512, "vcpus": 1, "disk": 10, "id": 980838109, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:45.543306 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:45.543306 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:45.546138 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-30dece4c-34a8-4bd1-a054-7980cb1ff68f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:45.556867 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-30dece4c-34a8-4bd1-a054-7980cb1ff68f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:45.565210 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-30dece4c-34a8-4bd1-a054-7980cb1ff68f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:45.577089 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-30dece4c-34a8-4bd1-a054-7980cb1ff68f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:45.592170 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-49f2384d-ede4-431a-8d73-daac2b53eb47 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 1.149781 Jun 16 14:38:45.605761 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 215/453] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:38:44 2022] POST /compute/v2.1/flavors => generated 412 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:45.613285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-aa2a1bdf-3c97-474e-8d0f-fdce839e21a0 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:45.631032 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:45.631032 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:38:45.724754 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-aa2a1bdf-3c97-474e-8d0f-fdce839e21a0 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/980838109/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.115632 Jun 16 14:38:45.736048 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 216/454] 10.222.0.57 () {60 vars in 1220 bytes} [Thu Jun 16 14:38:45 2022] POST /compute/v2.1/flavors/980838109/os-extra_specs => generated 66 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:38:46.072289 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bca16145-67ce-433b-9743-641b53e7aaf3 tempest-FlavorsExtraSpecsTestJSON-1490605381 tempest-FlavorsExtraSpecsTestJSON-1490605381-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:46.095380 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=13,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:46.114019 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bca16145-67ce-433b-9743-641b53e7aaf3 tempest-FlavorsExtraSpecsTestJSON-1490605381 tempest-FlavorsExtraSpecsTestJSON-1490605381-project] 10.222.0.57 "GET /compute/v2.1/flavors/980838109/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.369403 Jun 16 14:38:46.118462 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 217/455] 10.222.0.57 () {58 vars in 1199 bytes} [Thu Jun 16 14:38:45 2022] GET /compute/v2.1/flavors/980838109/os-extra_specs => generated 66 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:38:46.125437 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-25053b5d-8695-47bb-9994-f17923f71444 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:46.138040 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-25053b5d-8695-47bb-9994-f17923f71444 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:46.174745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25053b5d-8695-47bb-9994-f17923f71444 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:46.175688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25053b5d-8695-47bb-9994-f17923f71444 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:46.176845 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25053b5d-8695-47bb-9994-f17923f71444 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:46.177458 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25053b5d-8695-47bb-9994-f17923f71444 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:46.241009 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:46.723451 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-30dece4c-34a8-4bd1-a054-7980cb1ff68f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:46.738282 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-30dece4c-34a8-4bd1-a054-7980cb1ff68f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1504 microversion: 2.1 time: 1.288949 Jun 16 14:38:46.758601 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 239/456] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:45 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1504 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:46.781149 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2419c3d5-1bab-4a82-88e9-2903dccb824d tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:46.786766 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:46.786766 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:46.875564 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2419c3d5-1bab-4a82-88e9-2903dccb824d tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/980838109/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.115262 Jun 16 14:38:46.890171 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 240/457] 10.222.0.57 () {60 vars in 1220 bytes} [Thu Jun 16 14:38:46 2022] POST /compute/v2.1/flavors/980838109/os-extra_specs => generated 66 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:38:46.896778 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a7d021fb-1078-4730-afbb-e662a78cc805 tempest-FlavorsExtraSpecsTestJSON-1490605381 tempest-FlavorsExtraSpecsTestJSON-1490605381-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:46.946561 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a7d021fb-1078-4730-afbb-e662a78cc805 tempest-FlavorsExtraSpecsTestJSON-1490605381 tempest-FlavorsExtraSpecsTestJSON-1490605381-project] 10.222.0.57 "GET /compute/v2.1/flavors/980838109/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.054929 Jun 16 14:38:46.947181 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 241/458] 10.222.0.57 () {58 vars in 1241 bytes} [Thu Jun 16 14:38:46 2022] GET /compute/v2.1/flavors/980838109/os-extra_specs/hw:numa_nodes => generated 22 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:38:47.000560 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-77ec2901-a885-472f-b25b-409918a6938c tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:47.023828 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:RELEASE=4,nova_api:SAVEPOINT=4,nova_api:INSERT=2,nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:38:47.072786 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-77ec2901-a885-472f-b25b-409918a6938c tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/980838109/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.076161 Jun 16 14:38:47.097479 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 242/459] 10.222.0.57 () {60 vars in 1220 bytes} [Thu Jun 16 14:38:46 2022] POST /compute/v2.1/flavors/980838109/os-extra_specs => generated 66 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:38:47.116841 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-35608f4f-b157-4e80-85f4-842180b3e414 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:47.152305 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-35608f4f-b157-4e80-85f4-842180b3e414 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/980838109/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053298 Jun 16 14:38:47.162740 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 243/460] 10.222.0.57 () {58 vars in 1199 bytes} [Thu Jun 16 14:38:47 2022] GET /compute/v2.1/flavors/980838109/os-extra_specs => generated 66 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:38:47.176944 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9ff3ecb1-bf35-4048-ae76-b69c31d49918 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:47.181137 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:47.181137 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:47.186758 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-25053b5d-8695-47bb-9994-f17923f71444 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:47.203040 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-25053b5d-8695-47bb-9994-f17923f71444 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1471 microversion: 2.1 time: 1.081646 Jun 16 14:38:47.220807 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 218/461] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:46 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1471 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:47.247979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-af24180d-6a34-4451-9467-f041b4f7dcb5 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:47.263171 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-af24180d-6a34-4451-9467-f041b4f7dcb5 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:47.274153 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9ff3ecb1-bf35-4048-ae76-b69c31d49918 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] 10.222.0.57 "PUT /compute/v2.1/flavors/980838109/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.109151 Jun 16 14:38:47.284884 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 244/462] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jun 16 14:38:47 2022] PUT /compute/v2.1/flavors/980838109/os-extra_specs/hw:numa_nodes => generated 22 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:38:47.296049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af24180d-6a34-4451-9467-f041b4f7dcb5 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:47.301190 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8c5685f6-e9ec-4024-acf6-0965886d1095 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:47.311793 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af24180d-6a34-4451-9467-f041b4f7dcb5 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:47.315338 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af24180d-6a34-4451-9467-f041b4f7dcb5 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:47.326158 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8c5685f6-e9ec-4024-acf6-0965886d1095 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/980838109/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035261 Jun 16 14:38:47.327077 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af24180d-6a34-4451-9467-f041b4f7dcb5 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:47.334936 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 245/463] 10.222.0.57 () {58 vars in 1199 bytes} [Thu Jun 16 14:38:47 2022] GET /compute/v2.1/flavors/980838109/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:38:47.340503 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-80503ff8-ae57-44a9-873c-c5b3c9d1d7f2 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:47.341837 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:47.341837 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:47.422037 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-80503ff8-ae57-44a9-873c-c5b3c9d1d7f2 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/980838109/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.085908 Jun 16 14:38:47.427017 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 246/464] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 16 14:38:47 2022] DELETE /compute/v2.1/flavors/980838109/os-extra_specs/hw:numa_nodes => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:38:47.450698 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-19f05951-1f4a-43bf-a987-d7604e91144d tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:47.516915 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-af24180d-6a34-4451-9467-f041b4f7dcb5 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lazy-loading 'flavor' on Instance uuid f66e919a-163e-401b-8211-4711f5ce7e07 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:38:47.518038 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-19f05951-1f4a-43bf-a987-d7604e91144d tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/980838109/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.083422 Jun 16 14:38:47.518821 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 247/465] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 16 14:38:47 2022] DELETE /compute/v2.1/flavors/980838109/os-extra_specs/hw:cpu_policy => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 16 14:38:47.528631 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-240ffd47-2656-47cf-b13a-7daa99f24879 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:47.567037 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-240ffd47-2656-47cf-b13a-7daa99f24879 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/980838109/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.042194 Jun 16 14:38:47.568050 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 248/466] 10.222.0.57 () {58 vars in 1199 bytes} [Thu Jun 16 14:38:47 2022] GET /compute/v2.1/flavors/980838109/os-extra_specs => generated 19 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:38:47.587686 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b65867a2-1033-45a6-ba0f-572d270ffa54 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:47.588894 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:47.588894 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:47.656780 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b65867a2-1033-45a6-ba0f-572d270ffa54 tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/980838109" status: 202 len: 0 microversion: 2.1 time: 0.070649 Jun 16 14:38:47.667249 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 249/467] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:38:47 2022] DELETE /compute/v2.1/flavors/980838109 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:38:47.687463 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a89e511e-9bd4-4747-8233-599d5362142b tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:47.773942 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a89e511e-9bd4-4747-8233-599d5362142b tempest-FlavorsExtraSpecsTestJSON-1091500097 tempest-FlavorsExtraSpecsTestJSON-1091500097-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.098857 Jun 16 14:38:47.777486 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 250/468] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:38:47 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:47.844473 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5f764c87-46e4-48bb-9d38-de1d863803f7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:47.845847 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5f764c87-46e4-48bb-9d38-de1d863803f7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:47.889035 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5f764c87-46e4-48bb-9d38-de1d863803f7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:47.899181 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5f764c87-46e4-48bb-9d38-de1d863803f7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:47.901385 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5f764c87-46e4-48bb-9d38-de1d863803f7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:47.913638 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5f764c87-46e4-48bb-9d38-de1d863803f7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:48.009785 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-af24180d-6a34-4451-9467-f041b4f7dcb5 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07/action" status: 202 len: 0 microversion: 2.1 time: 0.777301 Jun 16 14:38:48.019380 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 219/469] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:38:47 2022] POST /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07/action => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:38:48.038925 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4352869f-c2f7-480e-8f20-4e1c12fa39dd tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:48.048513 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4352869f-c2f7-480e-8f20-4e1c12fa39dd tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:48.070642 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4352869f-c2f7-480e-8f20-4e1c12fa39dd tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:48.072205 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4352869f-c2f7-480e-8f20-4e1c12fa39dd tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:48.074300 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4352869f-c2f7-480e-8f20-4e1c12fa39dd tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:48.085385 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4352869f-c2f7-480e-8f20-4e1c12fa39dd tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:48.592947 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5f764c87-46e4-48bb-9d38-de1d863803f7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:48.641093 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5f764c87-46e4-48bb-9d38-de1d863803f7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1504 microversion: 2.1 time: 0.839737 Jun 16 14:38:48.654842 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 251/470] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:47 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1504 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:48.664407 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-05e609df-9ee3-4fa7-b793-f10672d67113 req-22079897-3469-4f95-b5b2-fb6356f7e04f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041bdae6-9e2f-4508-bd7b-51bcc2666b7f", "tag": "96b3e2f5-fedd-4636-8ce3-e8b768044f69"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:48.678178 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-05e609df-9ee3-4fa7-b793-f10672d67113 req-22079897-3469-4f95-b5b2-fb6356f7e04f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:48.680057 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-05e609df-9ee3-4fa7-b793-f10672d67113 req-22079897-3469-4f95-b5b2-fb6356f7e04f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:48.701732 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-05e609df-9ee3-4fa7-b793-f10672d67113 req-22079897-3469-4f95-b5b2-fb6356f7e04f service nova] Creating event network-changed:96b3e2f5-fedd-4636-8ce3-e8b768044f69 for instance 041bdae6-9e2f-4508-bd7b-51bcc2666b7f on n-h2-836830-4 Jun 16 14:38:48.710192 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-05e609df-9ee3-4fa7-b793-f10672d67113 req-22079897-3469-4f95-b5b2-fb6356f7e04f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053281 Jun 16 14:38:48.714503 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 252/471] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:49.358286 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4352869f-c2f7-480e-8f20-4e1c12fa39dd tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1630 microversion: 2.1 time: 1.337326 Jun 16 14:38:49.363727 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 220/472] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:48 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1630 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:49.663982 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b4e38288-211c-4eee-94e8-598e045d9b11 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:49.665825 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b4e38288-211c-4eee-94e8-598e045d9b11 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:49.681614 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4e38288-211c-4eee-94e8-598e045d9b11 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:49.681988 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4e38288-211c-4eee-94e8-598e045d9b11 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:49.682838 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4e38288-211c-4eee-94e8-598e045d9b11 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:49.688671 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4e38288-211c-4eee-94e8-598e045d9b11 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:50.385535 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d165975d-b260-4fc7-98e8-b39aff45afef tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:50.387397 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d165975d-b260-4fc7-98e8-b39aff45afef tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:50.405927 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d165975d-b260-4fc7-98e8-b39aff45afef tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:50.407424 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d165975d-b260-4fc7-98e8-b39aff45afef tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:50.409433 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d165975d-b260-4fc7-98e8-b39aff45afef tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:50.410468 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d165975d-b260-4fc7-98e8-b39aff45afef tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:50.551311 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b4e38288-211c-4eee-94e8-598e045d9b11 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:50.567654 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b4e38288-211c-4eee-94e8-598e045d9b11 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1504 microversion: 2.1 time: 0.906521 Jun 16 14:38:50.569246 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 253/473] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:49 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1504 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:51.077729 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-912c1431-72d5-4ddf-ad9d-378251d7f996 tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Calling method '.version_select at 0x7fdf0c4a2ca0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:51.085982 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:51.085982 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:51.087470 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-912c1431-72d5-4ddf-ad9d-378251d7f996 tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:51.088676 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-912c1431-72d5-4ddf-ad9d-378251d7f996 tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:51.154192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-912c1431-72d5-4ddf-ad9d-378251d7f996 tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:51.154760 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-912c1431-72d5-4ddf-ad9d-378251d7f996 tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:51.178476 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-912c1431-72d5-4ddf-ad9d-378251d7f996 tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:51.179268 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-912c1431-72d5-4ddf-ad9d-378251d7f996 tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:51.189185 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-912c1431-72d5-4ddf-ad9d-378251d7f996 tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.406482 Jun 16 14:38:51.191610 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 254/474] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:38:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:51.474374 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ab7ea5c7-9f13-48b4-88fb-c0c93c4b9fe2 tempest-HypervisorAdminNegativeUnderV252Test-1916874163 tempest-HypervisorAdminNegativeUnderV252Test-1916874163-project] Calling method '.version_select at 0x7fdf0c38e3a0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:51.475766 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:51.475766 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:51.477627 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ab7ea5c7-9f13-48b4-88fb-c0c93c4b9fe2 tempest-HypervisorAdminNegativeUnderV252Test-1916874163 tempest-HypervisorAdminNegativeUnderV252Test-1916874163-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '899abb7f0a5c4dfca36895734f953c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95b2b9c59de4333a0a7f058347fbb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ab7ea5c7-9f13-48b4-88fb-c0c93c4b9fe2 tempest-HypervisorAdminNegativeUnderV252Test-1916874163 tempest-HypervisorAdminNegativeUnderV252Test-1916874163-project] Request method failure captured: Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/os-hypervisors/n-h2-836830-4/search HTTP/1.1 Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0B5178veGqISAErCmJEdLBGobmivle2JtuO3rjjwu8NuW9otbqvb0_iiyo8bk4UDFOtpmtsfWvT0_YUDuzFaWIhLy4oIZgTK77Jzv8QGZnz2WCO5H1RdgPcJ-SOm3Xknrob2k8roJGCMUDf1M0TcSbuQoGX3TKRHN7KR-61NKjbprk Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: d95b2b9c59de4333a0a7f058347fbb1b Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1916874163 Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:38:51.481053 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:38:51.482911 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d95b2b9c59de4333a0a7f058347fbb1b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d95b2b9c59de4333a0a7f058347fbb1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d95b2b9c59de4333a0a7f058347fbb1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d95b2b9c59de4333a0a7f058347fbb1b"}]}] Jun 16 14:38:51.482911 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1916874163 Jun 16 14:38:51.482911 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: d95b2b9c59de4333a0a7f058347fbb1b Jun 16 14:38:51.482911 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1916874163 Jun 16 14:38:51.482911 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1916874163-project Jun 16 14:38:51.482911 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:51.482911 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:51.482911 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 899abb7f0a5c4dfca36895734f953c86 Jun 16 14:38:51.482911 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1916874163-project Jun 16 14:38:51.482911 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:38:51.482911 n-d-836830-4 devstack@n-api.service[125863]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 16 14:38:51.482911 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'n-h2-836830-4'} Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:38:51.483881 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 16 14:38:51.485394 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:51.489475 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ab7ea5c7-9f13-48b4-88fb-c0c93c4b9fe2 tempest-HypervisorAdminNegativeUnderV252Test-1916874163 tempest-HypervisorAdminNegativeUnderV252Test-1916874163-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:51.491549 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ab7ea5c7-9f13-48b4-88fb-c0c93c4b9fe2 tempest-HypervisorAdminNegativeUnderV252Test-1916874163 tempest-HypervisorAdminNegativeUnderV252Test-1916874163-project] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/n-h2-836830-4/search" status: 403 len: 117 microversion: 2.1 time: 0.291022 Jun 16 14:38:51.492345 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 255/475] 10.222.0.57 () {58 vars in 1208 bytes} [Thu Jun 16 14:38:51 2022] GET /compute/v2.1/os-hypervisors/n-h2-836830-4/search => generated 117 bytes in 293 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:51.508601 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b5ae0340-988b-4d21-a228-96374cf2640d tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Calling method '.version_select at 0x7fdf0c4071f0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:51.511824 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b5ae0340-988b-4d21-a228-96374cf2640d tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:51.512590 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b5ae0340-988b-4d21-a228-96374cf2640d tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:51.527126 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-b5ae0340-988b-4d21-a228-96374cf2640d tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b5ae0340-988b-4d21-a228-96374cf2640d tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Request method failure captured: Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0B6wH4BwCK4PSOWWf63wblM59jnlicbrLF5OIQkujvb3Ok0NwKO38TJogCh5SVMQFTi2-_-bCnM2E8T0oPJNYxpEtXEcFHjloGS_f5Q3r3pVNmBRKIlDF7yQGPn1KCxGJd6VmEV8IWoP_uTFjKTstGfxco2iI4LQozO3f19KeaMRy0 Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 1fb0ab38550645ff8ba685c655d7f0fc Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-936109952 Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:38:51.528849 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:38:51.530492 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1fb0ab38550645ff8ba685c655d7f0fc", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1fb0ab38550645ff8ba685c655d7f0fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1fb0ab38550645ff8ba685c655d7f0fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1fb0ab38550645ff8ba685c655d7f0fc"}]}] Jun 16 14:38:51.530492 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-936109952 Jun 16 14:38:51.530492 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 1fb0ab38550645ff8ba685c655d7f0fc Jun 16 14:38:51.530492 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-936109952 Jun 16 14:38:51.530492 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin Jun 16 14:38:51.530492 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:51.530492 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:51.530492 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 7f4c4b4ec7c04168b8b15883b207cbee Jun 16 14:38:51.530492 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin Jun 16 14:38:51.530492 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:38:51.530492 n-d-836830-4 devstack@n-api.service[125863]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 16 14:38:51.530492 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'nonexistent_hypervisor_name'} Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:51.531410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:51.533101 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:51.533101 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:38:51.533101 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:38:51.533101 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 16 14:38:51.533101 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:51.537664 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b5ae0340-988b-4d21-a228-96374cf2640d tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:51.542886 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b5ae0340-988b-4d21-a228-96374cf2640d tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.038063 Jun 16 14:38:51.552671 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 256/476] 10.222.0.57 () {58 vars in 1250 bytes} [Thu Jun 16 14:38:51 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:51.566979 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b22bc9a1-5879-4c17-81bf-602c667043ab tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Calling method '.version_select at 0x7fdf0c38e940>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:51.572360 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:51.572360 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:51.574290 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b22bc9a1-5879-4c17-81bf-602c667043ab tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:51.577660 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b22bc9a1-5879-4c17-81bf-602c667043ab tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:51.631410 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b22bc9a1-5879-4c17-81bf-602c667043ab tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:51.634027 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b22bc9a1-5879-4c17-81bf-602c667043ab tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:51.673182 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b22bc9a1-5879-4c17-81bf-602c667043ab tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:51.673714 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b22bc9a1-5879-4c17-81bf-602c667043ab tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:51.687133 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b22bc9a1-5879-4c17-81bf-602c667043ab tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.132642 Jun 16 14:38:51.688883 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 257/477] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:38:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:51.695853 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cac76c40-b167-42c0-b2b1-d969200d7ee3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:51.696843 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cac76c40-b167-42c0-b2b1-d969200d7ee3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:51.725099 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cac76c40-b167-42c0-b2b1-d969200d7ee3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:51.727369 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cac76c40-b167-42c0-b2b1-d969200d7ee3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:51.733027 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cac76c40-b167-42c0-b2b1-d969200d7ee3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:51.733853 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cac76c40-b167-42c0-b2b1-d969200d7ee3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:52.519873 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-cac76c40-b167-42c0-b2b1-d969200d7ee3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:52.529452 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cac76c40-b167-42c0-b2b1-d969200d7ee3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1504 microversion: 2.1 time: 0.838499 Jun 16 14:38:52.538837 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 258/478] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:51 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1504 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:52.551201 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a6725afc-eddf-43e6-b918-d7cf39962c10 tempest-HypervisorAdminNegativeUnderV252Test-1916874163 tempest-HypervisorAdminNegativeUnderV252Test-1916874163-project] Calling method '.version_select at 0x7fdf0c407b80>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:52.555648 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:38:52.555648 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:38:52.558824 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a6725afc-eddf-43e6-b918-d7cf39962c10 tempest-HypervisorAdminNegativeUnderV252Test-1916874163 tempest-HypervisorAdminNegativeUnderV252Test-1916874163-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '899abb7f0a5c4dfca36895734f953c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95b2b9c59de4333a0a7f058347fbb1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a6725afc-eddf-43e6-b918-d7cf39962c10 tempest-HypervisorAdminNegativeUnderV252Test-1916874163 tempest-HypervisorAdminNegativeUnderV252Test-1916874163-project] Request method failure captured: Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0B5178veGqISAErCmJEdLBGobmivle2JtuO3rjjwu8NuW9otbqvb0_iiyo8bk4UDFOtpmtsfWvT0_YUDuzFaWIhLy4oIZgTK77Jzv8QGZnz2WCO5H1RdgPcJ-SOm3Xknrob2k8roJGCMUDf1M0TcSbuQoGX3TKRHN7KR-61NKjbprk Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: d95b2b9c59de4333a0a7f058347fbb1b Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1916874163 Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:38:52.564285 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:38:52.566861 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d95b2b9c59de4333a0a7f058347fbb1b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d95b2b9c59de4333a0a7f058347fbb1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d95b2b9c59de4333a0a7f058347fbb1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d95b2b9c59de4333a0a7f058347fbb1b"}]}] Jun 16 14:38:52.566861 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1916874163 Jun 16 14:38:52.566861 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: d95b2b9c59de4333a0a7f058347fbb1b Jun 16 14:38:52.566861 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1916874163 Jun 16 14:38:52.566861 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1916874163-project Jun 16 14:38:52.566861 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:52.566861 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:52.566861 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 899abb7f0a5c4dfca36895734f953c86 Jun 16 14:38:52.566861 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1916874163-project Jun 16 14:38:52.566861 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:38:52.566861 n-d-836830-4 devstack@n-api.service[125863]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 16 14:38:52.566861 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '1'} Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:38:52.567759 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 16 14:38:52.569242 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:52.577068 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a6725afc-eddf-43e6-b918-d7cf39962c10 tempest-HypervisorAdminNegativeUnderV252Test-1916874163 tempest-HypervisorAdminNegativeUnderV252Test-1916874163-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:52.578223 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a6725afc-eddf-43e6-b918-d7cf39962c10 tempest-HypervisorAdminNegativeUnderV252Test-1916874163 tempest-HypervisorAdminNegativeUnderV252Test-1916874163-project] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.038016 Jun 16 14:38:52.579419 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 259/479] 10.222.0.57 () {58 vars in 1175 bytes} [Thu Jun 16 14:38:52 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:52.592105 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2bb63b81-403c-4c2b-9387-1e56b62d9c76 tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Calling method '.version_select at 0x7fdf0c5c5940>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:52.595192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2bb63b81-403c-4c2b-9387-1e56b62d9c76 tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:52.599525 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2bb63b81-403c-4c2b-9387-1e56b62d9c76 tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:52.609740 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-2bb63b81-403c-4c2b-9387-1e56b62d9c76 tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] HTTP exception thrown: No hypervisor matching '2a0c2724-3d80-40d9-af12-4e8ecc35bea7' could be found. Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2bb63b81-403c-4c2b-9387-1e56b62d9c76 tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Request method failure captured: Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/os-hypervisors/2a0c2724-3d80-40d9-af12-4e8ecc35bea7/servers HTTP/1.1 Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0B6wH4BwCK4PSOWWf63wblM59jnlicbrLF5OIQkujvb3Ok0NwKO38TJogCh5SVMQFTi2-_-bCnM2E8T0oPJNYxpEtXEcFHjloGS_f5Q3r3pVNmBRKIlDF7yQGPn1KCxGJd6VmEV8IWoP_uTFjKTstGfxco2iI4LQozO3f19KeaMRy0 Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 1fb0ab38550645ff8ba685c655d7f0fc Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-936109952 Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:38:52.621679 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:38:52.623891 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1fb0ab38550645ff8ba685c655d7f0fc", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1fb0ab38550645ff8ba685c655d7f0fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1fb0ab38550645ff8ba685c655d7f0fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1fb0ab38550645ff8ba685c655d7f0fc"}]}] Jun 16 14:38:52.623891 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-936109952 Jun 16 14:38:52.623891 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 1fb0ab38550645ff8ba685c655d7f0fc Jun 16 14:38:52.623891 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-936109952 Jun 16 14:38:52.623891 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin Jun 16 14:38:52.623891 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:52.623891 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:52.623891 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 7f4c4b4ec7c04168b8b15883b207cbee Jun 16 14:38:52.623891 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin Jun 16 14:38:52.623891 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:38:52.623891 n-d-836830-4 devstack@n-api.service[125863]: exception: No hypervisor matching '2a0c2724-3d80-40d9-af12-4e8ecc35bea7' could be found. Jun 16 14:38:52.623891 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '2a0c2724-3d80-40d9-af12-4e8ecc35bea7'} Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '2a0c2724-3d80-40d9-af12-4e8ecc35bea7' could be found. Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:52.624906 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:52.626239 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:52.626239 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:52.626239 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:38:52.626239 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:38:52.626239 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '2a0c2724-3d80-40d9-af12-4e8ecc35bea7' could be found. Jun 16 14:38:52.626239 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:52.628677 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2bb63b81-403c-4c2b-9387-1e56b62d9c76 tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] Returning 404 to user: No hypervisor matching '2a0c2724-3d80-40d9-af12-4e8ecc35bea7' could be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:52.633009 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2bb63b81-403c-4c2b-9387-1e56b62d9c76 tempest-HypervisorAdminNegativeUnderV252Test-936109952 tempest-HypervisorAdminNegativeUnderV252Test-936109952-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/2a0c2724-3d80-40d9-af12-4e8ecc35bea7/servers" status: 404 len: 123 microversion: 2.1 time: 0.045450 Jun 16 14:38:52.634333 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 260/480] 10.222.0.57 () {58 vars in 1280 bytes} [Thu Jun 16 14:38:52 2022] GET /compute/v2.1/os-hypervisors/2a0c2724-3d80-40d9-af12-4e8ecc35bea7/servers => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:38:52.702845 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d165975d-b260-4fc7-98e8-b39aff45afef tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1613 microversion: 2.1 time: 2.323891 Jun 16 14:38:52.706491 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 221/481] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:50 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1613 bytes in 2328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:52.731051 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ff98198e-e66e-4ffc-b151-a18b7d0833c6 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:52.731952 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ff98198e-e66e-4ffc-b151-a18b7d0833c6 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:52.755606 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ff98198e-e66e-4ffc-b151-a18b7d0833c6 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:52.756066 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ff98198e-e66e-4ffc-b151-a18b7d0833c6 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:52.756873 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ff98198e-e66e-4ffc-b151-a18b7d0833c6 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:52.757316 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ff98198e-e66e-4ffc-b151-a18b7d0833c6 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:53.076255 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-ff98198e-e66e-4ffc-b151-a18b7d0833c6 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] HTTP exception thrown: Cannot 'migrate' instance f66e919a-163e-401b-8211-4711f5ce7e07 while it is in vm_state suspended Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ff98198e-e66e-4ffc-b151-a18b7d0833c6 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Request method failure captured: Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07/action HTTP/1.1 Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 15 Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0A767KNhSJc6uXyQRNaCL2BkqH3h6vPtR6Szn_44glO3vdfPKKsC7TUgrH8QMB9XfXY_W4BJVykKpOGlcaKtL8b5JcCxMHWwQumvrgfidVsHXtlqc6qogVTNn_XgFbPex2zJOkUEhTITKA1Z7MxH2ltVDxeM0IsfWNNz00wVc7aQ0o Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 4f1b33829bfe4961a70fd14fa3e78adf Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1462614927 Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:38:53.079631 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:38:53.081706 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f1b33829bfe4961a70fd14fa3e78adf", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f1b33829bfe4961a70fd14fa3e78adf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f1b33829bfe4961a70fd14fa3e78adf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f1b33829bfe4961a70fd14fa3e78adf"}]}] Jun 16 14:38:53.081706 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1462614927 Jun 16 14:38:53.081706 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 4f1b33829bfe4961a70fd14fa3e78adf Jun 16 14:38:53.081706 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1462614927 Jun 16 14:38:53.081706 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersAdminNegativeTestJSON-1462614927-project-admin Jun 16 14:38:53.081706 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:53.081706 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:53.081706 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 18caeaed4c2242efb0508548d8126a49 Jun 16 14:38:53.081706 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1462614927-project-admin Jun 16 14:38:53.081706 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:38:53.081706 n-d-836830-4 devstack@n-api.service[125863]: {"migrate": {}} Jun 16 14:38:53.081706 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:38:53.081706 n-d-836830-4 devstack@n-api.service[125863]: exception: Cannot 'migrate' instance f66e919a-163e-401b-8211-4711f5ce7e07 while it is in vm_state suspended Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'f66e919a-163e-401b-8211-4711f5ce7e07', 'body': {'migrate': {}}} Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f66e919a-163e-401b-8211-4711f5ce7e07 in vm_state suspended. Cannot resize while the instance is in this state. Jun 16 14:38:53.082593 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance f66e919a-163e-401b-8211-4711f5ce7e07 while it is in vm_state suspended Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.083735 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:53.084966 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:53.084966 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:53.084966 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:38:53.084966 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:38:53.084966 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance f66e919a-163e-401b-8211-4711f5ce7e07 while it is in vm_state suspended Jun 16 14:38:53.084966 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.094523 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ff98198e-e66e-4ffc-b151-a18b7d0833c6 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Returning 409 to user: Cannot 'migrate' instance f66e919a-163e-401b-8211-4711f5ce7e07 while it is in vm_state suspended {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:53.095792 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ff98198e-e66e-4ffc-b151-a18b7d0833c6 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07/action" status: 409 len: 148 microversion: 2.1 time: 0.368990 Jun 16 14:38:53.109588 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ecf7dc1b-204c-401d-b569-1dc28d0bce0e tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ecf7dc1b-204c-401d-b569-1dc28d0bce0e tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Request method failure captured: Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa/action HTTP/1.1 Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 39 Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0A767KNhSJc6uXyQRNaCL2BkqH3h6vPtR6Szn_44glO3vdfPKKsC7TUgrH8QMB9XfXY_W4BJVykKpOGlcaKtL8b5JcCxMHWwQumvrgfidVsHXtlqc6qogVTNn_XgFbPex2zJOkUEhTITKA1Z7MxH2ltVDxeM0IsfWNNz00wVc7aQ0o Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 4f1b33829bfe4961a70fd14fa3e78adf Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1462614927 Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:38:53.123098 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:38:53.124536 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f1b33829bfe4961a70fd14fa3e78adf", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f1b33829bfe4961a70fd14fa3e78adf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f1b33829bfe4961a70fd14fa3e78adf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f1b33829bfe4961a70fd14fa3e78adf"}]}] Jun 16 14:38:53.124536 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1462614927 Jun 16 14:38:53.124536 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 4f1b33829bfe4961a70fd14fa3e78adf Jun 16 14:38:53.124536 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1462614927 Jun 16 14:38:53.124536 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ServersAdminNegativeTestJSON-1462614927-project-admin Jun 16 14:38:53.124536 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:38:53.124536 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:38:53.124536 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 18caeaed4c2242efb0508548d8126a49 Jun 16 14:38:53.124536 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1462614927-project-admin Jun 16 14:38:53.124536 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:38:53.124536 n-d-836830-4 devstack@n-api.service[125862]: {"os-resetState": {"state": "invalid"}} Jun 16 14:38:53.124536 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'f15993a1-48b8-4267-869d-8e98bf19cdaa', 'body': {'os-resetState': {'state': 'invalid'}}} Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'invalid' Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:53.125253 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:38:53.126837 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 16 14:38:53.128482 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.136979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ecf7dc1b-204c-401d-b569-1dc28d0bce0e tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:53.141093 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 261/482] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:38:52 2022] POST /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07/action => generated 148 bytes in 415 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:38:53.143640 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ecf7dc1b-204c-401d-b569-1dc28d0bce0e tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa/action" status: 400 len: 144 microversion: 2.1 time: 0.038042 Jun 16 14:38:53.162633 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 222/483] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:38:53 2022] POST /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa/action => generated 144 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:38:53.172872 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-73806a3e-8f59-4c99-96e5-57cb9a3ea77b tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-73806a3e-8f59-4c99-96e5-57cb9a3ea77b tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Request method failure captured: Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa/action HTTP/1.1 Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 31 Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0A767KNhSJc6uXyQRNaCL2BkqH3h6vPtR6Szn_44glO3vdfPKKsC7TUgrH8QMB9XfXY_W4BJVykKpOGlcaKtL8b5JcCxMHWwQumvrgfidVsHXtlqc6qogVTNn_XgFbPex2zJOkUEhTITKA1Z7MxH2ltVDxeM0IsfWNNz00wVc7aQ0o Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 4f1b33829bfe4961a70fd14fa3e78adf Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1462614927 Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:38:53.185202 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:38:53.186874 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f1b33829bfe4961a70fd14fa3e78adf", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f1b33829bfe4961a70fd14fa3e78adf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f1b33829bfe4961a70fd14fa3e78adf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f1b33829bfe4961a70fd14fa3e78adf"}]}] Jun 16 14:38:53.186874 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1462614927 Jun 16 14:38:53.186874 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 4f1b33829bfe4961a70fd14fa3e78adf Jun 16 14:38:53.186874 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1462614927 Jun 16 14:38:53.186874 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersAdminNegativeTestJSON-1462614927-project-admin Jun 16 14:38:53.186874 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:38:53.186874 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:38:53.186874 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 18caeaed4c2242efb0508548d8126a49 Jun 16 14:38:53.186874 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1462614927-project-admin Jun 16 14:38:53.186874 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:38:53.186874 n-d-836830-4 devstack@n-api.service[125863]: {"os-resetState": {"state": 1}} Jun 16 14:38:53.186874 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:38:53.186874 n-d-836830-4 devstack@n-api.service[125863]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'f15993a1-48b8-4267-869d-8e98bf19cdaa', 'body': {'os-resetState': {'state': 1}}} Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 1 Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:53.187688 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 16 14:38:53.189017 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.190708 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-73806a3e-8f59-4c99-96e5-57cb9a3ea77b tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:53.190708 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-73806a3e-8f59-4c99-96e5-57cb9a3ea77b tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa/action" status: 400 len: 120 microversion: 2.1 time: 0.024512 Jun 16 14:38:53.198987 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 262/484] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:38:53 2022] POST /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa/action => generated 120 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:38:53.204997 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5d734c71-92d9-4ba8-82df-4764a2939ce7 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:53.208683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5d734c71-92d9-4ba8-82df-4764a2939ce7 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Failed to fetch instance by id 999 {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 16 14:38:53.208683 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-5d734c71-92d9-4ba8-82df-4764a2939ce7 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] HTTP exception thrown: Instance 999 could not be found. Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5d734c71-92d9-4ba8-82df-4764a2939ce7 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Request method failure captured: Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 37 Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0A767KNhSJc6uXyQRNaCL2BkqH3h6vPtR6Szn_44glO3vdfPKKsC7TUgrH8QMB9XfXY_W4BJVykKpOGlcaKtL8b5JcCxMHWwQumvrgfidVsHXtlqc6qogVTNn_XgFbPex2zJOkUEhTITKA1Z7MxH2ltVDxeM0IsfWNNz00wVc7aQ0o Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 4f1b33829bfe4961a70fd14fa3e78adf Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1462614927 Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:38:53.217267 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:38:53.218704 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f1b33829bfe4961a70fd14fa3e78adf", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f1b33829bfe4961a70fd14fa3e78adf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f1b33829bfe4961a70fd14fa3e78adf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f1b33829bfe4961a70fd14fa3e78adf"}]}] Jun 16 14:38:53.218704 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1462614927 Jun 16 14:38:53.218704 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 4f1b33829bfe4961a70fd14fa3e78adf Jun 16 14:38:53.218704 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1462614927 Jun 16 14:38:53.218704 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ServersAdminNegativeTestJSON-1462614927-project-admin Jun 16 14:38:53.218704 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:38:53.218704 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:38:53.218704 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 18caeaed4c2242efb0508548d8126a49 Jun 16 14:38:53.218704 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1462614927-project-admin Jun 16 14:38:53.218704 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:38:53.218704 n-d-836830-4 devstack@n-api.service[125862]: {"os-resetState": {"state": "error"}} Jun 16 14:38:53.218704 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:38:53.218704 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 999 could not be found. Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:38:53.219656 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5d734c71-92d9-4ba8-82df-4764a2939ce7 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:38:53.221025 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5d734c71-92d9-4ba8-82df-4764a2939ce7 tempest-ServersAdminNegativeTestJSON-1462614927 tempest-ServersAdminNegativeTestJSON-1462614927-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.019364 Jun 16 14:38:53.230177 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 223/485] 10.222.0.57 () {60 vars in 1178 bytes} [Thu Jun 16 14:38:53 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:38:53.242879 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9d457286-04f6-4afb-8ee6-44a1ccb74f11 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:53.244778 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9d457286-04f6-4afb-8ee6-44a1ccb74f11 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:53.283503 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9d457286-04f6-4afb-8ee6-44a1ccb74f11 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:53.286920 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9d457286-04f6-4afb-8ee6-44a1ccb74f11 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:53.289730 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9d457286-04f6-4afb-8ee6-44a1ccb74f11 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:53.292911 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9d457286-04f6-4afb-8ee6-44a1ccb74f11 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:53.381909 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9d457286-04f6-4afb-8ee6-44a1ccb74f11 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:38:53.581413 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-02b510e3-7541-402d-9d55-b291a113b5b4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:53.589307 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-02b510e3-7541-402d-9d55-b291a113b5b4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:53.611133 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02b510e3-7541-402d-9d55-b291a113b5b4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:53.617301 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02b510e3-7541-402d-9d55-b291a113b5b4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:53.618466 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02b510e3-7541-402d-9d55-b291a113b5b4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:53.626660 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02b510e3-7541-402d-9d55-b291a113b5b4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:53.807872 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9d457286-04f6-4afb-8ee6-44a1ccb74f11 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 204 len: 0 microversion: 2.1 time: 0.576113 Jun 16 14:38:53.812124 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 263/486] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:38:53 2022] DELETE /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:38:53.838593 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-83a72560-7d25-452f-9e2a-bebf3ed78b26 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:53.839239 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-83a72560-7d25-452f-9e2a-bebf3ed78b26 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:53.863103 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-83a72560-7d25-452f-9e2a-bebf3ed78b26 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:53.863525 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-83a72560-7d25-452f-9e2a-bebf3ed78b26 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:53.864536 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-83a72560-7d25-452f-9e2a-bebf3ed78b26 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:53.865150 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-83a72560-7d25-452f-9e2a-bebf3ed78b26 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:54.499851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-83a72560-7d25-452f-9e2a-bebf3ed78b26 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:54.516472 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-83a72560-7d25-452f-9e2a-bebf3ed78b26 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1468 microversion: 2.1 time: 0.696738 Jun 16 14:38:54.535696 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 264/487] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:53 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1468 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:54.848549 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-02b510e3-7541-402d-9d55-b291a113b5b4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:54.865219 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-02b510e3-7541-402d-9d55-b291a113b5b4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1504 microversion: 2.1 time: 1.300771 Jun 16 14:38:54.866426 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 224/488] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:53 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1504 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:55.339848 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-e5c18d75-1cfd-403b-be40-7c55cd3422bc req-33a20cc9-2f16-400b-9c4c-4b7a7b8cdc2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041bdae6-9e2f-4508-bd7b-51bcc2666b7f", "name": "network-vif-unplugged", "status": "completed", "tag": "96b3e2f5-fedd-4636-8ce3-e8b768044f69"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:38:55.363206 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-e5c18d75-1cfd-403b-be40-7c55cd3422bc req-33a20cc9-2f16-400b-9c4c-4b7a7b8cdc2d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:55.368165 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-e5c18d75-1cfd-403b-be40-7c55cd3422bc req-33a20cc9-2f16-400b-9c4c-4b7a7b8cdc2d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:55.416423 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-e5c18d75-1cfd-403b-be40-7c55cd3422bc req-33a20cc9-2f16-400b-9c4c-4b7a7b8cdc2d service nova] Creating event network-vif-unplugged:96b3e2f5-fedd-4636-8ce3-e8b768044f69 for instance 041bdae6-9e2f-4508-bd7b-51bcc2666b7f on n-h2-836830-4 Jun 16 14:38:55.432822 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-e5c18d75-1cfd-403b-be40-7c55cd3422bc req-33a20cc9-2f16-400b-9c4c-4b7a7b8cdc2d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100212 Jun 16 14:38:55.435941 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 265/489] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:38:55.567023 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cffa819a-d5e9-4e3c-b3a4-57d6f9f13eba tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:55.567953 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cffa819a-d5e9-4e3c-b3a4-57d6f9f13eba tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:55.585489 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cffa819a-d5e9-4e3c-b3a4-57d6f9f13eba tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:55.586714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cffa819a-d5e9-4e3c-b3a4-57d6f9f13eba tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:55.588828 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cffa819a-d5e9-4e3c-b3a4-57d6f9f13eba tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:55.590460 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cffa819a-d5e9-4e3c-b3a4-57d6f9f13eba tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:55.886330 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a5421037-8d2b-4882-a9e9-8eb90b4798e8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:55.887104 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a5421037-8d2b-4882-a9e9-8eb90b4798e8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:55.922015 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5421037-8d2b-4882-a9e9-8eb90b4798e8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:55.928120 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5421037-8d2b-4882-a9e9-8eb90b4798e8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:55.929267 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5421037-8d2b-4882-a9e9-8eb90b4798e8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:55.937085 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5421037-8d2b-4882-a9e9-8eb90b4798e8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:56.468532 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a5421037-8d2b-4882-a9e9-8eb90b4798e8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:56.517572 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a5421037-8d2b-4882-a9e9-8eb90b4798e8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1504 microversion: 2.1 time: 0.628631 Jun 16 14:38:56.520783 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 266/490] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:55 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1504 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:57.383480 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cffa819a-d5e9-4e3c-b3a4-57d6f9f13eba tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:57.400483 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cffa819a-d5e9-4e3c-b3a4-57d6f9f13eba tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1468 microversion: 2.1 time: 1.839358 Jun 16 14:38:57.401432 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 225/491] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:55 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1468 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:57.553971 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ebe61ce7-18eb-4553-9e31-d5aa875e574c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:57.555736 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ebe61ce7-18eb-4553-9e31-d5aa875e574c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:57.597820 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ebe61ce7-18eb-4553-9e31-d5aa875e574c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:57.599220 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ebe61ce7-18eb-4553-9e31-d5aa875e574c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:57.601675 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ebe61ce7-18eb-4553-9e31-d5aa875e574c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:57.603225 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ebe61ce7-18eb-4553-9e31-d5aa875e574c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:58.425229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-143a5543-306e-40d4-92fd-d116e570449b tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:58.426593 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-143a5543-306e-40d4-92fd-d116e570449b tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:58.448127 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-143a5543-306e-40d4-92fd-d116e570449b tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:58.448594 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-143a5543-306e-40d4-92fd-d116e570449b tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:58.449637 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-143a5543-306e-40d4-92fd-d116e570449b tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:58.450091 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-143a5543-306e-40d4-92fd-d116e570449b tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:58.675717 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ebe61ce7-18eb-4553-9e31-d5aa875e574c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:58.697229 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ebe61ce7-18eb-4553-9e31-d5aa875e574c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1504 microversion: 2.1 time: 1.157247 Jun 16 14:38:58.718336 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 267/492] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:57 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1504 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:59.429378 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-143a5543-306e-40d4-92fd-d116e570449b tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:38:59.453084 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-143a5543-306e-40d4-92fd-d116e570449b tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1468 microversion: 2.1 time: 1.029772 Jun 16 14:38:59.461061 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 226/493] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:58 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1468 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:38:59.732530 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b937b00b-7369-4013-b6be-e1a84944586d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:38:59.735171 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b937b00b-7369-4013-b6be-e1a84944586d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:38:59.755940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b937b00b-7369-4013-b6be-e1a84944586d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:59.756802 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b937b00b-7369-4013-b6be-e1a84944586d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:38:59.771622 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b937b00b-7369-4013-b6be-e1a84944586d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:38:59.802871 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b937b00b-7369-4013-b6be-e1a84944586d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:00.703609 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cafc78df-f91c-4be3-84f1-4f751cf1b604 tempest-HypervisorAdminV228Test-1634758759 tempest-HypervisorAdminV228Test-1634758759-project-admin] Calling method '.version_select at 0x7fdf0c4a2ca0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:00.704645 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:39:00.704645 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:39:00.706647 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cafc78df-f91c-4be3-84f1-4f751cf1b604 tempest-HypervisorAdminV228Test-1634758759 tempest-HypervisorAdminV228Test-1634758759-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:00.713427 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cafc78df-f91c-4be3-84f1-4f751cf1b604 tempest-HypervisorAdminV228Test-1634758759 tempest-HypervisorAdminV228Test-1634758759-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:00.782591 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cafc78df-f91c-4be3-84f1-4f751cf1b604 tempest-HypervisorAdminV228Test-1634758759 tempest-HypervisorAdminV228Test-1634758759-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:00.786540 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cafc78df-f91c-4be3-84f1-4f751cf1b604 tempest-HypervisorAdminV228Test-1634758759 tempest-HypervisorAdminV228Test-1634758759-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:00.851409 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cafc78df-f91c-4be3-84f1-4f751cf1b604 tempest-HypervisorAdminV228Test-1634758759 tempest-HypervisorAdminV228Test-1634758759-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:00.868838 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cafc78df-f91c-4be3-84f1-4f751cf1b604 tempest-HypervisorAdminV228Test-1634758759 tempest-HypervisorAdminV228Test-1634758759-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:00.892693 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cafc78df-f91c-4be3-84f1-4f751cf1b604 tempest-HypervisorAdminV228Test-1634758759 tempest-HypervisorAdminV228Test-1634758759-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 1.446993 Jun 16 14:39:00.907403 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 268/494] 10.222.0.57 () {60 vars in 1186 bytes} [Thu Jun 16 14:38:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:39:00.925232 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-16ccb769-8677-4c06-931a-ecb97023faba req-0704865d-ac7e-429f-bf89-3f39f50c241b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66e919a-163e-401b-8211-4711f5ce7e07", "name": "network-vif-unplugged", "status": "completed", "tag": "fb7f9870-cb65-4faa-b023-61d84c6e5436"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:00.960259 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-16ccb769-8677-4c06-931a-ecb97023faba req-0704865d-ac7e-429f-bf89-3f39f50c241b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:00.962984 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-16ccb769-8677-4c06-931a-ecb97023faba req-0704865d-ac7e-429f-bf89-3f39f50c241b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:00.980125 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:01.021866 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-16ccb769-8677-4c06-931a-ecb97023faba req-0704865d-ac7e-429f-bf89-3f39f50c241b service nova] Creating event network-vif-unplugged:fb7f9870-cb65-4faa-b023-61d84c6e5436 for instance f66e919a-163e-401b-8211-4711f5ce7e07 on n-h1-836830-4 Jun 16 14:39:01.064362 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-16ccb769-8677-4c06-931a-ecb97023faba req-0704865d-ac7e-429f-bf89-3f39f50c241b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152954 Jun 16 14:39:01.066481 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 269/495] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:01.076402 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-479daa57-eeff-4afa-aae4-b536b106758e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:01.085876 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-479daa57-eeff-4afa-aae4-b536b106758e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:01.108605 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-479daa57-eeff-4afa-aae4-b536b106758e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:01.109075 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-479daa57-eeff-4afa-aae4-b536b106758e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:01.109903 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-479daa57-eeff-4afa-aae4-b536b106758e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:01.115864 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-479daa57-eeff-4afa-aae4-b536b106758e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:01.442898 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-479daa57-eeff-4afa-aae4-b536b106758e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:01.462126 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-479daa57-eeff-4afa-aae4-b536b106758e tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1426 microversion: 2.1 time: 0.393466 Jun 16 14:39:01.475329 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 270/496] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:01 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1426 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:01.492839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9827e8b5-2420-4b22-9738-773fcf1eb79e tempest-HypervisorAdminV228Test-1634758759 tempest-HypervisorAdminV228Test-1634758759-project-admin] Calling method '.version_select at 0x7fdf0c43f040>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:01.494160 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:39:01.494160 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:39:01.502373 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9827e8b5-2420-4b22-9738-773fcf1eb79e tempest-HypervisorAdminV228Test-1634758759 tempest-HypervisorAdminV228Test-1634758759-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:01.503776 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9827e8b5-2420-4b22-9738-773fcf1eb79e tempest-HypervisorAdminV228Test-1634758759 tempest-HypervisorAdminV228Test-1634758759-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:01.532469 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9827e8b5-2420-4b22-9738-773fcf1eb79e tempest-HypervisorAdminV228Test-1634758759 tempest-HypervisorAdminV228Test-1634758759-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:01.532942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9827e8b5-2420-4b22-9738-773fcf1eb79e tempest-HypervisorAdminV228Test-1634758759 tempest-HypervisorAdminV228Test-1634758759-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:01.555572 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9827e8b5-2420-4b22-9738-773fcf1eb79e tempest-HypervisorAdminV228Test-1634758759 tempest-HypervisorAdminV228Test-1634758759-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.077595 Jun 16 14:39:01.559335 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 271/497] 10.222.0.57 () {60 vars in 1192 bytes} [Thu Jun 16 14:39:01 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:39:01.797010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b937b00b-7369-4013-b6be-e1a84944586d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:01.817552 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b937b00b-7369-4013-b6be-e1a84944586d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1504 microversion: 2.1 time: 2.081553 Jun 16 14:39:01.821287 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 227/498] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:38:59 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1504 bytes in 2093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:02.482592 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5c87e7de-29aa-450a-9b02-de8648d960ad tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:02.484098 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5c87e7de-29aa-450a-9b02-de8648d960ad tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:02.508092 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c87e7de-29aa-450a-9b02-de8648d960ad tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:02.515462 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c87e7de-29aa-450a-9b02-de8648d960ad tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:02.516932 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c87e7de-29aa-450a-9b02-de8648d960ad tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:02.525446 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c87e7de-29aa-450a-9b02-de8648d960ad tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:02.612911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-62ae717c-a0da-4973-8655-9b87647d0032 req-40582a15-6551-4947-8836-124bb0240b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66e919a-163e-401b-8211-4711f5ce7e07", "name": "network-vif-deleted", "tag": "fb7f9870-cb65-4faa-b023-61d84c6e5436"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:02.673866 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-62ae717c-a0da-4973-8655-9b87647d0032 req-40582a15-6551-4947-8836-124bb0240b80 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:02.675751 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-62ae717c-a0da-4973-8655-9b87647d0032 req-40582a15-6551-4947-8836-124bb0240b80 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:02.872457 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-62ae717c-a0da-4973-8655-9b87647d0032 req-40582a15-6551-4947-8836-124bb0240b80 service nova] Creating event network-vif-deleted:fb7f9870-cb65-4faa-b023-61d84c6e5436 for instance f66e919a-163e-401b-8211-4711f5ce7e07 on n-h1-836830-4 Jun 16 14:39:02.897100 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-62ae717c-a0da-4973-8655-9b87647d0032 req-40582a15-6551-4947-8836-124bb0240b80 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.298819 Jun 16 14:39:02.904778 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 228/499] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:02.937557 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-930f69e6-38c2-47de-95a5-d31ba1066b16 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:02.938794 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-930f69e6-38c2-47de-95a5-d31ba1066b16 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:02.959549 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-930f69e6-38c2-47de-95a5-d31ba1066b16 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:02.969707 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-930f69e6-38c2-47de-95a5-d31ba1066b16 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:02.971134 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-930f69e6-38c2-47de-95a5-d31ba1066b16 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:02.973221 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-930f69e6-38c2-47de-95a5-d31ba1066b16 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:03.043983 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5c87e7de-29aa-450a-9b02-de8648d960ad tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:03.074038 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5c87e7de-29aa-450a-9b02-de8648d960ad tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 200 len: 1426 microversion: 2.1 time: 0.596664 Jun 16 14:39:03.100957 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 272/500] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:02 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 1426 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:04.131878 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-94751aac-86bd-49fb-baf8-014d9551a3cd tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:04.132772 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-94751aac-86bd-49fb-baf8-014d9551a3cd tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f66e919a-163e-401b-8211-4711f5ce7e07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:04.144667 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-94751aac-86bd-49fb-baf8-014d9551a3cd tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:04.155598 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-94751aac-86bd-49fb-baf8-014d9551a3cd tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:04.160461 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-94751aac-86bd-49fb-baf8-014d9551a3cd tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:04.166845 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-94751aac-86bd-49fb-baf8-014d9551a3cd tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:04.210910 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-94751aac-86bd-49fb-baf8-014d9551a3cd tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] HTTP exception thrown: Instance f66e919a-163e-401b-8211-4711f5ce7e07 could not be found. Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-94751aac-86bd-49fb-baf8-014d9551a3cd tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Request method failure captured: Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 HTTP/1.1 Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0A5Te_7LwXu76_YZOe-WKFkUJhtAXZeMNaZaDrrhC-_uZKQAGUfNGzPm9lmIrBMlXcFCaypnleLigP23Ox3xqmFAN1h1RjCLuRe5GT80jx7IeR9DHb1VAsDYuBcqbxLb-ZJDH1BitsKozH7mAYZJaPpWQ7MqMmYJxaf0raFoS2D1xc Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 8fe5a789f66b4837b0c4f5f0c68ff7b1 Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1152593654 Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:39:04.219774 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:39:04.221163 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fe5a789f66b4837b0c4f5f0c68ff7b1", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fe5a789f66b4837b0c4f5f0c68ff7b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fe5a789f66b4837b0c4f5f0c68ff7b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fe5a789f66b4837b0c4f5f0c68ff7b1"}]}] Jun 16 14:39:04.221163 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1152593654 Jun 16 14:39:04.221163 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 8fe5a789f66b4837b0c4f5f0c68ff7b1 Jun 16 14:39:04.221163 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1152593654 Jun 16 14:39:04.221163 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersAdminNegativeTestJSON-1152593654-project Jun 16 14:39:04.221163 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:39:04.221163 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:39:04.221163 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: f88bdba610f44f86aafb6bd31222fbcd Jun 16 14:39:04.221163 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1152593654-project Jun 16 14:39:04.221163 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:39:04.221163 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance f66e919a-163e-401b-8211-4711f5ce7e07 could not be found. Jun 16 14:39:04.221163 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'f66e919a-163e-401b-8211-4711f5ce7e07'} Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f66e919a-163e-401b-8211-4711f5ce7e07 could not be found. Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:39:04.222517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f66e919a-163e-401b-8211-4711f5ce7e07 could not be found. Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f66e919a-163e-401b-8211-4711f5ce7e07 could not be found. Jun 16 14:39:04.225550 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:39:04.233051 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-94751aac-86bd-49fb-baf8-014d9551a3cd tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Returning 404 to user: Instance f66e919a-163e-401b-8211-4711f5ce7e07 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:39:04.234892 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-94751aac-86bd-49fb-baf8-014d9551a3cd tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07" status: 404 len: 111 microversion: 2.1 time: 0.108782 Jun 16 14:39:04.243000 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 273/501] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:04 2022] GET /compute/v2.1/servers/f66e919a-163e-401b-8211-4711f5ce7e07 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:39:04.255859 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8051bb54-cef6-49dd-83fc-c386cc139218 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:04.262878 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8051bb54-cef6-49dd-83fc-c386cc139218 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:04.278496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8051bb54-cef6-49dd-83fc-c386cc139218 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:04.279254 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8051bb54-cef6-49dd-83fc-c386cc139218 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:04.280489 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8051bb54-cef6-49dd-83fc-c386cc139218 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:04.281111 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8051bb54-cef6-49dd-83fc-c386cc139218 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:04.363511 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8051bb54-cef6-49dd-83fc-c386cc139218 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:39:04.564858 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:RELEASE=5,nova_api:SAVEPOINT=4,nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=5 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:04.584784 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8051bb54-cef6-49dd-83fc-c386cc139218 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 204 len: 0 microversion: 2.1 time: 0.333051 Jun 16 14:39:04.585442 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 274/502] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:39:04 2022] DELETE /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 14:39:04.598173 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e4997b6c-00b3-4248-8ea6-91b58c911357 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:04.599350 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e4997b6c-00b3-4248-8ea6-91b58c911357 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:04.618954 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4997b6c-00b3-4248-8ea6-91b58c911357 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:04.622054 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4997b6c-00b3-4248-8ea6-91b58c911357 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:04.626087 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4997b6c-00b3-4248-8ea6-91b58c911357 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:04.630011 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4997b6c-00b3-4248-8ea6-91b58c911357 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:05.538211 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e4997b6c-00b3-4248-8ea6-91b58c911357 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:05.554095 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e4997b6c-00b3-4248-8ea6-91b58c911357 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1478 microversion: 2.1 time: 0.956342 Jun 16 14:39:05.563859 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 275/503] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:04 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1478 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:39:05.759225 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-930f69e6-38c2-47de-95a5-d31ba1066b16 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:05.782771 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-930f69e6-38c2-47de-95a5-d31ba1066b16 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1479 microversion: 2.1 time: 2.874528 Jun 16 14:39:05.790879 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 229/504] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:02 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1479 bytes in 2886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:05.823811 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b3bb5848-c2d8-46e2-884a-0c7ec4d7da81 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '.version_select at 0x7fdf0cb51e50>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:05.840892 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b3bb5848-c2d8-46e2-884a-0c7ec4d7da81 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:05.853851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b3bb5848-c2d8-46e2-884a-0c7ec4d7da81 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:05.901225 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b3bb5848-c2d8-46e2-884a-0c7ec4d7da81 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 784 microversion: 2.1 time: 0.085488 Jun 16 14:39:05.909991 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 276/505] 10.222.0.57 () {58 vars in 1142 bytes} [Thu Jun 16 14:39:05 2022] GET /compute/v2.1/os-migrations => generated 784 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:05.932290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b18c5117-fa97-4acd-9e1e-13487df5aade tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:05.933034 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b18c5117-fa97-4acd-9e1e-13487df5aade tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:05.972081 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b18c5117-fa97-4acd-9e1e-13487df5aade tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:05.981740 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b18c5117-fa97-4acd-9e1e-13487df5aade tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:05.988987 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b18c5117-fa97-4acd-9e1e-13487df5aade tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:05.994714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b18c5117-fa97-4acd-9e1e-13487df5aade tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:06.573810 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6a564285-7168-4905-a897-dcc189b63622 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:06.574590 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6a564285-7168-4905-a897-dcc189b63622 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:06.584089 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6a564285-7168-4905-a897-dcc189b63622 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:06.584662 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6a564285-7168-4905-a897-dcc189b63622 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:06.585604 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6a564285-7168-4905-a897-dcc189b63622 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:06.587522 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6a564285-7168-4905-a897-dcc189b63622 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:07.376309 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6a564285-7168-4905-a897-dcc189b63622 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:07.410025 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6a564285-7168-4905-a897-dcc189b63622 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1478 microversion: 2.1 time: 0.839243 Jun 16 14:39:07.432712 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 277/506] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:06 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1478 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:07.937504 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b18c5117-fa97-4acd-9e1e-13487df5aade tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1630 microversion: 2.1 time: 2.007831 Jun 16 14:39:07.954766 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 230/507] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:05 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1630 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:07.993567 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f3317034-15f2-4ee2-9c0b-75ddeb3d083b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Action: 'create', calling method: .version_select at 0x7fdf0c7d43a0>, body: {"keypair": {"name": "tempest-keypair-107457352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3NAHC/Omb3IqilWtHcvrqW9qUR9KaMrM/N+/lteCP06Z4LNB8KeBkIK4xo4EHhumUg6Xy+FCUABZ50+ETSeMaMLVBw7Ts6V4nSpNAPcQj2x9Dkcaehc73oo612SLQxVg=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:08.071522 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-f3317034-15f2-4ee2-9c0b-75ddeb3d083b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Getting quotas for project b0484f4c1c304b84a88b7d2be3b9483c. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:39:08.109199 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-f3317034-15f2-4ee2-9c0b-75ddeb3d083b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Getting quotas for user 96fb5660c35642ad9da6d8bb34e393f4 and project b0484f4c1c304b84a88b7d2be3b9483c. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:39:08.292452 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f3317034-15f2-4ee2-9c0b-75ddeb3d083b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.320520 Jun 16 14:39:08.299194 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 278/508] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:39:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:08.441786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-da0d9f60-b8ac-4bb0-b760-d2f84a9f9850 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:08.443031 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-da0d9f60-b8ac-4bb0-b760-d2f84a9f9850 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:08.469349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-da0d9f60-b8ac-4bb0-b760-d2f84a9f9850 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:08.470040 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-da0d9f60-b8ac-4bb0-b760-d2f84a9f9850 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:08.470940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-da0d9f60-b8ac-4bb0-b760-d2f84a9f9850 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:08.484398 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-da0d9f60-b8ac-4bb0-b760-d2f84a9f9850 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:10.316398 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fda18683-9a2f-4542-8593-3d0e1e134eb2 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Calling method '.version_select at 0x7fdf0c407af0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:10.946123 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-da0d9f60-b8ac-4bb0-b760-d2f84a9f9850 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88bdba610f44f86aafb6bd31222fbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe5a789f66b4837b0c4f5f0c68ff7b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:10.958352 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fda18683-9a2f-4542-8593-3d0e1e134eb2 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/bb33e5db3f424636a11cbc6e60979c5f" status: 200 len: 371 microversion: 2.1 time: 1.804302 Jun 16 14:39:10.974781 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 279/509] 10.222.0.57 () {58 vars in 1241 bytes} [Thu Jun 16 14:39:09 2022] GET /compute/v2.1/os-quota-sets/bb33e5db3f424636a11cbc6e60979c5f => generated 371 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:10.980608 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-39e38305-c5ab-4a3e-b033-44252d4fd1a3 req-d318b7e5-1370-43d5-a86c-5026fb09795a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f15993a1-48b8-4267-869d-8e98bf19cdaa", "name": "network-vif-deleted", "tag": "ca1af4e3-3d7e-4f00-ba23-5993bdef5ea5"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:11.002580 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-39e38305-c5ab-4a3e-b033-44252d4fd1a3 req-d318b7e5-1370-43d5-a86c-5026fb09795a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:11.005173 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-da0d9f60-b8ac-4bb0-b760-d2f84a9f9850 tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 200 len: 1478 microversion: 2.1 time: 2.562151 Jun 16 14:39:11.006237 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-39e38305-c5ab-4a3e-b033-44252d4fd1a3 req-d318b7e5-1370-43d5-a86c-5026fb09795a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:11.006397 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 231/510] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:08 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 1478 bytes in 2570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:11.033552 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-39e38305-c5ab-4a3e-b033-44252d4fd1a3 req-d318b7e5-1370-43d5-a86c-5026fb09795a service nova] Creating event network-vif-deleted:ca1af4e3-3d7e-4f00-ba23-5993bdef5ea5 for instance f15993a1-48b8-4267-869d-8e98bf19cdaa on n-h1-836830-4 Jun 16 14:39:11.049566 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-39e38305-c5ab-4a3e-b033-44252d4fd1a3 req-d318b7e5-1370-43d5-a86c-5026fb09795a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069903 Jun 16 14:39:11.056053 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 280/511] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:11.061049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0e56bb5c-ac08-492d-aa24-4201d2f21aae tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0c86d280>, body: {"quota_set": {"ram": "5120"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:11.801843 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0e56bb5c-ac08-492d-aa24-4201d2f21aae tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:11.804732 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0e56bb5c-ac08-492d-aa24-4201d2f21aae tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:11.806104 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0e56bb5c-ac08-492d-aa24-4201d2f21aae tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:11.807174 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0e56bb5c-ac08-492d-aa24-4201d2f21aae tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:12.028001 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cae432ea-beaa-4aaa-afb7-07316508ef6d tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:12.029533 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cae432ea-beaa-4aaa-afb7-07316508ef6d tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] [instance: f15993a1-48b8-4267-869d-8e98bf19cdaa] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:12.053955 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cae432ea-beaa-4aaa-afb7-07316508ef6d tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:12.054891 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cae432ea-beaa-4aaa-afb7-07316508ef6d tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:12.056493 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cae432ea-beaa-4aaa-afb7-07316508ef6d tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:12.058363 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cae432ea-beaa-4aaa-afb7-07316508ef6d tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:12.081353 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-cae432ea-beaa-4aaa-afb7-07316508ef6d tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] HTTP exception thrown: Instance f15993a1-48b8-4267-869d-8e98bf19cdaa could not be found. Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cae432ea-beaa-4aaa-afb7-07316508ef6d tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Request method failure captured: Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa HTTP/1.1 Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0A5Te_7LwXu76_YZOe-WKFkUJhtAXZeMNaZaDrrhC-_uZKQAGUfNGzPm9lmIrBMlXcFCaypnleLigP23Ox3xqmFAN1h1RjCLuRe5GT80jx7IeR9DHb1VAsDYuBcqbxLb-ZJDH1BitsKozH7mAYZJaPpWQ7MqMmYJxaf0raFoS2D1xc Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 8fe5a789f66b4837b0c4f5f0c68ff7b1 Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1152593654 Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:39:12.084453 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:39:12.085842 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8fe5a789f66b4837b0c4f5f0c68ff7b1", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fe5a789f66b4837b0c4f5f0c68ff7b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8fe5a789f66b4837b0c4f5f0c68ff7b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8fe5a789f66b4837b0c4f5f0c68ff7b1"}]}] Jun 16 14:39:12.085842 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1152593654 Jun 16 14:39:12.085842 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 8fe5a789f66b4837b0c4f5f0c68ff7b1 Jun 16 14:39:12.085842 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1152593654 Jun 16 14:39:12.085842 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersAdminNegativeTestJSON-1152593654-project Jun 16 14:39:12.085842 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:39:12.085842 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:39:12.085842 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: f88bdba610f44f86aafb6bd31222fbcd Jun 16 14:39:12.085842 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1152593654-project Jun 16 14:39:12.085842 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:39:12.085842 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance f15993a1-48b8-4267-869d-8e98bf19cdaa could not be found. Jun 16 14:39:12.085842 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'f15993a1-48b8-4267-869d-8e98bf19cdaa'} Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f15993a1-48b8-4267-869d-8e98bf19cdaa could not be found. Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:39:12.086652 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f15993a1-48b8-4267-869d-8e98bf19cdaa could not be found. Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f15993a1-48b8-4267-869d-8e98bf19cdaa could not be found. Jun 16 14:39:12.087797 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:39:12.090973 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cae432ea-beaa-4aaa-afb7-07316508ef6d tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] Returning 404 to user: Instance f15993a1-48b8-4267-869d-8e98bf19cdaa could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:39:12.093770 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cae432ea-beaa-4aaa-afb7-07316508ef6d tempest-ServersAdminNegativeTestJSON-1152593654 tempest-ServersAdminNegativeTestJSON-1152593654-project] 10.222.0.57 "GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa" status: 404 len: 111 microversion: 2.1 time: 0.071557 Jun 16 14:39:12.101102 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 281/512] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:12 2022] GET /compute/v2.1/servers/f15993a1-48b8-4267-869d-8e98bf19cdaa => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:39:12.194699 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0e56bb5c-ac08-492d-aa24-4201d2f21aae tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/bb33e5db3f424636a11cbc6e60979c5f" status: 200 len: 328 microversion: 2.1 time: 1.178355 Jun 16 14:39:12.197042 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 232/513] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jun 16 14:39:11 2022] PUT /compute/v2.1/os-quota-sets/bb33e5db3f424636a11cbc6e60979c5f => generated 328 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:12.210662 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0ce482a9-20c4-4b1a-9773-09a2273894d3 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:12.252288 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0ce482a9-20c4-4b1a-9773-09a2273894d3 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-quota-sets/bb33e5db3f424636a11cbc6e60979c5f" status: 202 len: 0 microversion: 2.1 time: 0.049099 Jun 16 14:39:12.257804 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 282/514] 10.222.0.57 () {58 vars in 1244 bytes} [Thu Jun 16 14:39:12 2022] DELETE /compute/v2.1/os-quota-sets/bb33e5db3f424636a11cbc6e60979c5f => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:39:12.276049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-63bb46cf-2f26-47f3-a901-24950e8c401b tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Calling method '.version_select at 0x7fdf0c6c6d30>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:13.551383 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-63bb46cf-2f26-47f3-a901-24950e8c401b tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/bb33e5db3f424636a11cbc6e60979c5f" status: 200 len: 371 microversion: 2.1 time: 1.284202 Jun 16 14:39:13.565230 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 233/515] 10.222.0.57 () {58 vars in 1241 bytes} [Thu Jun 16 14:39:12 2022] GET /compute/v2.1/os-quota-sets/bb33e5db3f424636a11cbc6e60979c5f => generated 371 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:39:14.100443 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2e7ea417-3738-46dd-abfc-35f9da6bcbd1 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Calling method '.version_select at 0x7fdf0c336160>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:14.859507 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2e7ea417-3738-46dd-abfc-35f9da6bcbd1 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/f84b1bac4502496fac34a516e5e70511/defaults" status: 200 len: 371 microversion: 2.1 time: 0.765092 Jun 16 14:39:14.871062 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 283/516] 10.222.0.57 () {58 vars in 1268 bytes} [Thu Jun 16 14:39:14 2022] GET /compute/v2.1/os-quota-sets/f84b1bac4502496fac34a516e5e70511/defaults => generated 371 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:15.007347 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-551880472", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:15.172583 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] validate_networks() for None {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:39:15.829170 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-394e7aa7-eadb-4129-b9be-59c2c48188d7 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0c336dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:16.611434 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-394e7aa7-eadb-4129-b9be-59c2c48188d7 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:16.612269 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-394e7aa7-eadb-4129-b9be-59c2c48188d7 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:16.614282 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-394e7aa7-eadb-4129-b9be-59c2c48188d7 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:16.615055 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-394e7aa7-eadb-4129-b9be-59c2c48188d7 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:16.914589 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-394e7aa7-eadb-4129-b9be-59c2c48188d7 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/c01ca2ad82bd42e5a62b32726a58451c" status: 200 len: 328 microversion: 2.1 time: 1.089941 Jun 16 14:39:16.924757 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 284/517] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jun 16 14:39:15 2022] PUT /compute/v2.1/os-quota-sets/c01ca2ad82bd42e5a62b32726a58451c => generated 328 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:17.617347 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:39:17.620158 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:39:17.621514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:39:17.622738 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:39:17.623776 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:39:17.651570 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3bbab532-b3d2-4f68-b814-9ed073e8cec5 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Action: 'create', calling method: .version_select at 0x7fdf0c407af0>, body: {"keypair": {"name": "tempest-keypair-537177185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6LB1Yus1EWwOF8H/zPfGDYHs9QW3gL7L77xNgoSbIqWUeo3i1nyHC4Fq9TrPOrLAC8eOa5hsV9m8eyLSspH3bsWxDm8hQwDeHqQ2z02ab21802KeLrVHwgLQFR7Ek/VQ=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:17.652363 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:17.674173 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:17.679637 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:17.688125 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-3bbab532-b3d2-4f68-b814-9ed073e8cec5 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Getting quotas for project c686fc6c846f444b9c3c8790028ad694. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:39:17.689334 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:17.690482 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:17.708541 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-3bbab532-b3d2-4f68-b814-9ed073e8cec5 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Getting quotas for user 848a67571a4e4eb5a21d5f4502b35cb4 and project c686fc6c846f444b9c3c8790028ad694. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:39:17.751740 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:17.770614 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3bbab532-b3d2-4f68-b814-9ed073e8cec5 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.852514 Jun 16 14:39:17.777193 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 285/518] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:39:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:17.789592 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-706f3ef7-2caf-4829-b7fb-e33f26936bc1 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Calling method '.version_select at 0x7fdf0c39bca0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:17.825988 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Getting quotas for project f1abbeadf6d14290a877226e9c7aaba5. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:39:17.848808 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Getting quotas for user fb3c3d0c6cae46fd9580de9fa58447d2 and project f1abbeadf6d14290a877226e9c7aaba5. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:39:17.921540 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:39:17.932610 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:39:18.170314 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4700e248-3c70-46cb-a4d3-7da41d506cf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.860149 Jun 16 14:39:18.174649 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 234/519] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:39:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 14:39:18.202812 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-206188926", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "f57fcde4-c3c0-449f-9871-02a5578b92d2"}], "security_groups": [{"name": "tempest-securitygroup--1949509915"}], "key_name": "tempest-keypair-107457352", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:18.453966 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-706f3ef7-2caf-4829-b7fb-e33f26936bc1 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:18.457735 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-706f3ef7-2caf-4829-b7fb-e33f26936bc1 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:18.465113 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-706f3ef7-2caf-4829-b7fb-e33f26936bc1 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:18.469493 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-706f3ef7-2caf-4829-b7fb-e33f26936bc1 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:18.572242 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-706f3ef7-2caf-4829-b7fb-e33f26936bc1 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/c01ca2ad82bd42e5a62b32726a58451c/detail" status: 200 len: 916 microversion: 2.1 time: 0.790334 Jun 16 14:39:18.588255 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 286/520] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jun 16 14:39:17 2022] GET /compute/v2.1/os-quota-sets/c01ca2ad82bd42e5a62b32726a58451c/detail => generated 916 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:18.600657 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ef5b9694-05af-47fe-9c04-9e377fbf94ba tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:18.601295 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ef5b9694-05af-47fe-9c04-9e377fbf94ba tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:18.833814 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] validate_networks() for [('f57fcde4-c3c0-449f-9871-02a5578b92d2', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:39:18.851578 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ef5b9694-05af-47fe-9c04-9e377fbf94ba tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:18.859642 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ef5b9694-05af-47fe-9c04-9e377fbf94ba tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1218 microversion: 2.1 time: 0.264268 Jun 16 14:39:18.860233 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 287/521] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:18 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1218 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:18.927477 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-88558dee-c7af-4f0e-9730-41183a2f0237 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0c4e05e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:19.570143 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-88558dee-c7af-4f0e-9730-41183a2f0237 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:19.571784 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-88558dee-c7af-4f0e-9730-41183a2f0237 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:19.573471 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-88558dee-c7af-4f0e-9730-41183a2f0237 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:19.576362 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-88558dee-c7af-4f0e-9730-41183a2f0237 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:19.678733 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-88558dee-c7af-4f0e-9730-41183a2f0237 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:19.679925 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-88558dee-c7af-4f0e-9730-41183a2f0237 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:19.682322 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-88558dee-c7af-4f0e-9730-41183a2f0237 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:19.683171 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-88558dee-c7af-4f0e-9730-41183a2f0237 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:19.873547 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-88558dee-c7af-4f0e-9730-41183a2f0237 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/c01ca2ad82bd42e5a62b32726a58451c?user_id=784b558208c84eb3a12d1fcacecbfad5" status: 200 len: 328 microversion: 2.1 time: 0.922408 Jun 16 14:39:19.877782 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 288/522] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jun 16 14:39:18 2022] PUT /compute/v2.1/os-quota-sets/c01ca2ad82bd42e5a62b32726a58451c?user_id=784b558208c84eb3a12d1fcacecbfad5 => generated 328 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:19.908707 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b70fa8d5-ac8d-4752-8cd7-1737ff4d287a tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Calling method '.version_select at 0x7fdf0c38e550>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:20.659370 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b70fa8d5-ac8d-4752-8cd7-1737ff4d287a tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/c01ca2ad82bd42e5a62b32726a58451c?user_id=784b558208c84eb3a12d1fcacecbfad5" status: 200 len: 370 microversion: 2.1 time: 0.770344 Jun 16 14:39:20.668836 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 289/523] 10.222.0.57 () {58 vars in 1322 bytes} [Thu Jun 16 14:39:19 2022] GET /compute/v2.1/os-quota-sets/c01ca2ad82bd42e5a62b32726a58451c?user_id=784b558208c84eb3a12d1fcacecbfad5 => generated 370 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:20.682245 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-63ddac85-0709-401a-8b70-5c1aea763f9c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:20.683350 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-63ddac85-0709-401a-8b70-5c1aea763f9c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:20.712075 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-63ddac85-0709-401a-8b70-5c1aea763f9c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:20.718835 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-63ddac85-0709-401a-8b70-5c1aea763f9c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:20.720668 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-63ddac85-0709-401a-8b70-5c1aea763f9c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:20.727731 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-63ddac85-0709-401a-8b70-5c1aea763f9c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:20.853589 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:39:20.854352 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:39:20.854912 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:39:20.855361 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:39:20.855968 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:39:20.883359 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:20.884564 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:20.886503 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:20.892480 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:20.991433 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Getting quotas for project b0484f4c1c304b84a88b7d2be3b9483c. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:39:21.008413 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Getting quotas for user 96fb5660c35642ad9da6d8bb34e393f4 and project b0484f4c1c304b84a88b7d2be3b9483c. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:39:21.061347 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:39:21.068400 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:39:21.186040 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-069c5f44-4341-4499-98e0-7ad195d16196 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.007695 Jun 16 14:39:21.187252 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 235/524] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:39:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 3012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:39:21.211303 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4cc1acc8-0ca7-44ef-bab8-f023441ab0bc tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:21.212458 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4cc1acc8-0ca7-44ef-bab8-f023441ab0bc tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:21.352306 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-4cc1acc8-0ca7-44ef-bab8-f023441ab0bc tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:21.382637 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4cc1acc8-0ca7-44ef-bab8-f023441ab0bc tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1233 microversion: 2.1 time: 0.177306 Jun 16 14:39:21.383785 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 236/525] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:21 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1233 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:21.576260 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-63ddac85-0709-401a-8b70-5c1aea763f9c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:21.592599 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-63ddac85-0709-401a-8b70-5c1aea763f9c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1270 microversion: 2.1 time: 0.919632 Jun 16 14:39:21.593086 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 290/526] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:20 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1270 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:21.915277 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-153fb1c6-f5d0-4d55-b5ba-2e85b613779f tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Calling method '.version_select at 0x7fdf0c7395e0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:22.402985 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7a76ebca-c972-4042-9d27-2dd1692d2f9d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:22.403879 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7a76ebca-c972-4042-9d27-2dd1692d2f9d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:22.419350 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-153fb1c6-f5d0-4d55-b5ba-2e85b613779f tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/f84b1bac4502496fac34a516e5e70511/defaults" status: 200 len: 371 microversion: 2.1 time: 0.511273 Jun 16 14:39:22.419637 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:22.423040 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 237/527] 10.222.0.57 () {58 vars in 1268 bytes} [Thu Jun 16 14:39:21 2022] GET /compute/v2.1/os-quota-sets/f84b1bac4502496fac34a516e5e70511/defaults => generated 371 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:22.470246 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0f99dff5-012f-4699-ba16-6022844333e3 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0c93baf0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:22.658954 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0f99dff5-012f-4699-ba16-6022844333e3 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:22.662904 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0f99dff5-012f-4699-ba16-6022844333e3 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:22.669735 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0f99dff5-012f-4699-ba16-6022844333e3 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:22.671844 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0f99dff5-012f-4699-ba16-6022844333e3 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:22.935674 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7a76ebca-c972-4042-9d27-2dd1692d2f9d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:22.976294 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7a76ebca-c972-4042-9d27-2dd1692d2f9d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1233 microversion: 2.1 time: 0.578050 Jun 16 14:39:22.980735 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 291/528] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:22 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1233 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:22.993915 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6760ebac-7f9c-4f87-bce5-51a2d8bb04ed tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:23.015977 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6760ebac-7f9c-4f87-bce5-51a2d8bb04ed tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:23.046328 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6760ebac-7f9c-4f87-bce5-51a2d8bb04ed tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:23.050577 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6760ebac-7f9c-4f87-bce5-51a2d8bb04ed tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:23.060067 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6760ebac-7f9c-4f87-bce5-51a2d8bb04ed tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:23.061102 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6760ebac-7f9c-4f87-bce5-51a2d8bb04ed tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:23.392515 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0f99dff5-012f-4699-ba16-6022844333e3 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/f84b1bac4502496fac34a516e5e70511" status: 200 len: 329 microversion: 2.1 time: 0.960946 Jun 16 14:39:23.402586 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 238/529] 10.222.0.57 () {60 vars in 1262 bytes} [Thu Jun 16 14:39:22 2022] PUT /compute/v2.1/os-quota-sets/f84b1bac4502496fac34a516e5e70511 => generated 329 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:39:23.428551 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ddd41fb2-d5b8-460c-a8b8-7bec631bef13 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0c6e3d30>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:23.588786 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6760ebac-7f9c-4f87-bce5-51a2d8bb04ed tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:23.624354 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6760ebac-7f9c-4f87-bce5-51a2d8bb04ed tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1276 microversion: 2.1 time: 0.641307 Jun 16 14:39:23.638701 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 292/530] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:22 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1276 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:23.646571 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ddd41fb2-d5b8-460c-a8b8-7bec631bef13 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:23.647345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ddd41fb2-d5b8-460c-a8b8-7bec631bef13 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:23.647892 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ddd41fb2-d5b8-460c-a8b8-7bec631bef13 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:23.648341 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ddd41fb2-d5b8-460c-a8b8-7bec631bef13 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:24.008571 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=24,nova_api:UPDATE=3 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:24.030786 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a192e623-8aea-4e0d-ab66-41f7ffa67fd1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:24.033708 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a192e623-8aea-4e0d-ab66-41f7ffa67fd1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:24.064839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a192e623-8aea-4e0d-ab66-41f7ffa67fd1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:24.066568 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a192e623-8aea-4e0d-ab66-41f7ffa67fd1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:24.069546 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a192e623-8aea-4e0d-ab66-41f7ffa67fd1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:24.071571 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a192e623-8aea-4e0d-ab66-41f7ffa67fd1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:24.816412 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ddd41fb2-d5b8-460c-a8b8-7bec631bef13 tempest-QuotasAdminTestJSON-836245485 tempest-QuotasAdminTestJSON-836245485-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/f84b1bac4502496fac34a516e5e70511" status: 200 len: 329 microversion: 2.1 time: 1.406751 Jun 16 14:39:24.838199 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 239/531] 10.222.0.57 () {60 vars in 1262 bytes} [Thu Jun 16 14:39:23 2022] PUT /compute/v2.1/os-quota-sets/f84b1bac4502496fac34a516e5e70511 => generated 329 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:24.866780 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d6c080d0-cadb-4e4c-8988-07dfb36c3679 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:24.867233 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d6c080d0-cadb-4e4c-8988-07dfb36c3679 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:24.879435 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d6c080d0-cadb-4e4c-8988-07dfb36c3679 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:24.887332 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d6c080d0-cadb-4e4c-8988-07dfb36c3679 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:24.888089 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d6c080d0-cadb-4e4c-8988-07dfb36c3679 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:24.888559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d6c080d0-cadb-4e4c-8988-07dfb36c3679 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:25.232085 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a192e623-8aea-4e0d-ab66-41f7ffa67fd1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:25.263763 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a192e623-8aea-4e0d-ab66-41f7ffa67fd1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1285 microversion: 2.1 time: 1.264648 Jun 16 14:39:25.265803 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 293/532] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:23 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1285 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:25.281353 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1788388988", "imageRef": "c69c8a6a-25b5-4455-ab78-fdca26584749", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ce1aa800-a2af-4842-bea2-ee70c786eab8"}], "security_groups": [{"name": "tempest-securitygroup--1205319567"}], "key_name": "tempest-keypair-537177185", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:25.701100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d6c080d0-cadb-4e4c-8988-07dfb36c3679 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:25.744910 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d6c080d0-cadb-4e4c-8988-07dfb36c3679 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1276 microversion: 2.1 time: 0.904588 Jun 16 14:39:25.750065 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 240/533] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:24 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1276 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:26.316316 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3cbdb86e-50d1-4412-b822-ad3760a5f864 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:26.320604 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3cbdb86e-50d1-4412-b822-ad3760a5f864 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:26.346563 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3cbdb86e-50d1-4412-b822-ad3760a5f864 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:26.347560 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3cbdb86e-50d1-4412-b822-ad3760a5f864 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:26.349445 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3cbdb86e-50d1-4412-b822-ad3760a5f864 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:26.350274 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3cbdb86e-50d1-4412-b822-ad3760a5f864 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:26.363316 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] validate_networks() for [('ce1aa800-a2af-4842-bea2-ee70c786eab8', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:39:26.580782 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3cbdb86e-50d1-4412-b822-ad3760a5f864 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:26.595363 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3cbdb86e-50d1-4412-b822-ad3760a5f864 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1291 microversion: 2.1 time: 0.313526 Jun 16 14:39:26.606719 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 241/534] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:26 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1291 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:26.773533 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-53f8e132-dbd4-4d19-bf76-bcedb34dc771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:26.774350 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-53f8e132-dbd4-4d19-bf76-bcedb34dc771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:26.782092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-53f8e132-dbd4-4d19-bf76-bcedb34dc771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:26.782888 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-53f8e132-dbd4-4d19-bf76-bcedb34dc771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:26.784079 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-53f8e132-dbd4-4d19-bf76-bcedb34dc771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:26.784719 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-53f8e132-dbd4-4d19-bf76-bcedb34dc771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:26.938931 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-53f8e132-dbd4-4d19-bf76-bcedb34dc771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:26.989396 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-53f8e132-dbd4-4d19-bf76-bcedb34dc771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1276 microversion: 2.1 time: 0.221097 Jun 16 14:39:26.993853 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 242/535] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:26 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1276 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:39:27.624464 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-153ac6d4-7c7e-4abb-8094-eb88ed5aaa63 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:27.625427 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-153ac6d4-7c7e-4abb-8094-eb88ed5aaa63 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:27.646468 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-153ac6d4-7c7e-4abb-8094-eb88ed5aaa63 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:27.647420 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-153ac6d4-7c7e-4abb-8094-eb88ed5aaa63 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:27.648586 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-153ac6d4-7c7e-4abb-8094-eb88ed5aaa63 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:27.649313 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-153ac6d4-7c7e-4abb-8094-eb88ed5aaa63 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:27.889518 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-153ac6d4-7c7e-4abb-8094-eb88ed5aaa63 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:27.905345 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-153ac6d4-7c7e-4abb-8094-eb88ed5aaa63 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1291 microversion: 2.1 time: 0.288761 Jun 16 14:39:27.911355 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 243/536] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:27 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1291 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:28.018201 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4015c116-1af2-4c80-97a9-8f179db8f771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:28.018910 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4015c116-1af2-4c80-97a9-8f179db8f771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:28.040807 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4015c116-1af2-4c80-97a9-8f179db8f771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:28.041470 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4015c116-1af2-4c80-97a9-8f179db8f771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:28.046417 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4015c116-1af2-4c80-97a9-8f179db8f771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:28.052053 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4015c116-1af2-4c80-97a9-8f179db8f771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:29.206397 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:39:29.207329 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:39:29.208954 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:39:29.209729 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:39:29.211073 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:39:29.242134 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:29.245932 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:29.251096 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:29.259450 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:29.284134 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-4015c116-1af2-4c80-97a9-8f179db8f771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:29.303491 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4015c116-1af2-4c80-97a9-8f179db8f771 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1318 microversion: 2.1 time: 1.289214 Jun 16 14:39:29.314441 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 244/537] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:28 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1318 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:29.321197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4334996a-02f6-45d5-8039-f9166ca7ea7d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:29.321827 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4334996a-02f6-45d5-8039-f9166ca7ea7d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:29.343641 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4334996a-02f6-45d5-8039-f9166ca7ea7d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:29.344425 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4334996a-02f6-45d5-8039-f9166ca7ea7d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:29.345616 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4334996a-02f6-45d5-8039-f9166ca7ea7d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:29.346294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4334996a-02f6-45d5-8039-f9166ca7ea7d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:29.372500 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Getting quotas for project c686fc6c846f444b9c3c8790028ad694. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:39:29.408769 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Getting quotas for user 848a67571a4e4eb5a21d5f4502b35cb4 and project c686fc6c846f444b9c3c8790028ad694. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:39:29.476114 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:39:29.481468 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c69c8a6a-25b5-4455-ab78-fdca26584749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:39:29.729709 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9ffb355a-b7a7-45a6-bef3-4239bb1876ff tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.458117 Jun 16 14:39:29.740169 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 294/538] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:39:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 4468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:39:29.768557 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-79943ec8-1a71-4953-8816-7129e17864b4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:29.769712 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-79943ec8-1a71-4953-8816-7129e17864b4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:30.165179 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-4334996a-02f6-45d5-8039-f9166ca7ea7d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:30.179798 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4334996a-02f6-45d5-8039-f9166ca7ea7d tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1359 microversion: 2.1 time: 0.863406 Jun 16 14:39:30.191921 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 245/539] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:29 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1359 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:30.324674 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-08bb226b-1e44-492f-94f6-14e380662ee0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:30.325660 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-08bb226b-1e44-492f-94f6-14e380662ee0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:30.351082 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-79943ec8-1a71-4953-8816-7129e17864b4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:30.356523 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-08bb226b-1e44-492f-94f6-14e380662ee0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:30.359332 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-08bb226b-1e44-492f-94f6-14e380662ee0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:30.367072 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-08bb226b-1e44-492f-94f6-14e380662ee0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:30.368049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-08bb226b-1e44-492f-94f6-14e380662ee0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:30.387085 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-79943ec8-1a71-4953-8816-7129e17864b4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1245 microversion: 2.1 time: 0.633302 Jun 16 14:39:30.389533 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 295/540] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:29 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1245 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:31.175686 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-265436069", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "174724bb-1f38-4b2e-afaf-aad767c219ae"}]}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:31.318023 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] validate_networks() for [('174724bb-1f38-4b2e-afaf-aad767c219ae', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:39:31.720257 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-08bb226b-1e44-492f-94f6-14e380662ee0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:31.729238 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-08bb226b-1e44-492f-94f6-14e380662ee0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1318 microversion: 2.1 time: 1.411678 Jun 16 14:39:31.743393 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 246/541] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:30 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1318 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:31.748438 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3026c295-9cfb-43ae-a437-94a4929de5a6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:31.749078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3026c295-9cfb-43ae-a437-94a4929de5a6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:31.778261 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3026c295-9cfb-43ae-a437-94a4929de5a6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:31.778880 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3026c295-9cfb-43ae-a437-94a4929de5a6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:31.787149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3026c295-9cfb-43ae-a437-94a4929de5a6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:31.787806 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3026c295-9cfb-43ae-a437-94a4929de5a6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:33.573027 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3026c295-9cfb-43ae-a437-94a4929de5a6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:33.625448 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3026c295-9cfb-43ae-a437-94a4929de5a6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1359 microversion: 2.1 time: 1.877908 Jun 16 14:39:33.631192 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 247/542] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:31 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1359 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:33.641756 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bcf12c85-6004-48c6-82dc-f945103b312f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:33.657750 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bcf12c85-6004-48c6-82dc-f945103b312f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:33.691325 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bcf12c85-6004-48c6-82dc-f945103b312f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:33.698967 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bcf12c85-6004-48c6-82dc-f945103b312f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:33.701095 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bcf12c85-6004-48c6-82dc-f945103b312f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:33.716883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bcf12c85-6004-48c6-82dc-f945103b312f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:33.725700 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=10 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:34.097529 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bcf12c85-6004-48c6-82dc-f945103b312f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:34.112008 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bcf12c85-6004-48c6-82dc-f945103b312f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1303 microversion: 2.1 time: 0.478262 Jun 16 14:39:34.112616 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 248/543] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:33 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1303 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:34.126994 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8191700d-49e3-41ae-a8b4-6597335d98b4 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:34.128749 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8191700d-49e3-41ae-a8b4-6597335d98b4 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:34.157651 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8191700d-49e3-41ae-a8b4-6597335d98b4 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:34.162642 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8191700d-49e3-41ae-a8b4-6597335d98b4 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:34.164293 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8191700d-49e3-41ae-a8b4-6597335d98b4 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:34.166831 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8191700d-49e3-41ae-a8b4-6597335d98b4 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:34.768795 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:39:34.769618 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:39:34.772786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=92 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:34.775409 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:39:34.778334 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:39:34.782517 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:39:34.829337 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=49 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:34.835146 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:34.836543 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:34.838447 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:34.839571 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:34.909362 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:35.009349 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Getting quotas for project c04830ebf498422d9dddfbc009697728. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:39:35.095108 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Getting quotas for user ab3aa4e887694a0e9a42bf6db6b01555 and project c04830ebf498422d9dddfbc009697728. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:39:35.229084 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:39:35.249522 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:39:35.627031 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-088fc558-19cc-4bbd-a6be-19b857f2abb5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.828002 Jun 16 14:39:35.642984 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 296/544] 10.222.0.57 () {62 vars in 1187 bytes} [Thu Jun 16 14:39:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 4845 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 16 14:39:35.667139 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2a4b7d26-5fae-4c0a-80d5-e8e0ccb78f40 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:35.670652 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2a4b7d26-5fae-4c0a-80d5-e8e0ccb78f40 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:35.744911 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a4b7d26-5fae-4c0a-80d5-e8e0ccb78f40 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:35.747933 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a4b7d26-5fae-4c0a-80d5-e8e0ccb78f40 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:35.749494 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a4b7d26-5fae-4c0a-80d5-e8e0ccb78f40 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:35.755793 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a4b7d26-5fae-4c0a-80d5-e8e0ccb78f40 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:35.880204 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2a4b7d26-5fae-4c0a-80d5-e8e0ccb78f40 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:39:36.288753 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2a4b7d26-5fae-4c0a-80d5-e8e0ccb78f40 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 204 len: 0 microversion: 2.1 time: 0.640852 Jun 16 14:39:36.299330 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 297/545] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:39:35 2022] DELETE /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:39:36.329801 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-607ba247-9ab9-40ce-bfe3-c10fd60b6082 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:36.333776 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-607ba247-9ab9-40ce-bfe3-c10fd60b6082 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:36.423771 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-607ba247-9ab9-40ce-bfe3-c10fd60b6082 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:36.428153 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-607ba247-9ab9-40ce-bfe3-c10fd60b6082 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:36.439332 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-607ba247-9ab9-40ce-bfe3-c10fd60b6082 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:36.440298 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-607ba247-9ab9-40ce-bfe3-c10fd60b6082 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:37.061364 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8191700d-49e3-41ae-a8b4-6597335d98b4 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:37.091397 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8191700d-49e3-41ae-a8b4-6597335d98b4 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1318 microversion: 2.1 time: 2.977214 Jun 16 14:39:37.106110 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 249/546] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:34 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1318 bytes in 2993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:37.131448 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-cb12813c-aa5a-42e0-b9f9-6aa78898f83e req-9329ebee-281a-4e58-8e64-99157b0bed07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a046e36a-76db-4e7d-9b92-02e62742e14a", "tag": "ed1256fa-5568-4d60-8d9f-e8b1a8491c98"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:37.191938 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-cb12813c-aa5a-42e0-b9f9-6aa78898f83e req-9329ebee-281a-4e58-8e64-99157b0bed07 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:37.195408 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-cb12813c-aa5a-42e0-b9f9-6aa78898f83e req-9329ebee-281a-4e58-8e64-99157b0bed07 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:37.279719 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-cb12813c-aa5a-42e0-b9f9-6aa78898f83e req-9329ebee-281a-4e58-8e64-99157b0bed07 service nova] Creating event network-changed:ed1256fa-5568-4d60-8d9f-e8b1a8491c98 for instance a046e36a-76db-4e7d-9b92-02e62742e14a on n-h2-836830-4 Jun 16 14:39:37.342548 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-cb12813c-aa5a-42e0-b9f9-6aa78898f83e req-9329ebee-281a-4e58-8e64-99157b0bed07 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229399 Jun 16 14:39:37.349676 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 250/547] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:37.392504 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cb892f2e-2c57-4223-9620-b103a6a4bb70 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:37.394752 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cb892f2e-2c57-4223-9620-b103a6a4bb70 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:37.434857 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cb892f2e-2c57-4223-9620-b103a6a4bb70 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:37.440436 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cb892f2e-2c57-4223-9620-b103a6a4bb70 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:37.446844 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cb892f2e-2c57-4223-9620-b103a6a4bb70 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:37.450586 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cb892f2e-2c57-4223-9620-b103a6a4bb70 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:37.504386 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-607ba247-9ab9-40ce-bfe3-c10fd60b6082 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:37.512847 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-607ba247-9ab9-40ce-bfe3-c10fd60b6082 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1359 microversion: 2.1 time: 1.209663 Jun 16 14:39:37.519219 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 298/548] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:36 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1359 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:37.527804 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ba7addd7-8920-4bd1-82a2-8fd71809389e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:37.543344 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ba7addd7-8920-4bd1-82a2-8fd71809389e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:37.740653 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ba7addd7-8920-4bd1-82a2-8fd71809389e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:37.752041 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ba7addd7-8920-4bd1-82a2-8fd71809389e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:37.756749 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ba7addd7-8920-4bd1-82a2-8fd71809389e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:37.762617 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ba7addd7-8920-4bd1-82a2-8fd71809389e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1261 microversion: 2.25 time: 0.240254 Jun 16 14:39:37.774572 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 299/549] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:39:37 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1261 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:39:37.784081 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1560753807", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "1595615383", "adminPass": "***", "networks": [{"uuid": "4683a45d-d69a-44d6-878a-f00c16dd6e9e"}], "security_groups": [{"name": "tempest-securitygroup--1422213890"}], "key_name": "tempest-keypair-1584692722", "user_data": "}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:38.070534 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cb892f2e-2c57-4223-9620-b103a6a4bb70 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:38.115947 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cb892f2e-2c57-4223-9620-b103a6a4bb70 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1303 microversion: 2.1 time: 0.757211 Jun 16 14:39:38.117548 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 251/550] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:37 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1303 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:38.179715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] validate_networks() for [('4683a45d-d69a-44d6-878a-f00c16dd6e9e', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:39:38.186262 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-44da02a5-ecdc-4a29-8944-3a061a911c48 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:38.194989 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-44da02a5-ecdc-4a29-8944-3a061a911c48 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:38.216061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-44da02a5-ecdc-4a29-8944-3a061a911c48 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:38.216814 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-44da02a5-ecdc-4a29-8944-3a061a911c48 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:38.217821 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-44da02a5-ecdc-4a29-8944-3a061a911c48 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:38.218575 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-44da02a5-ecdc-4a29-8944-3a061a911c48 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:39.067145 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-44da02a5-ecdc-4a29-8944-3a061a911c48 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:39.111642 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-44da02a5-ecdc-4a29-8944-3a061a911c48 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1318 microversion: 2.1 time: 0.971483 Jun 16 14:39:39.112611 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 252/551] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:38 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1318 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:39.645095 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2087064748", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:39.856104 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] validate_networks() for None {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:39:40.790860 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:39:40.791998 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:39:40.792672 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:39:40.793264 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:39:40.793839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:39:40.819153 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:40.831366 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:40.832682 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:40.833783 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:40.872936 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Getting quotas for project b3bb36eedcf640af98a6bc7f41473758. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:39:40.895342 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Getting quotas for user 2b7e98a72497450c98f5f05bf74213a0 and project b3bb36eedcf640af98a6bc7f41473758. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:39:40.965470 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:39:40.976425 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:39:41.186199 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ad6521d3-cd93-47ae-a112-4035c979a7ed tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.409408 Jun 16 14:39:41.194367 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 300/552] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:39:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 3418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:39:41.207406 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-62562dfd-bc35-467c-9c07-8976a49a1da8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:41.227046 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-62562dfd-bc35-467c-9c07-8976a49a1da8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:41.251940 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-62562dfd-bc35-467c-9c07-8976a49a1da8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:41.253035 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-62562dfd-bc35-467c-9c07-8976a49a1da8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:41.254757 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-62562dfd-bc35-467c-9c07-8976a49a1da8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:41.259623 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-62562dfd-bc35-467c-9c07-8976a49a1da8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:42.578887 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-62562dfd-bc35-467c-9c07-8976a49a1da8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:42.596418 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:39:42.597273 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:39:42.597414 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:39:42.597710 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:39:42.598300 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:39:42.630967 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-62562dfd-bc35-467c-9c07-8976a49a1da8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1359 microversion: 2.1 time: 1.417545 Jun 16 14:39:42.638022 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 301/553] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:41 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1359 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:42.659744 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:42.663595 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:42.670737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:42.675078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:42.683791 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a911f4cc-003a-4d04-8444-47e301c2890c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:42.693648 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a911f4cc-003a-4d04-8444-47e301c2890c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:42.747400 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a911f4cc-003a-4d04-8444-47e301c2890c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:42.758941 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a911f4cc-003a-4d04-8444-47e301c2890c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:42.766269 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a911f4cc-003a-4d04-8444-47e301c2890c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:42.768050 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a911f4cc-003a-4d04-8444-47e301c2890c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:42.815648 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Getting quotas for project 93da236582a64812bdde5b156b76d1e2. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:39:42.839003 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Getting quotas for user 3f9d5b3a7df04a5eb2a6dfd69d77e63c and project 93da236582a64812bdde5b156b76d1e2. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:39:42.884425 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:39:42.904908 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:39:43.094713 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6e8dd600-9143-480e-b071-fac5861dbdc0 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.974252 Jun 16 14:39:43.095393 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 253/554] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:39:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:39:43.120540 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-54651be4-4131-437d-942b-a16ae83a6591 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:43.121171 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-54651be4-4131-437d-942b-a16ae83a6591 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:43.159053 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54651be4-4131-437d-942b-a16ae83a6591 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:43.171622 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54651be4-4131-437d-942b-a16ae83a6591 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:43.173180 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54651be4-4131-437d-942b-a16ae83a6591 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:43.174048 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54651be4-4131-437d-942b-a16ae83a6591 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:43.322527 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a911f4cc-003a-4d04-8444-47e301c2890c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:43.390734 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a911f4cc-003a-4d04-8444-47e301c2890c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:43.413252 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a911f4cc-003a-4d04-8444-47e301c2890c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:43.434323 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a911f4cc-003a-4d04-8444-47e301c2890c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1319 microversion: 2.25 time: 0.790102 Jun 16 14:39:43.441777 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 302/555] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:39:42 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1319 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:39:43.515715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-99d16df7-b4c6-4abd-8ab9-6ab0fe44b40d req-5a4d08dd-40a8-4f21-8f0c-f0307f771b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cb64d6-b915-425c-aed2-442d3e2a1676", "tag": "dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:43.628026 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-99d16df7-b4c6-4abd-8ab9-6ab0fe44b40d req-5a4d08dd-40a8-4f21-8f0c-f0307f771b93 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:43.628971 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-99d16df7-b4c6-4abd-8ab9-6ab0fe44b40d req-5a4d08dd-40a8-4f21-8f0c-f0307f771b93 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:43.705616 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-99d16df7-b4c6-4abd-8ab9-6ab0fe44b40d req-5a4d08dd-40a8-4f21-8f0c-f0307f771b93 service nova] Creating event network-changed:dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a for instance e8cb64d6-b915-425c-aed2-442d3e2a1676 on n-h1-836830-4 Jun 16 14:39:43.756433 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-99d16df7-b4c6-4abd-8ab9-6ab0fe44b40d req-5a4d08dd-40a8-4f21-8f0c-f0307f771b93 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.311049 Jun 16 14:39:43.757900 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 303/556] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:43.771275 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2f3b34ee-9180-4312-a076-0bf581c759a8 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:43.773928 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2f3b34ee-9180-4312-a076-0bf581c759a8 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:43.788584 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2f3b34ee-9180-4312-a076-0bf581c759a8 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:43.789801 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2f3b34ee-9180-4312-a076-0bf581c759a8 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:43.791776 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2f3b34ee-9180-4312-a076-0bf581c759a8 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:43.792900 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2f3b34ee-9180-4312-a076-0bf581c759a8 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:45.803187 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2f3b34ee-9180-4312-a076-0bf581c759a8 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:45.851161 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2f3b34ee-9180-4312-a076-0bf581c759a8 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1318 microversion: 2.1 time: 2.087328 Jun 16 14:39:45.852601 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 304/557] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:43 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1318 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:45.870523 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9024cb56-bbdd-47a6-b6fc-1e0e9db2c4c4 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:45.872210 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9024cb56-bbdd-47a6-b6fc-1e0e9db2c4c4 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:45.899026 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9024cb56-bbdd-47a6-b6fc-1e0e9db2c4c4 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:45.900059 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9024cb56-bbdd-47a6-b6fc-1e0e9db2c4c4 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:45.901575 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9024cb56-bbdd-47a6-b6fc-1e0e9db2c4c4 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:45.902373 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9024cb56-bbdd-47a6-b6fc-1e0e9db2c4c4 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:46.157399 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-54651be4-4131-437d-942b-a16ae83a6591 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:46.167236 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-54651be4-4131-437d-942b-a16ae83a6591 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1371 microversion: 2.1 time: 3.050779 Jun 16 14:39:46.176832 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 254/558] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:43 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1371 bytes in 3080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:46.196979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b6c35dac-fa7d-4b6d-9f5e-dbc69400b245 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:46.203999 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b6c35dac-fa7d-4b6d-9f5e-dbc69400b245 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:46.247970 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b6c35dac-fa7d-4b6d-9f5e-dbc69400b245 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:46.255019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b6c35dac-fa7d-4b6d-9f5e-dbc69400b245 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:46.261769 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b6c35dac-fa7d-4b6d-9f5e-dbc69400b245 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:46.263907 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b6c35dac-fa7d-4b6d-9f5e-dbc69400b245 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:46.572013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9024cb56-bbdd-47a6-b6fc-1e0e9db2c4c4 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:46.601826 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9024cb56-bbdd-47a6-b6fc-1e0e9db2c4c4 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 200 len: 1323 microversion: 2.1 time: 0.743002 Jun 16 14:39:46.603477 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 305/559] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:45 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 1323 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:46.617661 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-10d7b365-ac88-4295-824e-39d775e5abc5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:46.621109 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-10d7b365-ac88-4295-824e-39d775e5abc5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:46.675436 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-10d7b365-ac88-4295-824e-39d775e5abc5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:46.683554 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-10d7b365-ac88-4295-824e-39d775e5abc5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:46.687188 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-10d7b365-ac88-4295-824e-39d775e5abc5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:46.693929 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-10d7b365-ac88-4295-824e-39d775e5abc5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:46.787515 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b6c35dac-fa7d-4b6d-9f5e-dbc69400b245 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9d5b3a7df04a5eb2a6dfd69d77e63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da236582a64812bdde5b156b76d1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:46.805493 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b6c35dac-fa7d-4b6d-9f5e-dbc69400b245 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 200 len: 1275 microversion: 2.1 time: 0.625484 Jun 16 14:39:46.821811 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 255/560] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:46 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 1275 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:46.829776 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3c7bcb32-d284-404e-8619-74ec5f85c546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:46.837601 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3c7bcb32-d284-404e-8619-74ec5f85c546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:46.846129 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3c7bcb32-d284-404e-8619-74ec5f85c546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:46.847104 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3c7bcb32-d284-404e-8619-74ec5f85c546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:46.848412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3c7bcb32-d284-404e-8619-74ec5f85c546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:46.849908 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3c7bcb32-d284-404e-8619-74ec5f85c546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:47.577845 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-10d7b365-ac88-4295-824e-39d775e5abc5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:47.608689 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-10d7b365-ac88-4295-824e-39d775e5abc5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1359 microversion: 2.1 time: 0.996798 Jun 16 14:39:47.617157 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 306/561] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:46 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1359 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:47.636545 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-022deb14-fa14-46d6-bfe7-69faf7a27961 req-cb688fdd-bb57-44be-a182-d7c8cb695571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b36c679-5452-4c35-ba4a-a19aa69e3fd8", "name": "network-vif-unplugged", "status": "completed", "tag": "9f8be973-6750-49fd-8447-597286585736"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:47.670795 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-022deb14-fa14-46d6-bfe7-69faf7a27961 req-cb688fdd-bb57-44be-a182-d7c8cb695571 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:47.676306 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-022deb14-fa14-46d6-bfe7-69faf7a27961 req-cb688fdd-bb57-44be-a182-d7c8cb695571 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:47.722886 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-022deb14-fa14-46d6-bfe7-69faf7a27961 req-cb688fdd-bb57-44be-a182-d7c8cb695571 service nova] Creating event network-vif-unplugged:9f8be973-6750-49fd-8447-597286585736 for instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 on n-h1-836830-4 Jun 16 14:39:47.735448 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-022deb14-fa14-46d6-bfe7-69faf7a27961 req-cb688fdd-bb57-44be-a182-d7c8cb695571 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113714 Jun 16 14:39:47.739992 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 307/562] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:47.749688 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-aa038b71-219e-46b2-a1c1-776b707f209d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:47.750462 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-aa038b71-219e-46b2-a1c1-776b707f209d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:47.775819 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aa038b71-219e-46b2-a1c1-776b707f209d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:47.776432 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aa038b71-219e-46b2-a1c1-776b707f209d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:47.777276 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aa038b71-219e-46b2-a1c1-776b707f209d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:47.781080 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aa038b71-219e-46b2-a1c1-776b707f209d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:50.020643 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-aa038b71-219e-46b2-a1c1-776b707f209d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:50.064406 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-aa038b71-219e-46b2-a1c1-776b707f209d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1318 microversion: 2.1 time: 2.320080 Jun 16 14:39:50.070976 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 308/563] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:47 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1318 bytes in 2330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:50.105559 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a60cd36d-f15c-4cae-86ad-7f12d79a71f7 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:50.110733 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a60cd36d-f15c-4cae-86ad-7f12d79a71f7 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:50.139063 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a60cd36d-f15c-4cae-86ad-7f12d79a71f7 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:50.142137 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a60cd36d-f15c-4cae-86ad-7f12d79a71f7 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:50.143638 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a60cd36d-f15c-4cae-86ad-7f12d79a71f7 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:50.147019 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a60cd36d-f15c-4cae-86ad-7f12d79a71f7 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:50.617037 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3c7bcb32-d284-404e-8619-74ec5f85c546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:50.671815 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:50.711187 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3c7bcb32-d284-404e-8619-74ec5f85c546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:50.724975 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3c7bcb32-d284-404e-8619-74ec5f85c546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:50.728519 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3c7bcb32-d284-404e-8619-74ec5f85c546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1361 microversion: 2.25 time: 3.904330 Jun 16 14:39:50.736323 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 256/564] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:39:46 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1361 bytes in 3913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:39:50.798611 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-db5bbcea-174d-4d6b-b9d3-93420d9b2425 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:50.807807 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-db5bbcea-174d-4d6b-b9d3-93420d9b2425 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:50.844765 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=15 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:50.861664 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-db5bbcea-174d-4d6b-b9d3-93420d9b2425 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:50.876311 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-db5bbcea-174d-4d6b-b9d3-93420d9b2425 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:50.878764 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-db5bbcea-174d-4d6b-b9d3-93420d9b2425 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:50.883579 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-db5bbcea-174d-4d6b-b9d3-93420d9b2425 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:50.945107 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=13 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:51.480630 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a60cd36d-f15c-4cae-86ad-7f12d79a71f7 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:51.525617 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a60cd36d-f15c-4cae-86ad-7f12d79a71f7 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1371 microversion: 2.1 time: 1.452549 Jun 16 14:39:51.526423 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 309/565] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:50 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1371 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:51.550012 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ef979c3b-3486-43d8-a7c8-0bd03ecb2081 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:51.551396 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ef979c3b-3486-43d8-a7c8-0bd03ecb2081 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:51.569444 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef979c3b-3486-43d8-a7c8-0bd03ecb2081 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:51.570288 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef979c3b-3486-43d8-a7c8-0bd03ecb2081 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:51.578053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef979c3b-3486-43d8-a7c8-0bd03ecb2081 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:51.578861 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef979c3b-3486-43d8-a7c8-0bd03ecb2081 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:51.704398 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-db5bbcea-174d-4d6b-b9d3-93420d9b2425 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:51.762300 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-db5bbcea-174d-4d6b-b9d3-93420d9b2425 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 200 len: 1323 microversion: 2.1 time: 1.002189 Jun 16 14:39:51.765735 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 257/566] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:50 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 1323 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:51.782830 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ef979c3b-3486-43d8-a7c8-0bd03ecb2081 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9d5b3a7df04a5eb2a6dfd69d77e63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da236582a64812bdde5b156b76d1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:51.797368 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-aa34c23f-1d81-48a1-b114-e9fde2ec9a64 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:51.800435 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-aa34c23f-1d81-48a1-b114-e9fde2ec9a64 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:51.803218 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ef979c3b-3486-43d8-a7c8-0bd03ecb2081 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 200 len: 1281 microversion: 2.1 time: 0.265307 Jun 16 14:39:51.829706 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 310/567] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:51 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 1281 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:51.839640 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-eb6b2fe6-48c4-4a07-9ebd-8953953979de tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:51.840277 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-eb6b2fe6-48c4-4a07-9ebd-8953953979de tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:51.882054 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb6b2fe6-48c4-4a07-9ebd-8953953979de tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:51.882552 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb6b2fe6-48c4-4a07-9ebd-8953953979de tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:51.888158 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aa34c23f-1d81-48a1-b114-e9fde2ec9a64 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:51.888920 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aa34c23f-1d81-48a1-b114-e9fde2ec9a64 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:51.890340 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aa34c23f-1d81-48a1-b114-e9fde2ec9a64 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:51.895630 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb6b2fe6-48c4-4a07-9ebd-8953953979de tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:51.896098 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb6b2fe6-48c4-4a07-9ebd-8953953979de tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:51.910815 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aa34c23f-1d81-48a1-b114-e9fde2ec9a64 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:52.758205 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:52.871545 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=6 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:53.566431 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-aa34c23f-1d81-48a1-b114-e9fde2ec9a64 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:53.594523 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-aa34c23f-1d81-48a1-b114-e9fde2ec9a64 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1359 microversion: 2.1 time: 1.827301 Jun 16 14:39:53.595781 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 258/568] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:51 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1359 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:53.604690 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-88953895-3135-4239-bc0b-8ebacfbf35c1 req-c916bd72-b12f-442a-bc5b-1b08216f5171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a046e36a-76db-4e7d-9b92-02e62742e14a", "name": "network-vif-plugged", "status": "completed", "tag": "ed1256fa-5568-4d60-8d9f-e8b1a8491c98"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:53.618795 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-88953895-3135-4239-bc0b-8ebacfbf35c1 req-c916bd72-b12f-442a-bc5b-1b08216f5171 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:53.619635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-88953895-3135-4239-bc0b-8ebacfbf35c1 req-c916bd72-b12f-442a-bc5b-1b08216f5171 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:53.660215 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-88953895-3135-4239-bc0b-8ebacfbf35c1 req-c916bd72-b12f-442a-bc5b-1b08216f5171 service nova] Creating event network-vif-plugged:ed1256fa-5568-4d60-8d9f-e8b1a8491c98 for instance a046e36a-76db-4e7d-9b92-02e62742e14a on n-h2-836830-4 Jun 16 14:39:53.669220 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-88953895-3135-4239-bc0b-8ebacfbf35c1 req-c916bd72-b12f-442a-bc5b-1b08216f5171 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071455 Jun 16 14:39:53.670918 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 259/569] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:53.682503 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-d0da5a51-2bcc-49bf-b9aa-caa19a0acbff req-5ca7ac9e-62fd-433d-9226-f67266a4481a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e048775-afa2-4ec5-91fd-f5d06c1fe6d3", "tag": "f802939c-946a-4ee0-9525-cc56a9c04b53"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:53.701966 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:UPDATE=11,nova_api:SELECT=76,nova_api:INSERT=13 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:53.721197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-d0da5a51-2bcc-49bf-b9aa-caa19a0acbff req-5ca7ac9e-62fd-433d-9226-f67266a4481a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:53.721961 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-d0da5a51-2bcc-49bf-b9aa-caa19a0acbff req-5ca7ac9e-62fd-433d-9226-f67266a4481a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:53.747799 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-d0da5a51-2bcc-49bf-b9aa-caa19a0acbff req-5ca7ac9e-62fd-433d-9226-f67266a4481a service nova] Creating event network-changed:f802939c-946a-4ee0-9525-cc56a9c04b53 for instance 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 on n-h1-836830-4 Jun 16 14:39:53.755240 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-d0da5a51-2bcc-49bf-b9aa-caa19a0acbff req-5ca7ac9e-62fd-433d-9226-f67266a4481a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081398 Jun 16 14:39:53.774822 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 260/570] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:53.784212 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9f1b97c0-6f4a-4a84-a928-f6b66b787339 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:53.785428 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9f1b97c0-6f4a-4a84-a928-f6b66b787339 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:53.795699 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9f1b97c0-6f4a-4a84-a928-f6b66b787339 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:53.796563 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9f1b97c0-6f4a-4a84-a928-f6b66b787339 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:53.798193 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9f1b97c0-6f4a-4a84-a928-f6b66b787339 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:53.798898 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9f1b97c0-6f4a-4a84-a928-f6b66b787339 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:54.559490 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-eb6b2fe6-48c4-4a07-9ebd-8953953979de tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:54.597703 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-eb6b2fe6-48c4-4a07-9ebd-8953953979de tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1318 microversion: 2.1 time: 2.765822 Jun 16 14:39:54.602287 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 311/571] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:51 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1318 bytes in 2772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:54.623949 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ccf58396-e67a-4456-81ed-d322b3eee0bd tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:54.627156 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ccf58396-e67a-4456-81ed-d322b3eee0bd tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:54.642100 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:54.646149 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ccf58396-e67a-4456-81ed-d322b3eee0bd tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:54.649030 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ccf58396-e67a-4456-81ed-d322b3eee0bd tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:54.650942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ccf58396-e67a-4456-81ed-d322b3eee0bd tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:54.652603 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ccf58396-e67a-4456-81ed-d322b3eee0bd tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:54.865629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9f1b97c0-6f4a-4a84-a928-f6b66b787339 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:54.879783 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9f1b97c0-6f4a-4a84-a928-f6b66b787339 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:54.881610 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9f1b97c0-6f4a-4a84-a928-f6b66b787339 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:54.883313 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9f1b97c0-6f4a-4a84-a928-f6b66b787339 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1361 microversion: 2.25 time: 1.104913 Jun 16 14:39:54.885555 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 261/572] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:39:53 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1361 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:39:54.899722 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-97e20cb9-ae02-406e-b94e-dc871cfcf719 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:54.903811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-97e20cb9-ae02-406e-b94e-dc871cfcf719 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:54.920111 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97e20cb9-ae02-406e-b94e-dc871cfcf719 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:54.921102 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97e20cb9-ae02-406e-b94e-dc871cfcf719 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:54.922037 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97e20cb9-ae02-406e-b94e-dc871cfcf719 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:54.922526 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97e20cb9-ae02-406e-b94e-dc871cfcf719 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:55.559953 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ccf58396-e67a-4456-81ed-d322b3eee0bd tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:55.575831 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ccf58396-e67a-4456-81ed-d322b3eee0bd tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1371 microversion: 2.1 time: 0.971250 Jun 16 14:39:55.577664 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 312/573] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:54 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1371 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:55.584333 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7dd7ba0a-bb22-4da0-9e9f-22d832a8d193 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:55.585551 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7dd7ba0a-bb22-4da0-9e9f-22d832a8d193 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:55.610265 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7dd7ba0a-bb22-4da0-9e9f-22d832a8d193 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:55.611127 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7dd7ba0a-bb22-4da0-9e9f-22d832a8d193 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:55.613181 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7dd7ba0a-bb22-4da0-9e9f-22d832a8d193 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:55.614307 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7dd7ba0a-bb22-4da0-9e9f-22d832a8d193 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:55.834238 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7dd7ba0a-bb22-4da0-9e9f-22d832a8d193 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9d5b3a7df04a5eb2a6dfd69d77e63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da236582a64812bdde5b156b76d1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:55.849215 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7dd7ba0a-bb22-4da0-9e9f-22d832a8d193 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 200 len: 1281 microversion: 2.1 time: 0.269907 Jun 16 14:39:55.859264 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 313/574] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:55 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 1281 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:55.864605 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-0467440c-793f-4a31-b40c-54ab88b77279 req-7ca78881-1865-42a0-98a0-a1949cc0e089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7771166-9bbf-41d0-b3ca-b4515a46a67c", "tag": "763165ed-fb52-4810-9706-7aa1d1b6f7f1"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:55.892024 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-0467440c-793f-4a31-b40c-54ab88b77279 req-7ca78881-1865-42a0-98a0-a1949cc0e089 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:55.892946 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-0467440c-793f-4a31-b40c-54ab88b77279 req-7ca78881-1865-42a0-98a0-a1949cc0e089 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:55.957444 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-0467440c-793f-4a31-b40c-54ab88b77279 req-7ca78881-1865-42a0-98a0-a1949cc0e089 service nova] Creating event network-changed:763165ed-fb52-4810-9706-7aa1d1b6f7f1 for instance e7771166-9bbf-41d0-b3ca-b4515a46a67c on n-h2-836830-4 Jun 16 14:39:56.001044 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-0467440c-793f-4a31-b40c-54ab88b77279 req-7ca78881-1865-42a0-98a0-a1949cc0e089 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128643 Jun 16 14:39:56.002424 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 314/575] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:56.028882 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7a81f7e6-b244-49b1-b8dd-6d81e221e25a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:56.034300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7a81f7e6-b244-49b1-b8dd-6d81e221e25a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:56.069046 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-97e20cb9-ae02-406e-b94e-dc871cfcf719 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:56.070119 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a81f7e6-b244-49b1-b8dd-6d81e221e25a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:56.075685 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a81f7e6-b244-49b1-b8dd-6d81e221e25a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:56.078302 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a81f7e6-b244-49b1-b8dd-6d81e221e25a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:56.085219 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a81f7e6-b244-49b1-b8dd-6d81e221e25a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:56.115167 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-97e20cb9-ae02-406e-b94e-dc871cfcf719 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 200 len: 1391 microversion: 2.1 time: 1.227077 Jun 16 14:39:56.121758 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 262/576] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:54 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 1391 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:56.147480 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4d11885f-e14c-49e5-944b-c431d3edb144 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:56.151046 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:39:56.151766 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4d11885f-e14c-49e5-944b-c431d3edb144 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:56.160118 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d11885f-e14c-49e5-944b-c431d3edb144 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:56.160675 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d11885f-e14c-49e5-944b-c431d3edb144 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:56.162692 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d11885f-e14c-49e5-944b-c431d3edb144 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:56.167673 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d11885f-e14c-49e5-944b-c431d3edb144 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:56.839103 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7a81f7e6-b244-49b1-b8dd-6d81e221e25a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:56.866574 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7a81f7e6-b244-49b1-b8dd-6d81e221e25a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1359 microversion: 2.1 time: 0.858591 Jun 16 14:39:56.872200 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 315/577] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:56 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1359 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:56.889042 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-2adc88bd-2bbe-4f8a-9fa2-d9e6fa83e857 req-528b4dc2-023b-46e2-9419-31ba2805d7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cb64d6-b915-425c-aed2-442d3e2a1676", "name": "network-vif-plugged", "status": "completed", "tag": "dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:56.913814 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-4d11885f-e14c-49e5-944b-c431d3edb144 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:56.924864 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4d11885f-e14c-49e5-944b-c431d3edb144 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1318 microversion: 2.1 time: 0.797599 Jun 16 14:39:56.929918 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 263/578] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:56 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1318 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:56.930668 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-2adc88bd-2bbe-4f8a-9fa2-d9e6fa83e857 req-528b4dc2-023b-46e2-9419-31ba2805d7b8 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:56.931233 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-2adc88bd-2bbe-4f8a-9fa2-d9e6fa83e857 req-528b4dc2-023b-46e2-9419-31ba2805d7b8 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:56.944466 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ba1e8707-52e5-48f5-a010-a7d1fbf762f5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:56.945652 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ba1e8707-52e5-48f5-a010-a7d1fbf762f5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:56.967196 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba1e8707-52e5-48f5-a010-a7d1fbf762f5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:56.967861 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-2adc88bd-2bbe-4f8a-9fa2-d9e6fa83e857 req-528b4dc2-023b-46e2-9419-31ba2805d7b8 service nova] Creating event network-vif-plugged:dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a for instance e8cb64d6-b915-425c-aed2-442d3e2a1676 on n-h1-836830-4 Jun 16 14:39:56.968729 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba1e8707-52e5-48f5-a010-a7d1fbf762f5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:56.969732 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba1e8707-52e5-48f5-a010-a7d1fbf762f5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:56.970710 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba1e8707-52e5-48f5-a010-a7d1fbf762f5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:56.982459 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-2adc88bd-2bbe-4f8a-9fa2-d9e6fa83e857 req-528b4dc2-023b-46e2-9419-31ba2805d7b8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108343 Jun 16 14:39:56.984451 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 316/579] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:57.001826 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-056aedcc-279b-47d7-a2b1-b4df985fd765 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:57.007534 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-056aedcc-279b-47d7-a2b1-b4df985fd765 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:57.027424 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-056aedcc-279b-47d7-a2b1-b4df985fd765 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:57.027893 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-056aedcc-279b-47d7-a2b1-b4df985fd765 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:57.034520 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-056aedcc-279b-47d7-a2b1-b4df985fd765 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:57.040865 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-056aedcc-279b-47d7-a2b1-b4df985fd765 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:57.440144 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ba1e8707-52e5-48f5-a010-a7d1fbf762f5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:57.463878 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ba1e8707-52e5-48f5-a010-a7d1fbf762f5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:57.479947 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ba1e8707-52e5-48f5-a010-a7d1fbf762f5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:57.489451 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ba1e8707-52e5-48f5-a010-a7d1fbf762f5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1361 microversion: 2.25 time: 0.556724 Jun 16 14:39:57.498456 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 264/580] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:39:56 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1361 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:39:57.509062 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-056aedcc-279b-47d7-a2b1-b4df985fd765 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:57.527865 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-55a4787a-6d62-427c-829e-ca2f220d73da tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:57.529931 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-55a4787a-6d62-427c-829e-ca2f220d73da tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:57.533491 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-056aedcc-279b-47d7-a2b1-b4df985fd765 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1371 microversion: 2.1 time: 0.546954 Jun 16 14:39:57.534084 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 317/581] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:56 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1371 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:57.541796 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4b048543-3c74-484c-a004-50fc994b301c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:57.542439 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4b048543-3c74-484c-a004-50fc994b301c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:57.557617 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-55a4787a-6d62-427c-829e-ca2f220d73da tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:57.559512 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-55a4787a-6d62-427c-829e-ca2f220d73da tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:57.561573 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-55a4787a-6d62-427c-829e-ca2f220d73da tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:57.563814 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-55a4787a-6d62-427c-829e-ca2f220d73da tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:57.583314 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b048543-3c74-484c-a004-50fc994b301c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:57.583757 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b048543-3c74-484c-a004-50fc994b301c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:57.585094 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b048543-3c74-484c-a004-50fc994b301c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:57.589658 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b048543-3c74-484c-a004-50fc994b301c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:58.250169 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-55a4787a-6d62-427c-829e-ca2f220d73da tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9d5b3a7df04a5eb2a6dfd69d77e63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da236582a64812bdde5b156b76d1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:58.278283 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-55a4787a-6d62-427c-829e-ca2f220d73da tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 200 len: 1323 microversion: 2.1 time: 0.777619 Jun 16 14:39:58.279210 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 265/582] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:57 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 1323 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:58.300018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-afd4e78a-27dd-4e16-baa2-d516aa9320a7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:58.305474 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-afd4e78a-27dd-4e16-baa2-d516aa9320a7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:58.320972 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-afd4e78a-27dd-4e16-baa2-d516aa9320a7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:58.322113 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-afd4e78a-27dd-4e16-baa2-d516aa9320a7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:58.324759 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-afd4e78a-27dd-4e16-baa2-d516aa9320a7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:58.325380 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-afd4e78a-27dd-4e16-baa2-d516aa9320a7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:58.720544 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-afd4e78a-27dd-4e16-baa2-d516aa9320a7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:58.733498 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-afd4e78a-27dd-4e16-baa2-d516aa9320a7 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1359 microversion: 2.1 time: 0.445890 Jun 16 14:39:58.734173 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 266/583] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:58 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1359 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:58.742188 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-01430cd3-68dd-47da-bbb8-767a9ba2ddf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:58.753088 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-01430cd3-68dd-47da-bbb8-767a9ba2ddf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:58.771383 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01430cd3-68dd-47da-bbb8-767a9ba2ddf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:58.772587 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01430cd3-68dd-47da-bbb8-767a9ba2ddf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:58.775144 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01430cd3-68dd-47da-bbb8-767a9ba2ddf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:58.776626 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01430cd3-68dd-47da-bbb8-767a9ba2ddf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:58.793094 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4b048543-3c74-484c-a004-50fc994b301c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:58.807074 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4b048543-3c74-484c-a004-50fc994b301c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 200 len: 1391 microversion: 2.1 time: 1.271807 Jun 16 14:39:58.808955 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 318/584] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:57 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 1391 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:58.815715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-6868f2ed-e0a0-4542-bbbb-021f7b7b9c45 req-f615b80b-214a-4d4c-b09c-361a4e40d315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b36c679-5452-4c35-ba4a-a19aa69e3fd8", "name": "network-vif-deleted", "tag": "9f8be973-6750-49fd-8447-597286585736"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:58.847042 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-6868f2ed-e0a0-4542-bbbb-021f7b7b9c45 req-f615b80b-214a-4d4c-b09c-361a4e40d315 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:58.850707 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-6868f2ed-e0a0-4542-bbbb-021f7b7b9c45 req-f615b80b-214a-4d4c-b09c-361a4e40d315 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:58.877617 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-6868f2ed-e0a0-4542-bbbb-021f7b7b9c45 req-f615b80b-214a-4d4c-b09c-361a4e40d315 service nova] Creating event network-vif-deleted:9f8be973-6750-49fd-8447-597286585736 for instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 on n-h1-836830-4 Jun 16 14:39:58.908322 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-6868f2ed-e0a0-4542-bbbb-021f7b7b9c45 req-f615b80b-214a-4d4c-b09c-361a4e40d315 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096094 Jun 16 14:39:58.910107 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 319/585] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:58.946433 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-cab4902b-b63f-476c-a18f-71456dd0361f req-a537cbde-1948-440e-bbec-2011b7b599e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc39a7a1-2d9e-4eec-b07d-9f85e148665e", "tag": "8dc21a1c-aebf-4862-afc4-a9a93eaf0386"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:39:58.989956 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-cab4902b-b63f-476c-a18f-71456dd0361f req-a537cbde-1948-440e-bbec-2011b7b599e6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:58.995495 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-cab4902b-b63f-476c-a18f-71456dd0361f req-a537cbde-1948-440e-bbec-2011b7b599e6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:59.054431 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-cab4902b-b63f-476c-a18f-71456dd0361f req-a537cbde-1948-440e-bbec-2011b7b599e6 service nova] Creating event network-changed:8dc21a1c-aebf-4862-afc4-a9a93eaf0386 for instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e on n-h2-836830-4 Jun 16 14:39:59.080163 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-cab4902b-b63f-476c-a18f-71456dd0361f req-a537cbde-1948-440e-bbec-2011b7b599e6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165605 Jun 16 14:39:59.087773 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 320/586] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:39:59.112006 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-dc8aef05-e90b-4b66-81c8-393f08bb0136 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:59.112006 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-dc8aef05-e90b-4b66-81c8-393f08bb0136 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:59.127706 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dc8aef05-e90b-4b66-81c8-393f08bb0136 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:59.135787 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dc8aef05-e90b-4b66-81c8-393f08bb0136 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:59.136993 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dc8aef05-e90b-4b66-81c8-393f08bb0136 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:59.137449 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dc8aef05-e90b-4b66-81c8-393f08bb0136 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:59.445028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-01430cd3-68dd-47da-bbb8-767a9ba2ddf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:59.463780 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-01430cd3-68dd-47da-bbb8-767a9ba2ddf0 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1468 microversion: 2.1 time: 0.726959 Jun 16 14:39:59.476804 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 267/587] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:58 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1468 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:39:59.483833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-95c063c5-3167-42b1-b525-f9fa68ee5e58 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:59.484733 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-95c063c5-3167-42b1-b525-f9fa68ee5e58 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:59.492881 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-95c063c5-3167-42b1-b525-f9fa68ee5e58 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:59.493606 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-95c063c5-3167-42b1-b525-f9fa68ee5e58 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:59.494710 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-95c063c5-3167-42b1-b525-f9fa68ee5e58 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:59.495413 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-95c063c5-3167-42b1-b525-f9fa68ee5e58 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:59.604833 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-dc8aef05-e90b-4b66-81c8-393f08bb0136 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:59.626428 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-dc8aef05-e90b-4b66-81c8-393f08bb0136 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:59.631828 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-dc8aef05-e90b-4b66-81c8-393f08bb0136 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:39:59.639216 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-dc8aef05-e90b-4b66-81c8-393f08bb0136 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1361 microversion: 2.25 time: 0.546235 Jun 16 14:39:59.643691 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 321/588] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:39:59 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1361 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:39:59.657202 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ab3862b2-a499-4c35-b0d3-fc50253378e7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:39:59.664368 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ab3862b2-a499-4c35-b0d3-fc50253378e7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:39:59.682219 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ab3862b2-a499-4c35-b0d3-fc50253378e7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:59.683265 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ab3862b2-a499-4c35-b0d3-fc50253378e7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:39:59.684559 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ab3862b2-a499-4c35-b0d3-fc50253378e7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:39:59.685265 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ab3862b2-a499-4c35-b0d3-fc50253378e7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:00.168406 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ab3862b2-a499-4c35-b0d3-fc50253378e7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9d5b3a7df04a5eb2a6dfd69d77e63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da236582a64812bdde5b156b76d1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:00.180997 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ab3862b2-a499-4c35-b0d3-fc50253378e7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 200 len: 1323 microversion: 2.1 time: 0.535593 Jun 16 14:40:00.199278 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 322/589] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:59 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 1323 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:00.441986 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-95c063c5-3167-42b1-b525-f9fa68ee5e58 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:00.455774 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-95c063c5-3167-42b1-b525-f9fa68ee5e58 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1371 microversion: 2.1 time: 0.977442 Jun 16 14:40:00.471481 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 268/590] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:39:59 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1371 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:00.477801 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a62f325d-a1f2-4326-947a-a26cac127ac4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:00.492645 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a62f325d-a1f2-4326-947a-a26cac127ac4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:00.517835 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a62f325d-a1f2-4326-947a-a26cac127ac4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:00.518311 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a62f325d-a1f2-4326-947a-a26cac127ac4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:00.519252 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a62f325d-a1f2-4326-947a-a26cac127ac4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:00.525772 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a62f325d-a1f2-4326-947a-a26cac127ac4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:00.830843 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ce1d0d53-9e88-4d41-b276-a792b9dc4c2f tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1898210355", "block_migration": true, "disk_over_commit": false}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:00.834239 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ce1d0d53-9e88-4d41-b276-a792b9dc4c2f tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:00.853496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ce1d0d53-9e88-4d41-b276-a792b9dc4c2f tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:00.855970 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ce1d0d53-9e88-4d41-b276-a792b9dc4c2f tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:00.858745 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ce1d0d53-9e88-4d41-b276-a792b9dc4c2f tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:00.860114 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ce1d0d53-9e88-4d41-b276-a792b9dc4c2f tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:00.954347 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-ce1d0d53-9e88-4d41-b276-a792b9dc4c2f tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lazy-loading 'flavor' on Instance uuid a046e36a-76db-4e7d-9b92-02e62742e14a {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:40:00.984046 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ce1d0d53-9e88-4d41-b276-a792b9dc4c2f tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Going to try to live migrate instance to tempest-host-1898210355 {{(pid=125863) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 14:40:01.013957 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-ce1d0d53-9e88-4d41-b276-a792b9dc4c2f tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] HTTP exception thrown: Compute host tempest-host-1898210355 could not be found. Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ce1d0d53-9e88-4d41-b276-a792b9dc4c2f tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Request method failure captured: Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a/action HTTP/1.1 Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 107 Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0CRggOwjTMCHkTOHPYmgD6RhU1alBi6PGg9Q2m4WKzZQyUWONOUxW9QbIy1tFXJdfADyRVZCpF3KiSLAS22Wxmive4qFserkOtVXZ3AHI67_xwVA5kOGdesnZTbljbpl12rFV1PNey0tqQsAFYfIFy4Kc0MBCC1kKqrR3Bey1GvMsM Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 45e8163bedcd493291ced82d4f5a6092 Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-LiveMigrationNegativeTest-1119711907 Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:40:01.050200 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:40:01.052006 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_45e8163bedcd493291ced82d4f5a6092", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/45e8163bedcd493291ced82d4f5a6092"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/45e8163bedcd493291ced82d4f5a6092"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/45e8163bedcd493291ced82d4f5a6092"}]}] Jun 16 14:40:01.052006 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-LiveMigrationNegativeTest-1119711907 Jun 16 14:40:01.052006 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 45e8163bedcd493291ced82d4f5a6092 Jun 16 14:40:01.052006 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1119711907 Jun 16 14:40:01.052006 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-LiveMigrationNegativeTest-1119711907-project-admin Jun 16 14:40:01.052006 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:40:01.052006 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:40:01.052006 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 254567906e684352b7881dd67857d311 Jun 16 14:40:01.052006 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-LiveMigrationNegativeTest-1119711907-project-admin Jun 16 14:40:01.052006 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:40:01.052006 n-d-836830-4 devstack@n-api.service[125863]: {"os-migrateLive": {"host": "tempest-host-1898210355", "block_migration": true, "disk_over_commit": false}} Jun 16 14:40:01.052006 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: exception: Compute host tempest-host-1898210355 could not be found. Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'a046e36a-76db-4e7d-9b92-02e62742e14a', 'body': {'os-migrateLive': {'host': 'tempest-host-1898210355', 'block_migration': True, 'disk_over_commit': False}}} Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 14:40:01.052944 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1898210355 could not be found. Jun 16 14:40:01.058780 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1898210355 could not be found. Jun 16 14:40:01.061641 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:01.064675 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:40:01.064675 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:01.064675 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:01.064675 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:40:01.064675 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:40:01.064675 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:40:01.064675 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:40:01.064675 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1898210355 could not be found. Jun 16 14:40:01.064675 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:01.064675 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ce1d0d53-9e88-4d41-b276-a792b9dc4c2f tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Returning 400 to user: Compute host tempest-host-1898210355 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:40:01.064675 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ce1d0d53-9e88-4d41-b276-a792b9dc4c2f tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a/action" status: 400 len: 100 microversion: 2.1 time: 0.851264 Jun 16 14:40:01.064675 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 323/591] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Jun 16 14:40:00 2022] POST /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a/action => generated 100 bytes in 854 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:40:01.071013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cec8842f-7777-494c-83d9-885230ed6629 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:01.071930 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cec8842f-7777-494c-83d9-885230ed6629 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:01.091277 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cec8842f-7777-494c-83d9-885230ed6629 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:01.091472 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cec8842f-7777-494c-83d9-885230ed6629 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:01.092290 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cec8842f-7777-494c-83d9-885230ed6629 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:01.092935 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cec8842f-7777-494c-83d9-885230ed6629 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:01.525117 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-cec8842f-7777-494c-83d9-885230ed6629 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:01.544526 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cec8842f-7777-494c-83d9-885230ed6629 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 200 len: 1391 microversion: 2.1 time: 0.487242 Jun 16 14:40:01.546998 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 324/592] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:01 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 1391 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:01.558295 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b8b7024d-7fb8-4dbc-a270-3c6f1fbc0d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:01.560316 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b8b7024d-7fb8-4dbc-a270-3c6f1fbc0d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:01.596054 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b8b7024d-7fb8-4dbc-a270-3c6f1fbc0d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:01.597464 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b8b7024d-7fb8-4dbc-a270-3c6f1fbc0d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:01.602105 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b8b7024d-7fb8-4dbc-a270-3c6f1fbc0d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:01.603584 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b8b7024d-7fb8-4dbc-a270-3c6f1fbc0d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:01.980152 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b8b7024d-7fb8-4dbc-a270-3c6f1fbc0d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:01.998053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b8b7024d-7fb8-4dbc-a270-3c6f1fbc0d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:02.000333 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b8b7024d-7fb8-4dbc-a270-3c6f1fbc0d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:02.018163 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b8b7024d-7fb8-4dbc-a270-3c6f1fbc0d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1361 microversion: 2.25 time: 0.458520 Jun 16 14:40:02.019236 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 325/593] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:01 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1361 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:02.040202 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f9673704-536d-4a8a-bde5-8b39bd857820 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:02.040998 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f9673704-536d-4a8a-bde5-8b39bd857820 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:02.060560 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f9673704-536d-4a8a-bde5-8b39bd857820 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:02.061051 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f9673704-536d-4a8a-bde5-8b39bd857820 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:02.061888 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f9673704-536d-4a8a-bde5-8b39bd857820 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:02.062799 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f9673704-536d-4a8a-bde5-8b39bd857820 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:02.113580 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a62f325d-a1f2-4326-947a-a26cac127ac4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:02.152474 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a62f325d-a1f2-4326-947a-a26cac127ac4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1542 microversion: 2.1 time: 1.678946 Jun 16 14:40:02.161349 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 269/594] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:00 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1542 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:02.185882 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ac35df3b-c288-48b9-b132-bb39a76a868c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:02.198948 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ac35df3b-c288-48b9-b132-bb39a76a868c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:02.228783 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac35df3b-c288-48b9-b132-bb39a76a868c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:02.229639 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac35df3b-c288-48b9-b132-bb39a76a868c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:02.231619 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac35df3b-c288-48b9-b132-bb39a76a868c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:02.232412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac35df3b-c288-48b9-b132-bb39a76a868c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:02.574150 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f9673704-536d-4a8a-bde5-8b39bd857820 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:02.601535 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f9673704-536d-4a8a-bde5-8b39bd857820 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1468 microversion: 2.1 time: 0.580035 Jun 16 14:40:02.607041 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 326/595] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:02 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1468 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:02.627958 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9199dce5-f27a-4bdf-a7ad-4eb5edf8199b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:02.631069 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9199dce5-f27a-4bdf-a7ad-4eb5edf8199b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:02.660061 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9199dce5-f27a-4bdf-a7ad-4eb5edf8199b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:02.661712 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9199dce5-f27a-4bdf-a7ad-4eb5edf8199b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:02.664305 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9199dce5-f27a-4bdf-a7ad-4eb5edf8199b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:02.665087 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9199dce5-f27a-4bdf-a7ad-4eb5edf8199b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:03.018417 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9199dce5-f27a-4bdf-a7ad-4eb5edf8199b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:03.046737 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9199dce5-f27a-4bdf-a7ad-4eb5edf8199b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1371 microversion: 2.1 time: 0.436819 Jun 16 14:40:03.047815 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 327/596] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:02 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1371 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:03.059472 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-f5ed3195-f048-4592-9173-fe4cedd36f41 req-1e4a125c-745b-405e-b4de-744c400ff112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9531184d-4ad3-4c41-b4f9-16b24ae0d6b6", "tag": "5642ee3e-05f2-4ee8-815f-d629815c9aa4"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:03.079558 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-f5ed3195-f048-4592-9173-fe4cedd36f41 req-1e4a125c-745b-405e-b4de-744c400ff112 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:03.082568 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-f5ed3195-f048-4592-9173-fe4cedd36f41 req-1e4a125c-745b-405e-b4de-744c400ff112 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:03.127637 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-f5ed3195-f048-4592-9173-fe4cedd36f41 req-1e4a125c-745b-405e-b4de-744c400ff112 service nova] Creating event network-changed:5642ee3e-05f2-4ee8-815f-d629815c9aa4 for instance 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 on n-h1-836830-4 Jun 16 14:40:03.141324 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-f5ed3195-f048-4592-9173-fe4cedd36f41 req-1e4a125c-745b-405e-b4de-744c400ff112 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090968 Jun 16 14:40:03.150964 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 328/597] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:03.173187 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7c5e48cd-5109-44e1-a765-631228ff153b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:03.174230 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7c5e48cd-5109-44e1-a765-631228ff153b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:03.188168 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7c5e48cd-5109-44e1-a765-631228ff153b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:03.188982 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7c5e48cd-5109-44e1-a765-631228ff153b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:03.190482 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7c5e48cd-5109-44e1-a765-631228ff153b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:03.191289 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7c5e48cd-5109-44e1-a765-631228ff153b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:03.342773 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7c5e48cd-5109-44e1-a765-631228ff153b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.189386 Jun 16 14:40:03.344242 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 329/598] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 16 14:40:03 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:03.349945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b0c72e28-9d20-49fb-ba95-703b3491327c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:03.351678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b0c72e28-9d20-49fb-ba95-703b3491327c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:03.360822 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b0c72e28-9d20-49fb-ba95-703b3491327c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:03.361732 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b0c72e28-9d20-49fb-ba95-703b3491327c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:03.362972 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b0c72e28-9d20-49fb-ba95-703b3491327c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:03.363986 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b0c72e28-9d20-49fb-ba95-703b3491327c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:03.644558 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ac35df3b-c288-48b9-b132-bb39a76a868c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9d5b3a7df04a5eb2a6dfd69d77e63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da236582a64812bdde5b156b76d1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:03.679247 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ac35df3b-c288-48b9-b132-bb39a76a868c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 200 len: 1323 microversion: 2.1 time: 1.511142 Jun 16 14:40:03.683851 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 270/599] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:02 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 1323 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:03.702745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1186954455", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:03.811289 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] validate_networks() for None {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:40:04.242043 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b0c72e28-9d20-49fb-ba95-703b3491327c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:04.329123 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b0c72e28-9d20-49fb-ba95-703b3491327c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 200 len: 1391 microversion: 2.1 time: 0.983256 Jun 16 14:40:04.330110 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 330/600] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:03 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 1391 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:04.347449 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-fe7a2a3e-51c3-4a90-82c8-943272d6d575 req-1fb99f03-05f2-47f8-a5cc-572630a1f4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7771166-9bbf-41d0-b3ca-b4515a46a67c", "name": "network-vif-plugged", "status": "completed", "tag": "763165ed-fb52-4810-9706-7aa1d1b6f7f1"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:04.358010 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-fe7a2a3e-51c3-4a90-82c8-943272d6d575 req-1fb99f03-05f2-47f8-a5cc-572630a1f4f6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:04.359189 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-fe7a2a3e-51c3-4a90-82c8-943272d6d575 req-1fb99f03-05f2-47f8-a5cc-572630a1f4f6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:04.378193 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-fe7a2a3e-51c3-4a90-82c8-943272d6d575 req-1fb99f03-05f2-47f8-a5cc-572630a1f4f6 service nova] Creating event network-vif-plugged:763165ed-fb52-4810-9706-7aa1d1b6f7f1 for instance e7771166-9bbf-41d0-b3ca-b4515a46a67c on n-h2-836830-4 Jun 16 14:40:04.387486 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-fe7a2a3e-51c3-4a90-82c8-943272d6d575 req-1fb99f03-05f2-47f8-a5cc-572630a1f4f6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054958 Jun 16 14:40:04.388878 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 331/601] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:04.395491 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3413a97f-490a-44c5-b3d6-12cde467d54c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:04.398584 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3413a97f-490a-44c5-b3d6-12cde467d54c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:04.414441 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3413a97f-490a-44c5-b3d6-12cde467d54c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:04.415788 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3413a97f-490a-44c5-b3d6-12cde467d54c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:04.417529 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3413a97f-490a-44c5-b3d6-12cde467d54c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:04.418765 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3413a97f-490a-44c5-b3d6-12cde467d54c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:04.673507 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:40:04.674462 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:40:04.675287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:40:04.675916 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:40:04.676721 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:40:04.697633 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:04.699118 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:04.701704 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:04.702797 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:04.744853 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Getting quotas for project f1abbeadf6d14290a877226e9c7aaba5. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:40:04.754335 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Getting quotas for user fb3c3d0c6cae46fd9580de9fa58447d2 and project f1abbeadf6d14290a877226e9c7aaba5. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:40:04.800383 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:40:04.804079 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:40:04.892336 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-75ee9192-0485-4969-97d1-9ce5ce1b24c3 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.206469 Jun 16 14:40:04.899784 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 271/602] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:40:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:40:04.919440 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2bc052a2-d2bb-4c68-9e98-b6927bdca1f3 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:04.920953 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2bc052a2-d2bb-4c68-9e98-b6927bdca1f3 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:04.929923 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2bc052a2-d2bb-4c68-9e98-b6927bdca1f3 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:04.931264 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2bc052a2-d2bb-4c68-9e98-b6927bdca1f3 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:04.932697 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2bc052a2-d2bb-4c68-9e98-b6927bdca1f3 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:04.933364 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2bc052a2-d2bb-4c68-9e98-b6927bdca1f3 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:05.809734 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2bc052a2-d2bb-4c68-9e98-b6927bdca1f3 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:05.825100 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2bc052a2-d2bb-4c68-9e98-b6927bdca1f3 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1371 microversion: 2.1 time: 0.923225 Jun 16 14:40:05.826111 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3413a97f-490a-44c5-b3d6-12cde467d54c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:05.826752 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 272/603] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:04 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1371 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:05.832138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-368a530c-36f1-472d-80e7-ddd6db309e33 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:05.833687 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-368a530c-36f1-472d-80e7-ddd6db309e33 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:05.841693 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-368a530c-36f1-472d-80e7-ddd6db309e33 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:05.842650 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-368a530c-36f1-472d-80e7-ddd6db309e33 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:05.844298 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-368a530c-36f1-472d-80e7-ddd6db309e33 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:05.844998 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-368a530c-36f1-472d-80e7-ddd6db309e33 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:05.862769 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3413a97f-490a-44c5-b3d6-12cde467d54c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:05.867814 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3413a97f-490a-44c5-b3d6-12cde467d54c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:05.870055 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3413a97f-490a-44c5-b3d6-12cde467d54c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1361 microversion: 2.25 time: 1.479210 Jun 16 14:40:05.872727 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 332/604] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:04 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1361 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:05.889799 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b65a1d06-c180-490f-ab74-e4475eb01ed7 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:05.890906 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b65a1d06-c180-490f-ab74-e4475eb01ed7 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:06.130368 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b65a1d06-c180-490f-ab74-e4475eb01ed7 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:06.141181 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b65a1d06-c180-490f-ab74-e4475eb01ed7 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1219 microversion: 2.1 time: 0.266695 Jun 16 14:40:06.151401 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 333/605] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:05 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1219 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:06.153985 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d074fcf3-891f-42ff-b212-19de3afe4d2e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:06.155750 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d074fcf3-891f-42ff-b212-19de3afe4d2e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:06.170685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-368a530c-36f1-472d-80e7-ddd6db309e33 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9d5b3a7df04a5eb2a6dfd69d77e63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da236582a64812bdde5b156b76d1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:06.176157 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d074fcf3-891f-42ff-b212-19de3afe4d2e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:06.176706 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d074fcf3-891f-42ff-b212-19de3afe4d2e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:06.177554 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d074fcf3-891f-42ff-b212-19de3afe4d2e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:06.178021 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d074fcf3-891f-42ff-b212-19de3afe4d2e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:06.184984 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-368a530c-36f1-472d-80e7-ddd6db309e33 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 200 len: 1323 microversion: 2.1 time: 0.356434 Jun 16 14:40:06.187361 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 273/606] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:05 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 1323 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:06.460933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-4a1ca17b-98f7-422f-9300-cdd9cc080aa2 req-5f3ede60-066e-4ce6-a9ec-1cdee9db8a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e048775-afa2-4ec5-91fd-f5d06c1fe6d3", "name": "network-vif-plugged", "status": "completed", "tag": "f802939c-946a-4ee0-9525-cc56a9c04b53"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:06.485456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-4a1ca17b-98f7-422f-9300-cdd9cc080aa2 req-5f3ede60-066e-4ce6-a9ec-1cdee9db8a6a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:06.488095 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-4a1ca17b-98f7-422f-9300-cdd9cc080aa2 req-5f3ede60-066e-4ce6-a9ec-1cdee9db8a6a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:06.521577 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-4a1ca17b-98f7-422f-9300-cdd9cc080aa2 req-5f3ede60-066e-4ce6-a9ec-1cdee9db8a6a service nova] Creating event network-vif-plugged:f802939c-946a-4ee0-9525-cc56a9c04b53 for instance 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 on n-h1-836830-4 Jun 16 14:40:06.538966 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-4a1ca17b-98f7-422f-9300-cdd9cc080aa2 req-5f3ede60-066e-4ce6-a9ec-1cdee9db8a6a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082789 Jun 16 14:40:06.540960 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 274/607] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:40:06.861591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7e5b6cda-0dfe-4d74-986b-c4ff7c7faf95 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:06.868528 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7e5b6cda-0dfe-4d74-986b-c4ff7c7faf95 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:06.895114 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7e5b6cda-0dfe-4d74-986b-c4ff7c7faf95 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:06.896799 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7e5b6cda-0dfe-4d74-986b-c4ff7c7faf95 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:06.905508 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7e5b6cda-0dfe-4d74-986b-c4ff7c7faf95 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:06.908309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7e5b6cda-0dfe-4d74-986b-c4ff7c7faf95 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:07.232375 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d074fcf3-891f-42ff-b212-19de3afe4d2e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:07.259448 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d074fcf3-891f-42ff-b212-19de3afe4d2e tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 200 len: 1391 microversion: 2.1 time: 1.114496 Jun 16 14:40:07.264702 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 334/608] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:06 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 1391 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:07.283826 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-012a2b41-f88f-4c2a-9d58-631686cbe618 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:07.287719 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-012a2b41-f88f-4c2a-9d58-631686cbe618 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:07.320493 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-012a2b41-f88f-4c2a-9d58-631686cbe618 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:07.321961 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-012a2b41-f88f-4c2a-9d58-631686cbe618 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:07.326457 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-012a2b41-f88f-4c2a-9d58-631686cbe618 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:07.332530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-012a2b41-f88f-4c2a-9d58-631686cbe618 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:07.949638 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7e5b6cda-0dfe-4d74-986b-c4ff7c7faf95 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:07.970164 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7e5b6cda-0dfe-4d74-986b-c4ff7c7faf95 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1371 microversion: 2.1 time: 1.112338 Jun 16 14:40:07.974647 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 275/609] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:06 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1371 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:07.995263 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f55911c1-5f11-4b79-ac41-a0571ae6a800 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:07.996265 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f55911c1-5f11-4b79-ac41-a0571ae6a800 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:08.018847 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f55911c1-5f11-4b79-ac41-a0571ae6a800 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:08.021277 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f55911c1-5f11-4b79-ac41-a0571ae6a800 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:08.025070 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f55911c1-5f11-4b79-ac41-a0571ae6a800 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:08.031528 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f55911c1-5f11-4b79-ac41-a0571ae6a800 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:08.051312 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:08.345232 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f55911c1-5f11-4b79-ac41-a0571ae6a800 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:08.359212 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f55911c1-5f11-4b79-ac41-a0571ae6a800 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1277 microversion: 2.1 time: 0.375481 Jun 16 14:40:08.360187 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 276/610] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:07 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1277 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:08.371284 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-914e0c70-3ca7-4dc1-9fa0-c48bfb9468d1 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:08.372369 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-914e0c70-3ca7-4dc1-9fa0-c48bfb9468d1 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:08.388697 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-914e0c70-3ca7-4dc1-9fa0-c48bfb9468d1 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:08.389868 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-914e0c70-3ca7-4dc1-9fa0-c48bfb9468d1 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:08.391927 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-914e0c70-3ca7-4dc1-9fa0-c48bfb9468d1 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:08.393275 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-914e0c70-3ca7-4dc1-9fa0-c48bfb9468d1 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:08.514502 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-012a2b41-f88f-4c2a-9d58-631686cbe618 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:08.577613 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-012a2b41-f88f-4c2a-9d58-631686cbe618 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:08.582300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-012a2b41-f88f-4c2a-9d58-631686cbe618 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:08.587199 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-012a2b41-f88f-4c2a-9d58-631686cbe618 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1361 microversion: 2.25 time: 1.315856 Jun 16 14:40:08.603376 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 335/611] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:07 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1361 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:08.622931 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d0a30b73-3dab-4502-a2f6-a2739b32e41f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:08.625022 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d0a30b73-3dab-4502-a2f6-a2739b32e41f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:08.641410 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d0a30b73-3dab-4502-a2f6-a2739b32e41f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:08.642889 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d0a30b73-3dab-4502-a2f6-a2739b32e41f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:08.644938 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d0a30b73-3dab-4502-a2f6-a2739b32e41f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:08.646684 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d0a30b73-3dab-4502-a2f6-a2739b32e41f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:08.724206 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:09.438483 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-914e0c70-3ca7-4dc1-9fa0-c48bfb9468d1 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9d5b3a7df04a5eb2a6dfd69d77e63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da236582a64812bdde5b156b76d1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:09.479400 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-914e0c70-3ca7-4dc1-9fa0-c48bfb9468d1 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 200 len: 1323 microversion: 2.1 time: 1.116794 Jun 16 14:40:09.486657 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 277/612] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:08 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 1323 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:09.511991 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-3b2d1184-976f-4974-80b9-c984942441fe req-f0a4b4d6-c935-4a7e-abe6-5195925f70f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc39a7a1-2d9e-4eec-b07d-9f85e148665e", "name": "network-vif-plugged", "status": "completed", "tag": "8dc21a1c-aebf-4862-afc4-a9a93eaf0386"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:09.516455 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d0a30b73-3dab-4502-a2f6-a2739b32e41f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:09.524061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3b2d1184-976f-4974-80b9-c984942441fe req-f0a4b4d6-c935-4a7e-abe6-5195925f70f2 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:09.526789 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3b2d1184-976f-4974-80b9-c984942441fe req-f0a4b4d6-c935-4a7e-abe6-5195925f70f2 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:09.534610 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d0a30b73-3dab-4502-a2f6-a2739b32e41f tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 200 len: 1391 microversion: 2.1 time: 0.929079 Jun 16 14:40:09.535559 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 336/613] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:08 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 1391 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:09.555763 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-3b2d1184-976f-4974-80b9-c984942441fe req-f0a4b4d6-c935-4a7e-abe6-5195925f70f2 service nova] Creating event network-vif-plugged:8dc21a1c-aebf-4862-afc4-a9a93eaf0386 for instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e on n-h2-836830-4 Jun 16 14:40:09.559897 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6284710b-1938-49a0-8251-50d9f2920c40 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:09.563489 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6284710b-1938-49a0-8251-50d9f2920c40 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:09.579009 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-3b2d1184-976f-4974-80b9-c984942441fe req-f0a4b4d6-c935-4a7e-abe6-5195925f70f2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089933 Jun 16 14:40:09.580297 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 278/614] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:09.581585 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6284710b-1938-49a0-8251-50d9f2920c40 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:09.582104 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6284710b-1938-49a0-8251-50d9f2920c40 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:09.583179 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6284710b-1938-49a0-8251-50d9f2920c40 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:09.583679 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6284710b-1938-49a0-8251-50d9f2920c40 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:09.607695 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c297935b-f4cd-4136-abed-88ad0c24d83c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:09.608504 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c297935b-f4cd-4136-abed-88ad0c24d83c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:09.633538 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c297935b-f4cd-4136-abed-88ad0c24d83c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:09.639664 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c297935b-f4cd-4136-abed-88ad0c24d83c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:09.641036 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c297935b-f4cd-4136-abed-88ad0c24d83c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:09.641518 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c297935b-f4cd-4136-abed-88ad0c24d83c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:09.965501 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6284710b-1938-49a0-8251-50d9f2920c40 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:09.984742 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6284710b-1938-49a0-8251-50d9f2920c40 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1557 microversion: 2.1 time: 0.433361 Jun 16 14:40:09.997320 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 337/615] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:09 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1557 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:10.034935 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c297935b-f4cd-4136-abed-88ad0c24d83c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:10.043704 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-04de3409-b587-4045-a1ec-037975228454 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:10.044886 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-04de3409-b587-4045-a1ec-037975228454 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:10.047670 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c297935b-f4cd-4136-abed-88ad0c24d83c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1277 microversion: 2.1 time: 0.465803 Jun 16 14:40:10.048385 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 279/616] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:09 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1277 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:10.065913 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-451678e6-ad1e-4c19-8edc-1ab29ec5ecf8 req-dc329591-ec94-4fbe-b10b-c12625afbe5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cb64d6-b915-425c-aed2-442d3e2a1676", "tag": "dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:10.090003 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-04de3409-b587-4045-a1ec-037975228454 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:10.090824 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-04de3409-b587-4045-a1ec-037975228454 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:10.096786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-451678e6-ad1e-4c19-8edc-1ab29ec5ecf8 req-dc329591-ec94-4fbe-b10b-c12625afbe5a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:10.099576 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-451678e6-ad1e-4c19-8edc-1ab29ec5ecf8 req-dc329591-ec94-4fbe-b10b-c12625afbe5a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:10.109508 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-04de3409-b587-4045-a1ec-037975228454 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:10.110637 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-04de3409-b587-4045-a1ec-037975228454 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:10.136042 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-451678e6-ad1e-4c19-8edc-1ab29ec5ecf8 req-dc329591-ec94-4fbe-b10b-c12625afbe5a service nova] Creating event network-changed:dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a for instance e8cb64d6-b915-425c-aed2-442d3e2a1676 on n-h1-836830-4 Jun 16 14:40:10.162223 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-451678e6-ad1e-4c19-8edc-1ab29ec5ecf8 req-dc329591-ec94-4fbe-b10b-c12625afbe5a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100457 Jun 16 14:40:10.164452 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 280/617] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:10.177051 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5d83dddd-59c7-43d0-a206-d291100ecbf4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:10.189862 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5d83dddd-59c7-43d0-a206-d291100ecbf4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:10.212336 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d83dddd-59c7-43d0-a206-d291100ecbf4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:10.218710 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d83dddd-59c7-43d0-a206-d291100ecbf4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:10.219882 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d83dddd-59c7-43d0-a206-d291100ecbf4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:10.223290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d83dddd-59c7-43d0-a206-d291100ecbf4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:10.902257 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-04de3409-b587-4045-a1ec-037975228454 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:10.954526 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-04de3409-b587-4045-a1ec-037975228454 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:10.979483 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-04de3409-b587-4045-a1ec-037975228454 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:10.981962 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-04de3409-b587-4045-a1ec-037975228454 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1556 microversion: 2.25 time: 0.971898 Jun 16 14:40:10.996469 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 338/618] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:09 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1556 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:11.019639 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-de488e3f-29df-4488-8854-45f0fbce3a8c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:11.021645 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-de488e3f-29df-4488-8854-45f0fbce3a8c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:11.034627 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de488e3f-29df-4488-8854-45f0fbce3a8c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:11.035699 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de488e3f-29df-4488-8854-45f0fbce3a8c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:11.037456 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de488e3f-29df-4488-8854-45f0fbce3a8c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:11.039226 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de488e3f-29df-4488-8854-45f0fbce3a8c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:11.558585 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-de488e3f-29df-4488-8854-45f0fbce3a8c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9d5b3a7df04a5eb2a6dfd69d77e63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da236582a64812bdde5b156b76d1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:11.577814 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-de488e3f-29df-4488-8854-45f0fbce3a8c tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 200 len: 1323 microversion: 2.1 time: 0.565785 Jun 16 14:40:11.604261 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 339/619] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:11 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 1323 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:11.627839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ddfdef48-5a4c-4371-bc56-6459fcc656d5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:11.629363 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ddfdef48-5a4c-4371-bc56-6459fcc656d5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:11.659042 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddfdef48-5a4c-4371-bc56-6459fcc656d5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:11.660418 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddfdef48-5a4c-4371-bc56-6459fcc656d5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:11.662287 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddfdef48-5a4c-4371-bc56-6459fcc656d5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:11.664795 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddfdef48-5a4c-4371-bc56-6459fcc656d5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:11.717716 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5d83dddd-59c7-43d0-a206-d291100ecbf4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.551645 Jun 16 14:40:11.719001 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 281/620] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 16 14:40:10 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c/os-interface => generated 285 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:12.044870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a2eed4da-2e31-42a1-b777-1c95c2180f33 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:12.049276 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a2eed4da-2e31-42a1-b777-1c95c2180f33 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:12.071886 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a2eed4da-2e31-42a1-b777-1c95c2180f33 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:12.076666 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a2eed4da-2e31-42a1-b777-1c95c2180f33 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:12.096730 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a2eed4da-2e31-42a1-b777-1c95c2180f33 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:12.098021 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a2eed4da-2e31-42a1-b777-1c95c2180f33 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:12.911929 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ddfdef48-5a4c-4371-bc56-6459fcc656d5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:12.934177 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ddfdef48-5a4c-4371-bc56-6459fcc656d5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 200 len: 1589 microversion: 2.1 time: 1.329098 Jun 16 14:40:12.935114 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 340/621] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:11 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 1589 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:12.940685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-a2eed4da-2e31-42a1-b777-1c95c2180f33 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'services' on Instance uuid 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:40:12.952194 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-51366443-ee5c-4602-957d-6f3a6e3d1706 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:12.952991 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-51366443-ee5c-4602-957d-6f3a6e3d1706 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:12.971913 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-51366443-ee5c-4602-957d-6f3a6e3d1706 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:12.989633 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-51366443-ee5c-4602-957d-6f3a6e3d1706 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:12.995548 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-51366443-ee5c-4602-957d-6f3a6e3d1706 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:12.996424 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-51366443-ee5c-4602-957d-6f3a6e3d1706 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:13.129085 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a2eed4da-2e31-42a1-b777-1c95c2180f33 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 2048 microversion: 2.25 time: 1.408391 Jun 16 14:40:13.131058 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 282/622] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:11 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 2048 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:13.140094 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6b529ac9-fdb0-46b0-a280-d8aad0d704a9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:13.141342 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6b529ac9-fdb0-46b0-a280-d8aad0d704a9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:13.152782 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6b529ac9-fdb0-46b0-a280-d8aad0d704a9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:13.153629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6b529ac9-fdb0-46b0-a280-d8aad0d704a9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:13.156148 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6b529ac9-fdb0-46b0-a280-d8aad0d704a9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:13.169208 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6b529ac9-fdb0-46b0-a280-d8aad0d704a9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:13.558598 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-51366443-ee5c-4602-957d-6f3a6e3d1706 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:13.572380 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-51366443-ee5c-4602-957d-6f3a6e3d1706 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1319 microversion: 2.1 time: 0.624290 Jun 16 14:40:13.573532 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 341/623] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:12 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1319 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:13.580808 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-57321b99-a712-4454-aeef-519d51221c79 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:13.581690 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-57321b99-a712-4454-aeef-519d51221c79 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:13.589193 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57321b99-a712-4454-aeef-519d51221c79 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:13.589959 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57321b99-a712-4454-aeef-519d51221c79 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:13.591078 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57321b99-a712-4454-aeef-519d51221c79 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:13.591711 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57321b99-a712-4454-aeef-519d51221c79 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:13.779254 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-57321b99-a712-4454-aeef-519d51221c79 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.202793 Jun 16 14:40:13.780096 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 342/624] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 16 14:40:13 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:13.790193 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-1775f88e-1029-4e35-b554-8cf3cc846ef7 req-710114f1-a6b0-4d8a-bfd8-3f3718a86988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9531184d-4ad3-4c41-b4f9-16b24ae0d6b6", "name": "network-vif-plugged", "status": "completed", "tag": "5642ee3e-05f2-4ee8-815f-d629815c9aa4"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:13.804872 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-1775f88e-1029-4e35-b554-8cf3cc846ef7 req-710114f1-a6b0-4d8a-bfd8-3f3718a86988 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:13.805693 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-1775f88e-1029-4e35-b554-8cf3cc846ef7 req-710114f1-a6b0-4d8a-bfd8-3f3718a86988 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:13.829612 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-1775f88e-1029-4e35-b554-8cf3cc846ef7 req-710114f1-a6b0-4d8a-bfd8-3f3718a86988 service nova] Creating event network-vif-plugged:5642ee3e-05f2-4ee8-815f-d629815c9aa4 for instance 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 on n-h1-836830-4 Jun 16 14:40:13.840061 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-1775f88e-1029-4e35-b554-8cf3cc846ef7 req-710114f1-a6b0-4d8a-bfd8-3f3718a86988 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057361 Jun 16 14:40:13.841624 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 343/625] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:13.854750 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a0a84fe9-d1cc-47f2-aa54-91c56c667b42 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:13.856120 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a0a84fe9-d1cc-47f2-aa54-91c56c667b42 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:13.876942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0a84fe9-d1cc-47f2-aa54-91c56c667b42 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:13.877703 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0a84fe9-d1cc-47f2-aa54-91c56c667b42 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:13.879513 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0a84fe9-d1cc-47f2-aa54-91c56c667b42 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:13.881062 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0a84fe9-d1cc-47f2-aa54-91c56c667b42 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:14.362844 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6b529ac9-fdb0-46b0-a280-d8aad0d704a9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9d5b3a7df04a5eb2a6dfd69d77e63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da236582a64812bdde5b156b76d1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:14.385422 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6b529ac9-fdb0-46b0-a280-d8aad0d704a9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 200 len: 1323 microversion: 2.1 time: 1.252403 Jun 16 14:40:14.388152 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 283/626] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:13 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 1323 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:14.405583 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-a0a84fe9-d1cc-47f2-aa54-91c56c667b42 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'services' on Instance uuid 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:40:14.463882 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a0a84fe9-d1cc-47f2-aa54-91c56c667b42 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 2048 microversion: 2.25 time: 0.619968 Jun 16 14:40:14.465213 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 344/627] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:13 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 2048 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:14.482893 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-534bdac4-9b64-49a4-b9a5-fe6a732fda1f tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:14.484888 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:40:14.484888 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:40:14.486656 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-534bdac4-9b64-49a4-b9a5-fe6a732fda1f tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:14.487347 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-534bdac4-9b64-49a4-b9a5-fe6a732fda1f tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:14.488710 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-534bdac4-9b64-49a4-b9a5-fe6a732fda1f tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:14.489367 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-534bdac4-9b64-49a4-b9a5-fe6a732fda1f tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:14.518736 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-534bdac4-9b64-49a4-b9a5-fe6a732fda1f tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.039446 Jun 16 14:40:14.526244 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 284/628] 10.222.0.57 () {60 vars in 1216 bytes} [Thu Jun 16 14:40:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:40:14.535323 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e2bfcd93-30d8-449a-bc4b-26582700c5e5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-4", "block_migration": "auto"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:14.538295 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e2bfcd93-30d8-449a-bc4b-26582700c5e5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:14.551893 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e2bfcd93-30d8-449a-bc4b-26582700c5e5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:14.553272 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e2bfcd93-30d8-449a-bc4b-26582700c5e5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:14.557266 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e2bfcd93-30d8-449a-bc4b-26582700c5e5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:14.558470 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e2bfcd93-30d8-449a-bc4b-26582700c5e5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:14.592251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cf98e977-7cdc-45ad-9f75-344ddf304e84 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:14.593215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cf98e977-7cdc-45ad-9f75-344ddf304e84 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:14.605649 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf98e977-7cdc-45ad-9f75-344ddf304e84 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:14.609549 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf98e977-7cdc-45ad-9f75-344ddf304e84 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:14.610652 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf98e977-7cdc-45ad-9f75-344ddf304e84 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:14.611504 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf98e977-7cdc-45ad-9f75-344ddf304e84 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:14.625359 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-e2bfcd93-30d8-449a-bc4b-26582700c5e5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'flavor' on Instance uuid 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:40:14.660095 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e2bfcd93-30d8-449a-bc4b-26582700c5e5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Going to try to live migrate instance to n-h2-836830-4 {{(pid=125863) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 14:40:14.792855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=6 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:16.138559 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:16.269451 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cf98e977-7cdc-45ad-9f75-344ddf304e84 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:16.301601 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cf98e977-7cdc-45ad-9f75-344ddf304e84 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1319 microversion: 2.1 time: 1.713527 Jun 16 14:40:16.314862 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 285/629] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:14 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1319 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:16.328167 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-c38638e4-c339-4851-b798-ac2bbcc9c077 req-ba5cabc7-9579-4f44-83b3-c3968cc192bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "612d9d55-cc49-462c-8c30-6c4c91a0f5f9", "tag": "6d716415-3fc5-4be2-8287-f2692f5b4efb"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:16.353967 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-c38638e4-c339-4851-b798-ac2bbcc9c077 req-ba5cabc7-9579-4f44-83b3-c3968cc192bc service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:16.357228 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-c38638e4-c339-4851-b798-ac2bbcc9c077 req-ba5cabc7-9579-4f44-83b3-c3968cc192bc service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:16.378357 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-c38638e4-c339-4851-b798-ac2bbcc9c077 req-ba5cabc7-9579-4f44-83b3-c3968cc192bc service nova] Creating event network-changed:6d716415-3fc5-4be2-8287-f2692f5b4efb for instance 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 on n-h2-836830-4 Jun 16 14:40:16.385962 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-c38638e4-c339-4851-b798-ac2bbcc9c077 req-ba5cabc7-9579-4f44-83b3-c3968cc192bc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067675 Jun 16 14:40:16.387264 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 286/630] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:16.402312 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-405045ed-5bac-401f-b4d6-ebc8a4f50ca9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:16.403615 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-405045ed-5bac-401f-b4d6-ebc8a4f50ca9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:16.426874 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-405045ed-5bac-401f-b4d6-ebc8a4f50ca9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:16.431557 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-405045ed-5bac-401f-b4d6-ebc8a4f50ca9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:16.434457 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-405045ed-5bac-401f-b4d6-ebc8a4f50ca9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:16.435065 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-405045ed-5bac-401f-b4d6-ebc8a4f50ca9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:17.243033 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-405045ed-5bac-401f-b4d6-ebc8a4f50ca9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9d5b3a7df04a5eb2a6dfd69d77e63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da236582a64812bdde5b156b76d1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:17.274938 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-405045ed-5bac-401f-b4d6-ebc8a4f50ca9 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 200 len: 1472 microversion: 2.1 time: 0.883143 Jun 16 14:40:17.281274 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 287/631] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:16 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 1472 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:17.324576 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-faa7f65b-107e-4935-8a6b-62698ac6b64e tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:17.325982 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-faa7f65b-107e-4935-8a6b-62698ac6b64e tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:17.349351 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-faa7f65b-107e-4935-8a6b-62698ac6b64e tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:17.351260 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-faa7f65b-107e-4935-8a6b-62698ac6b64e tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:17.352795 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-faa7f65b-107e-4935-8a6b-62698ac6b64e tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:17.353458 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-faa7f65b-107e-4935-8a6b-62698ac6b64e tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:17.422013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-faa7f65b-107e-4935-8a6b-62698ac6b64e tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '3f9d5b3a7df04a5eb2a6dfd69d77e63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da236582a64812bdde5b156b76d1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-faa7f65b-107e-4935-8a6b-62698ac6b64e tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Request method failure captured: Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6/diagnostics HTTP/1.1 Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0Cn50f2AvES_59YbmU-akkKMY4SmkRVg51r3dWr1UwBwHU9rcvc8H15wXzYrpj7eUUuiVAeRUpCFdTL174bpfivTBKdc8U_zWqE-gye6lAlJro6qYD-PaO_NeDhld8XamJJwjVt-50FlrUl_TM-ooSxKtYwd9GbJBP9kWidl1xIGHY Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 93da236582a64812bdde5b156b76d1e2 Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1387714724 Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:40:17.428886 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:40:17.431901 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_93da236582a64812bdde5b156b76d1e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93da236582a64812bdde5b156b76d1e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93da236582a64812bdde5b156b76d1e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/93da236582a64812bdde5b156b76d1e2"}]}] Jun 16 14:40:17.431901 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1387714724 Jun 16 14:40:17.431901 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 93da236582a64812bdde5b156b76d1e2 Jun 16 14:40:17.431901 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1387714724 Jun 16 14:40:17.431901 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ServerDiagnosticsNegativeTest-1387714724-project Jun 16 14:40:17.431901 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:40:17.431901 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:40:17.431901 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 3f9d5b3a7df04a5eb2a6dfd69d77e63c Jun 16 14:40:17.431901 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1387714724-project Jun 16 14:40:17.431901 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:40:17.431901 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'server_id': '9531184d-4ad3-4c41-b4f9-16b24ae0d6b6'} Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:40:17.433679 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:40:17.437642 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-faa7f65b-107e-4935-8a6b-62698ac6b64e tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:40:17.440035 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-faa7f65b-107e-4935-8a6b-62698ac6b64e tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.120817 Jun 16 14:40:17.440035 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 288/632] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:40:17 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6/diagnostics => generated 117 bytes in 128 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:40:17.449422 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c8e169f6-5aa3-4320-bd11-9eeee31b1fcc tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:17.450095 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c8e169f6-5aa3-4320-bd11-9eeee31b1fcc tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:17.468446 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8e169f6-5aa3-4320-bd11-9eeee31b1fcc tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:17.468790 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8e169f6-5aa3-4320-bd11-9eeee31b1fcc tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:17.469649 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8e169f6-5aa3-4320-bd11-9eeee31b1fcc tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:17.470091 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8e169f6-5aa3-4320-bd11-9eeee31b1fcc tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:17.878183 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e2bfcd93-30d8-449a-bc4b-26582700c5e5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3/action" status: 202 len: 0 microversion: 2.25 time: 3.349708 Jun 16 14:40:17.883436 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 345/633] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jun 16 14:40:14 2022] POST /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3/action => generated 0 bytes in 3353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:17.908014 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bc110af9-4c69-44bf-8a9c-c24e1c08fca7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:17.909067 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bc110af9-4c69-44bf-8a9c-c24e1c08fca7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:17.954920 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bc110af9-4c69-44bf-8a9c-c24e1c08fca7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:17.957911 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bc110af9-4c69-44bf-8a9c-c24e1c08fca7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:17.970334 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bc110af9-4c69-44bf-8a9c-c24e1c08fca7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:17.971357 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bc110af9-4c69-44bf-8a9c-c24e1c08fca7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:18.134083 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bc110af9-4c69-44bf-8a9c-c24e1c08fca7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:40:18.267516 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c8e169f6-5aa3-4320-bd11-9eeee31b1fcc tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:18.286773 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c8e169f6-5aa3-4320-bd11-9eeee31b1fcc tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1319 microversion: 2.1 time: 0.846064 Jun 16 14:40:18.288142 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 289/634] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:17 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1319 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:18.303494 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-48fdcac3-96fe-4232-b596-872992f96521 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:18.305981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-48fdcac3-96fe-4232-b596-872992f96521 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:18.325974 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-48fdcac3-96fe-4232-b596-872992f96521 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:18.327637 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-48fdcac3-96fe-4232-b596-872992f96521 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:18.329544 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-48fdcac3-96fe-4232-b596-872992f96521 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:18.330645 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-48fdcac3-96fe-4232-b596-872992f96521 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:18.447216 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bc110af9-4c69-44bf-8a9c-c24e1c08fca7 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 204 len: 0 microversion: 2.1 time: 0.566041 Jun 16 14:40:18.447831 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 346/635] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:40:17 2022] DELETE /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:18.461461 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f39bd02a-0280-4f31-85ca-d6d9af3e49bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:18.464154 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f39bd02a-0280-4f31-85ca-d6d9af3e49bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:18.480620 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f39bd02a-0280-4f31-85ca-d6d9af3e49bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:18.481939 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f39bd02a-0280-4f31-85ca-d6d9af3e49bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:18.485217 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f39bd02a-0280-4f31-85ca-d6d9af3e49bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:18.486188 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f39bd02a-0280-4f31-85ca-d6d9af3e49bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:18.941952 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f39bd02a-0280-4f31-85ca-d6d9af3e49bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:18.974719 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f39bd02a-0280-4f31-85ca-d6d9af3e49bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:18.982994 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f39bd02a-0280-4f31-85ca-d6d9af3e49bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:18.999649 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f39bd02a-0280-4f31-85ca-d6d9af3e49bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1566 microversion: 2.25 time: 0.550209 Jun 16 14:40:19.010905 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 347/636] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:18 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1566 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:19.036208 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-836f3336-6089-4cfb-a81f-e37495b98bd8 req-2b77ec83-d847-4f05-9fad-802e32fa95a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7771166-9bbf-41d0-b3ca-b4515a46a67c", "tag": "763165ed-fb52-4810-9706-7aa1d1b6f7f1"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:19.060804 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-836f3336-6089-4cfb-a81f-e37495b98bd8 req-2b77ec83-d847-4f05-9fad-802e32fa95a3 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:19.061269 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-836f3336-6089-4cfb-a81f-e37495b98bd8 req-2b77ec83-d847-4f05-9fad-802e32fa95a3 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:19.099420 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-836f3336-6089-4cfb-a81f-e37495b98bd8 req-2b77ec83-d847-4f05-9fad-802e32fa95a3 service nova] Creating event network-changed:763165ed-fb52-4810-9706-7aa1d1b6f7f1 for instance e7771166-9bbf-41d0-b3ca-b4515a46a67c on n-h2-836830-4 Jun 16 14:40:19.110957 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-836f3336-6089-4cfb-a81f-e37495b98bd8 req-2b77ec83-d847-4f05-9fad-802e32fa95a3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098209 Jun 16 14:40:19.113359 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 348/637] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:19.136332 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-24776f74-53fc-4757-8315-6575d2df4298 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:19.137290 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-24776f74-53fc-4757-8315-6575d2df4298 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:19.154627 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-24776f74-53fc-4757-8315-6575d2df4298 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:19.155603 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-24776f74-53fc-4757-8315-6575d2df4298 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:19.156688 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-24776f74-53fc-4757-8315-6575d2df4298 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:19.157379 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-24776f74-53fc-4757-8315-6575d2df4298 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:19.705434 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-48fdcac3-96fe-4232-b596-872992f96521 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:19.736357 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-48fdcac3-96fe-4232-b596-872992f96521 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 200 len: 1589 microversion: 2.1 time: 1.444295 Jun 16 14:40:19.740454 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 290/638] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:18 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 1589 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:19.761477 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-8f2babdc-2a4d-41b0-9db9-739696c1d8c0 req-52db44e2-8455-4047-9758-aab9e708016b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc39a7a1-2d9e-4eec-b07d-9f85e148665e", "tag": "8dc21a1c-aebf-4862-afc4-a9a93eaf0386"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:19.781575 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-8f2babdc-2a4d-41b0-9db9-739696c1d8c0 req-52db44e2-8455-4047-9758-aab9e708016b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:19.782962 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-8f2babdc-2a4d-41b0-9db9-739696c1d8c0 req-52db44e2-8455-4047-9758-aab9e708016b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:19.840692 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-8f2babdc-2a4d-41b0-9db9-739696c1d8c0 req-52db44e2-8455-4047-9758-aab9e708016b service nova] Creating event network-changed:8dc21a1c-aebf-4862-afc4-a9a93eaf0386 for instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e on n-h2-836830-4 Jun 16 14:40:19.862638 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-8f2babdc-2a4d-41b0-9db9-739696c1d8c0 req-52db44e2-8455-4047-9758-aab9e708016b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118325 Jun 16 14:40:19.866972 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 291/639] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:19.882302 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d546fa6c-3321-415c-aba1-7a70c5636832 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:19.884297 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d546fa6c-3321-415c-aba1-7a70c5636832 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:19.897905 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d546fa6c-3321-415c-aba1-7a70c5636832 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:19.899586 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d546fa6c-3321-415c-aba1-7a70c5636832 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:19.902834 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d546fa6c-3321-415c-aba1-7a70c5636832 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:19.909770 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d546fa6c-3321-415c-aba1-7a70c5636832 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:20.317554 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-24776f74-53fc-4757-8315-6575d2df4298 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9d5b3a7df04a5eb2a6dfd69d77e63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da236582a64812bdde5b156b76d1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:20.343291 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-24776f74-53fc-4757-8315-6575d2df4298 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 200 len: 1478 microversion: 2.1 time: 1.226598 Jun 16 14:40:20.360666 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 349/640] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:19 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 1478 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:20.388701 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-efbfecb4-3508-4abe-9ded-c74628fe55ab tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:20.390564 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-efbfecb4-3508-4abe-9ded-c74628fe55ab tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:20.407176 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-efbfecb4-3508-4abe-9ded-c74628fe55ab tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:20.408718 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-efbfecb4-3508-4abe-9ded-c74628fe55ab tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:20.410661 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-efbfecb4-3508-4abe-9ded-c74628fe55ab tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:20.411875 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-efbfecb4-3508-4abe-9ded-c74628fe55ab tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:20.829949 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d546fa6c-3321-415c-aba1-7a70c5636832 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:20.852589 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d546fa6c-3321-415c-aba1-7a70c5636832 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1319 microversion: 2.1 time: 0.982414 Jun 16 14:40:20.853237 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 292/641] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:19 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1319 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:21.068788 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-efbfecb4-3508-4abe-9ded-c74628fe55ab tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:21.101464 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:21.110342 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-efbfecb4-3508-4abe-9ded-c74628fe55ab tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:21.125056 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-efbfecb4-3508-4abe-9ded-c74628fe55ab tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:21.129835 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-efbfecb4-3508-4abe-9ded-c74628fe55ab tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1566 microversion: 2.25 time: 0.764532 Jun 16 14:40:21.134812 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 350/642] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:20 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1566 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:21.392644 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-09668374-d3d3-4293-9157-bfe4dfbc550f tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:21.393927 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-09668374-d3d3-4293-9157-bfe4dfbc550f tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:21.428603 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-09668374-d3d3-4293-9157-bfe4dfbc550f tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:21.433794 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-09668374-d3d3-4293-9157-bfe4dfbc550f tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:21.436069 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-09668374-d3d3-4293-9157-bfe4dfbc550f tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:21.447029 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-09668374-d3d3-4293-9157-bfe4dfbc550f tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:21.872386 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d3a361ec-c69f-4a55-975c-c4062beabc98 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:21.874671 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d3a361ec-c69f-4a55-975c-c4062beabc98 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:21.897110 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3a361ec-c69f-4a55-975c-c4062beabc98 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:21.900500 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3a361ec-c69f-4a55-975c-c4062beabc98 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:21.903790 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3a361ec-c69f-4a55-975c-c4062beabc98 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:21.904964 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3a361ec-c69f-4a55-975c-c4062beabc98 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:22.290755 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-09668374-d3d3-4293-9157-bfe4dfbc550f tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9d5b3a7df04a5eb2a6dfd69d77e63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da236582a64812bdde5b156b76d1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:22.324277 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-09668374-d3d3-4293-9157-bfe4dfbc550f tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 200 len: 1478 microversion: 2.1 time: 0.937625 Jun 16 14:40:22.343991 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 293/643] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:21 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 1478 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:22.356610 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-24e4276b-af11-4198-b509-4a7153d98590 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:22.363027 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-24e4276b-af11-4198-b509-4a7153d98590 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:22.385612 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-24e4276b-af11-4198-b509-4a7153d98590 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:22.391657 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-24e4276b-af11-4198-b509-4a7153d98590 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:22.394599 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-24e4276b-af11-4198-b509-4a7153d98590 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:22.399069 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-24e4276b-af11-4198-b509-4a7153d98590 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:23.121141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-24e4276b-af11-4198-b509-4a7153d98590 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:23.141715 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-24e4276b-af11-4198-b509-4a7153d98590 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:23.145165 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-24e4276b-af11-4198-b509-4a7153d98590 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:23.159096 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-24e4276b-af11-4198-b509-4a7153d98590 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1566 microversion: 2.25 time: 0.807539 Jun 16 14:40:23.164196 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 294/644] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:22 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1566 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:23.183650 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-c3d74c70-9ca1-44dd-bd5a-ca03994a936a req-3542a5d4-4fe7-4639-89b9-2c8baad4dbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9531184d-4ad3-4c41-b4f9-16b24ae0d6b6", "name": "network-vif-deleted", "tag": "5642ee3e-05f2-4ee8-815f-d629815c9aa4"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:23.204807 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-c3d74c70-9ca1-44dd-bd5a-ca03994a936a req-3542a5d4-4fe7-4639-89b9-2c8baad4dbf1 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:23.205584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-c3d74c70-9ca1-44dd-bd5a-ca03994a936a req-3542a5d4-4fe7-4639-89b9-2c8baad4dbf1 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:23.286583 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-c3d74c70-9ca1-44dd-bd5a-ca03994a936a req-3542a5d4-4fe7-4639-89b9-2c8baad4dbf1 service nova] Creating event network-vif-deleted:5642ee3e-05f2-4ee8-815f-d629815c9aa4 for instance 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 on n-h1-836830-4 Jun 16 14:40:23.301592 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-c3d74c70-9ca1-44dd-bd5a-ca03994a936a req-3542a5d4-4fe7-4639-89b9-2c8baad4dbf1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135335 Jun 16 14:40:23.307984 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 295/645] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:23.341478 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-cddcfb8d-ced7-425b-847f-9f749a05447a req-2da44b86-960b-455c-b60c-bcf46f187d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "612d9d55-cc49-462c-8c30-6c4c91a0f5f9", "name": "network-vif-plugged", "status": "completed", "tag": "6d716415-3fc5-4be2-8287-f2692f5b4efb"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:23.371965 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-cddcfb8d-ced7-425b-847f-9f749a05447a req-2da44b86-960b-455c-b60c-bcf46f187d76 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:23.372922 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-cddcfb8d-ced7-425b-847f-9f749a05447a req-2da44b86-960b-455c-b60c-bcf46f187d76 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:23.380383 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d3a361ec-c69f-4a55-975c-c4062beabc98 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:23.415397 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d3a361ec-c69f-4a55-975c-c4062beabc98 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1319 microversion: 2.1 time: 1.547091 Jun 16 14:40:23.428087 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 351/646] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:21 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1319 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:23.457272 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-cddcfb8d-ced7-425b-847f-9f749a05447a req-2da44b86-960b-455c-b60c-bcf46f187d76 service nova] Creating event network-vif-plugged:6d716415-3fc5-4be2-8287-f2692f5b4efb for instance 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 on n-h2-836830-4 Jun 16 14:40:23.461973 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0d63d6bc-3a3c-49fc-9a26-bb5e3d1adb38 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:23.464535 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0d63d6bc-3a3c-49fc-9a26-bb5e3d1adb38 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:23.495154 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-cddcfb8d-ced7-425b-847f-9f749a05447a req-2da44b86-960b-455c-b60c-bcf46f187d76 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168766 Jun 16 14:40:23.497669 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 296/647] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:23.511275 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0d63d6bc-3a3c-49fc-9a26-bb5e3d1adb38 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:23.513807 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0d63d6bc-3a3c-49fc-9a26-bb5e3d1adb38 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:23.516659 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0d63d6bc-3a3c-49fc-9a26-bb5e3d1adb38 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:23.517711 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-4e004545-8515-4579-ab0c-39ae9297916c req-1a1bc100-7e17-4ff2-98d7-af3780e9ed73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e048775-afa2-4ec5-91fd-f5d06c1fe6d3", "name": "network-vif-unplugged", "status": "completed", "tag": "f802939c-946a-4ee0-9525-cc56a9c04b53"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:23.519852 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0d63d6bc-3a3c-49fc-9a26-bb5e3d1adb38 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:23.568508 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-4e004545-8515-4579-ab0c-39ae9297916c req-1a1bc100-7e17-4ff2-98d7-af3780e9ed73 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:23.575167 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-4e004545-8515-4579-ab0c-39ae9297916c req-1a1bc100-7e17-4ff2-98d7-af3780e9ed73 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:23.594086 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0d63d6bc-3a3c-49fc-9a26-bb5e3d1adb38 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:23.594957 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0d63d6bc-3a3c-49fc-9a26-bb5e3d1adb38 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:23.596499 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-0d63d6bc-3a3c-49fc-9a26-bb5e3d1adb38 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lazy-loading 'fault' on Instance uuid 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:40:23.634674 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-4e004545-8515-4579-ab0c-39ae9297916c req-1a1bc100-7e17-4ff2-98d7-af3780e9ed73 service nova] Creating event network-vif-unplugged:f802939c-946a-4ee0-9525-cc56a9c04b53 for instance 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 on n-h1-836830-4 Jun 16 14:40:23.658568 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-4e004545-8515-4579-ab0c-39ae9297916c req-1a1bc100-7e17-4ff2-98d7-af3780e9ed73 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157044 Jun 16 14:40:23.669691 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 297/648] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:24.026224 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0d63d6bc-3a3c-49fc-9a26-bb5e3d1adb38 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f9d5b3a7df04a5eb2a6dfd69d77e63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da236582a64812bdde5b156b76d1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:24.093401 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0d63d6bc-3a3c-49fc-9a26-bb5e3d1adb38 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 200 len: 1313 microversion: 2.1 time: 0.663289 Jun 16 14:40:24.098263 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 352/649] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:23 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 1313 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:24.193610 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-42a7941b-0c6f-4de3-b685-c1d5ee098d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:24.194393 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-42a7941b-0c6f-4de3-b685-c1d5ee098d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:24.199499 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:24.211777 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-42a7941b-0c6f-4de3-b685-c1d5ee098d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:24.212420 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-42a7941b-0c6f-4de3-b685-c1d5ee098d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:24.213562 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-42a7941b-0c6f-4de3-b685-c1d5ee098d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:24.214006 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-42a7941b-0c6f-4de3-b685-c1d5ee098d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:24.262796 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:24.458702 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-dcfb2831-2e30-4cad-a0d7-62b1fbd8769c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:24.464711 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-dcfb2831-2e30-4cad-a0d7-62b1fbd8769c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:24.498941 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:24.504963 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dcfb2831-2e30-4cad-a0d7-62b1fbd8769c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:24.508048 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dcfb2831-2e30-4cad-a0d7-62b1fbd8769c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:24.535053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dcfb2831-2e30-4cad-a0d7-62b1fbd8769c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:24.540902 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dcfb2831-2e30-4cad-a0d7-62b1fbd8769c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:25.112556 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-dcfb2831-2e30-4cad-a0d7-62b1fbd8769c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:25.128098 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-dcfb2831-2e30-4cad-a0d7-62b1fbd8769c tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1319 microversion: 2.1 time: 0.685167 Jun 16 14:40:25.130159 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 353/650] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:24 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1319 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:25.158024 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-daaf9070-2ed9-4660-9186-781e56704666 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:25.159213 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-daaf9070-2ed9-4660-9186-781e56704666 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] [instance: 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:25.162736 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:25.173883 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-daaf9070-2ed9-4660-9186-781e56704666 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:25.175184 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-daaf9070-2ed9-4660-9186-781e56704666 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:25.177081 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-daaf9070-2ed9-4660-9186-781e56704666 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:25.178128 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-daaf9070-2ed9-4660-9186-781e56704666 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:25.211174 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-daaf9070-2ed9-4660-9186-781e56704666 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] HTTP exception thrown: Instance 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 could not be found. Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-daaf9070-2ed9-4660-9186-781e56704666 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Request method failure captured: Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 HTTP/1.1 Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0Cn50f2AvES_59YbmU-akkKMY4SmkRVg51r3dWr1UwBwHU9rcvc8H15wXzYrpj7eUUuiVAeRUpCFdTL174bpfivTBKdc8U_zWqE-gye6lAlJro6qYD-PaO_NeDhld8XamJJwjVt-50FlrUl_TM-ooSxKtYwd9GbJBP9kWidl1xIGHY Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 93da236582a64812bdde5b156b76d1e2 Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1387714724 Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:40:25.215456 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:40:25.218650 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_93da236582a64812bdde5b156b76d1e2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93da236582a64812bdde5b156b76d1e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/93da236582a64812bdde5b156b76d1e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/93da236582a64812bdde5b156b76d1e2"}]}] Jun 16 14:40:25.218650 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1387714724 Jun 16 14:40:25.218650 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 93da236582a64812bdde5b156b76d1e2 Jun 16 14:40:25.218650 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1387714724 Jun 16 14:40:25.218650 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServerDiagnosticsNegativeTest-1387714724-project Jun 16 14:40:25.218650 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:40:25.218650 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:40:25.218650 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 3f9d5b3a7df04a5eb2a6dfd69d77e63c Jun 16 14:40:25.218650 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1387714724-project Jun 16 14:40:25.218650 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:40:25.218650 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 could not be found. Jun 16 14:40:25.218650 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '9531184d-4ad3-4c41-b4f9-16b24ae0d6b6'} Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 could not be found. Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:40:25.220253 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 could not be found. Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 could not be found. Jun 16 14:40:25.222918 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:25.228825 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-daaf9070-2ed9-4660-9186-781e56704666 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] Returning 404 to user: Instance 9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:40:25.239042 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-daaf9070-2ed9-4660-9186-781e56704666 tempest-ServerDiagnosticsNegativeTest-1387714724 tempest-ServerDiagnosticsNegativeTest-1387714724-project] 10.222.0.57 "GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6" status: 404 len: 111 microversion: 2.1 time: 0.099502 Jun 16 14:40:25.240470 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 354/651] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:25 2022] GET /compute/v2.1/servers/9531184d-4ad3-4c41-b4f9-16b24ae0d6b6 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:40:25.800548 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-42a7941b-0c6f-4de3-b685-c1d5ee098d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:25.810162 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-42a7941b-0c6f-4de3-b685-c1d5ee098d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:25.811815 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-42a7941b-0c6f-4de3-b685-c1d5ee098d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:25.823766 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-42a7941b-0c6f-4de3-b685-c1d5ee098d1d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1566 microversion: 2.25 time: 1.634467 Jun 16 14:40:25.824666 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 298/652] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:24 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1566 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:40:25.843408 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-3ac44dd0-548d-4bec-8395-4c5adaa975a5 req-aec66345-f59e-4cac-a7bf-d700990b66ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e048775-afa2-4ec5-91fd-f5d06c1fe6d3", "tag": "f802939c-946a-4ee0-9525-cc56a9c04b53"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:25.856789 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3ac44dd0-548d-4bec-8395-4c5adaa975a5 req-aec66345-f59e-4cac-a7bf-d700990b66ee service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:25.857248 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3ac44dd0-548d-4bec-8395-4c5adaa975a5 req-aec66345-f59e-4cac-a7bf-d700990b66ee service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:25.887008 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-3ac44dd0-548d-4bec-8395-4c5adaa975a5 req-aec66345-f59e-4cac-a7bf-d700990b66ee service nova] Creating event network-changed:f802939c-946a-4ee0-9525-cc56a9c04b53 for instance 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 on n-h1-836830-4 Jun 16 14:40:25.893945 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-3ac44dd0-548d-4bec-8395-4c5adaa975a5 req-aec66345-f59e-4cac-a7bf-d700990b66ee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067755 Jun 16 14:40:25.896006 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 299/653] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:26.073801 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1535175890", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:26.155233 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:40:26.166178 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f08e6241-de21-4656-bcf1-d402601b452a tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:26.167370 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f08e6241-de21-4656-bcf1-d402601b452a tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:26.186261 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f08e6241-de21-4656-bcf1-d402601b452a tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:26.187128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f08e6241-de21-4656-bcf1-d402601b452a tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:26.188580 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f08e6241-de21-4656-bcf1-d402601b452a tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:26.189876 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f08e6241-de21-4656-bcf1-d402601b452a tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:26.661517 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:40:26.662558 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:40:26.663289 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:40:26.667165 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:40:26.668359 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:40:26.687527 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:26.689096 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:26.690805 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:26.693336 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:26.719514 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Getting quotas for project 414e3b792647435daa2ecce22a2c6132. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:40:26.732526 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Getting quotas for user 65cde69f3b52448c8b08297b548bb377 and project 414e3b792647435daa2ecce22a2c6132. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:40:26.750372 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:40:26.760802 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:40:26.791189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f08e6241-de21-4656-bcf1-d402601b452a tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:26.818752 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f08e6241-de21-4656-bcf1-d402601b452a tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1469 microversion: 2.1 time: 0.664597 Jun 16 14:40:26.834952 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 300/654] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:26 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1469 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:40:26.860763 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bf9661b9-a0fb-4ab1-a543-5c5b2d0a980c tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:26.862805 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bf9661b9-a0fb-4ab1-a543-5c5b2d0a980c tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:26.887253 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bf9661b9-a0fb-4ab1-a543-5c5b2d0a980c tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:26.888333 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bf9661b9-a0fb-4ab1-a543-5c5b2d0a980c tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:26.889900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bf9661b9-a0fb-4ab1-a543-5c5b2d0a980c tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:26.890873 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bf9661b9-a0fb-4ab1-a543-5c5b2d0a980c tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:26.916667 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-552333c4-88b9-4100-86ce-b5fade55703f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.450939 Jun 16 14:40:26.922917 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 355/655] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:40:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 14:40:26.943009 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9e03c87f-4f5a-48e2-a819-d24d4eb6022e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:26.944516 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9e03c87f-4f5a-48e2-a819-d24d4eb6022e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:26.975313 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9e03c87f-4f5a-48e2-a819-d24d4eb6022e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:26.977199 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9e03c87f-4f5a-48e2-a819-d24d4eb6022e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:26.979078 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9e03c87f-4f5a-48e2-a819-d24d4eb6022e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:26.980202 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9e03c87f-4f5a-48e2-a819-d24d4eb6022e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:27.050732 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-bf9661b9-a0fb-4ab1-a543-5c5b2d0a980c tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lazy-loading 'flavor' on Instance uuid 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:40:27.225202 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bf9661b9-a0fb-4ab1-a543-5c5b2d0a980c tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9/action" status: 202 len: 0 microversion: 2.1 time: 0.377755 Jun 16 14:40:27.234407 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 301/656] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:40:26 2022] POST /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 14:40:27.298341 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f7d7226b-1b29-4a0c-b453-5a3ef4c0b138 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:27.304238 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f7d7226b-1b29-4a0c-b453-5a3ef4c0b138 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:27.471561 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9e03c87f-4f5a-48e2-a819-d24d4eb6022e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:27.495830 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9e03c87f-4f5a-48e2-a819-d24d4eb6022e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:27.505747 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9e03c87f-4f5a-48e2-a819-d24d4eb6022e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:27.513332 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9e03c87f-4f5a-48e2-a819-d24d4eb6022e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1566 microversion: 2.25 time: 0.587732 Jun 16 14:40:27.514864 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 356/657] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:26 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1566 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:27.526748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f438b45d-b4d3-4c2f-a8fa-8820eee31b46 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:27.528769 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f7d7226b-1b29-4a0c-b453-5a3ef4c0b138 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:27.529739 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f438b45d-b4d3-4c2f-a8fa-8820eee31b46 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:27.552176 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f438b45d-b4d3-4c2f-a8fa-8820eee31b46 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:27.554081 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f438b45d-b4d3-4c2f-a8fa-8820eee31b46 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:27.556094 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f7d7226b-1b29-4a0c-b453-5a3ef4c0b138 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1213 microversion: 2.1 time: 0.314026 Jun 16 14:40:27.557090 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 302/658] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:27 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1213 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:27.558245 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f438b45d-b4d3-4c2f-a8fa-8820eee31b46 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:27.559109 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f438b45d-b4d3-4c2f-a8fa-8820eee31b46 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:28.024652 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f438b45d-b4d3-4c2f-a8fa-8820eee31b46 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:28.045235 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f438b45d-b4d3-4c2f-a8fa-8820eee31b46 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1477 microversion: 2.1 time: 0.527499 Jun 16 14:40:28.048148 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 357/659] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:27 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1477 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:28.536479 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-11a045da-baa6-4162-9733-353eff5e41b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:28.548391 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-11a045da-baa6-4162-9733-353eff5e41b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:28.565072 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11a045da-baa6-4162-9733-353eff5e41b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:28.573185 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11a045da-baa6-4162-9733-353eff5e41b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:28.575100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11a045da-baa6-4162-9733-353eff5e41b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:28.576284 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11a045da-baa6-4162-9733-353eff5e41b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:28.593577 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fe2bc60e-1351-4087-b2a3-5e8ccbdc4b1c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:28.597056 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fe2bc60e-1351-4087-b2a3-5e8ccbdc4b1c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:28.619273 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fe2bc60e-1351-4087-b2a3-5e8ccbdc4b1c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:28.620075 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fe2bc60e-1351-4087-b2a3-5e8ccbdc4b1c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:28.621155 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fe2bc60e-1351-4087-b2a3-5e8ccbdc4b1c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:28.622736 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fe2bc60e-1351-4087-b2a3-5e8ccbdc4b1c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:28.824974 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fe2bc60e-1351-4087-b2a3-5e8ccbdc4b1c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:28.865514 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fe2bc60e-1351-4087-b2a3-5e8ccbdc4b1c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1265 microversion: 2.1 time: 0.282576 Jun 16 14:40:28.878924 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 358/660] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:28 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:28.910024 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-11a045da-baa6-4162-9733-353eff5e41b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:28.935855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-11a045da-baa6-4162-9733-353eff5e41b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:28.939963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-11a045da-baa6-4162-9733-353eff5e41b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:28.944470 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-11a045da-baa6-4162-9733-353eff5e41b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1566 microversion: 2.25 time: 0.413998 Jun 16 14:40:28.952277 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 303/661] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:28 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1566 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:29.095633 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0f7330c5-74b5-4078-9b76-8f0a7aa8454b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:29.096282 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0f7330c5-74b5-4078-9b76-8f0a7aa8454b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:29.111579 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0f7330c5-74b5-4078-9b76-8f0a7aa8454b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:29.111921 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0f7330c5-74b5-4078-9b76-8f0a7aa8454b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:29.116632 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0f7330c5-74b5-4078-9b76-8f0a7aa8454b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:29.120148 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0f7330c5-74b5-4078-9b76-8f0a7aa8454b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:29.421677 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6118b50a-06b6-455a-9a30-fc6a9eae4752 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Action: 'create', calling method: .version_select at 0x7fdf0c3a0e50>, body: {"keypair": {"name": "tempest-keypair-655384762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7VNrvnSs06R1YdhT63koJ8zQpBBgAYK9sVpJqJHVOESJLgG/UCD22xz4+H2FsUp4oDsED6xG6aDxoC8QqCktYpK0/0nQUsNvn6d1MOrysBjKMt031QvsjLClKTZ1cQ4Q=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:29.463013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-6118b50a-06b6-455a-9a30-fc6a9eae4752 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Getting quotas for project 1cb259849be2454ba564207db28025d4. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:40:29.471721 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-6118b50a-06b6-455a-9a30-fc6a9eae4752 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Getting quotas for user 960ce02e58de4a02a547844c88034159 and project 1cb259849be2454ba564207db28025d4. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:40:29.565468 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6118b50a-06b6-455a-9a30-fc6a9eae4752 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.682136 Jun 16 14:40:29.567705 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 359/662] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:40:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:29.672880 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0f7330c5-74b5-4078-9b76-8f0a7aa8454b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:29.699635 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0f7330c5-74b5-4078-9b76-8f0a7aa8454b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1460 microversion: 2.1 time: 0.623344 Jun 16 14:40:29.700636 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 304/663] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:29 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1460 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:29.726098 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f848e3a8-882d-4959-be7a-375f885ac384 tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:29.731386 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f848e3a8-882d-4959-be7a-375f885ac384 tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:29.747930 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f848e3a8-882d-4959-be7a-375f885ac384 tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:29.749794 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f848e3a8-882d-4959-be7a-375f885ac384 tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:29.752055 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f848e3a8-882d-4959-be7a-375f885ac384 tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:29.753175 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f848e3a8-882d-4959-be7a-375f885ac384 tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:29.886311 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-838f91ba-f271-4ac6-9f0d-80ccc3f39de6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:29.886978 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-838f91ba-f271-4ac6-9f0d-80ccc3f39de6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:29.907033 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-838f91ba-f271-4ac6-9f0d-80ccc3f39de6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:29.912358 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-838f91ba-f271-4ac6-9f0d-80ccc3f39de6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:29.917096 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-838f91ba-f271-4ac6-9f0d-80ccc3f39de6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:29.919510 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-838f91ba-f271-4ac6-9f0d-80ccc3f39de6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:30.165035 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-838f91ba-f271-4ac6-9f0d-80ccc3f39de6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:30.187191 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-838f91ba-f271-4ac6-9f0d-80ccc3f39de6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1271 microversion: 2.1 time: 0.304491 Jun 16 14:40:30.191247 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 305/664] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:29 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1271 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:40:30.213595 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0c75f1b7-29e1-48e7-84fa-d8edeafe1a05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:30.218855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0c75f1b7-29e1-48e7-84fa-d8edeafe1a05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:30.238175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c75f1b7-29e1-48e7-84fa-d8edeafe1a05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:30.243197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c75f1b7-29e1-48e7-84fa-d8edeafe1a05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:30.244984 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c75f1b7-29e1-48e7-84fa-d8edeafe1a05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:30.245448 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c75f1b7-29e1-48e7-84fa-d8edeafe1a05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:30.375635 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f848e3a8-882d-4959-be7a-375f885ac384 tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1611 microversion: 2.1 time: 0.654965 Jun 16 14:40:30.388106 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 360/665] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:29 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1611 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:30.424081 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f00a106f-94cf-43db-88b9-b4576f7233b0 tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:30.427324 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:40:30.427324 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:40:30.430597 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f00a106f-94cf-43db-88b9-b4576f7233b0 tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:30.432431 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f00a106f-94cf-43db-88b9-b4576f7233b0 tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:30.438510 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f00a106f-94cf-43db-88b9-b4576f7233b0 tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:30.439903 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f00a106f-94cf-43db-88b9-b4576f7233b0 tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:30.516827 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f00a106f-94cf-43db-88b9-b4576f7233b0 tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.103693 Jun 16 14:40:30.517888 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 361/666] 10.222.0.57 () {58 vars in 1175 bytes} [Thu Jun 16 14:40:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:30.543198 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-44296247-63ba-4de5-ab39-a6ee991ce3cf tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-4", "block_migration": true, "disk_over_commit": false}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:30.545337 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-44296247-63ba-4de5-ab39-a6ee991ce3cf tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:30.562029 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44296247-63ba-4de5-ab39-a6ee991ce3cf tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:30.562933 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44296247-63ba-4de5-ab39-a6ee991ce3cf tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:30.564428 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44296247-63ba-4de5-ab39-a6ee991ce3cf tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:30.566627 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44296247-63ba-4de5-ab39-a6ee991ce3cf tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:30.639630 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-44296247-63ba-4de5-ab39-a6ee991ce3cf tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Lazy-loading 'flavor' on Instance uuid 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:40:30.670940 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-44296247-63ba-4de5-ab39-a6ee991ce3cf tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 while it is in vm_state suspended Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-44296247-63ba-4de5-ab39-a6ee991ce3cf tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Request method failure captured: Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9/action HTTP/1.1 Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 97 Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0CRggOwjTMCHkTOHPYmgD6RhU1alBi6PGg9Q2m4WKzZQyUWONOUxW9QbIy1tFXJdfADyRVZCpF3KiSLAS22Wxmive4qFserkOtVXZ3AHI67_xwVA5kOGdesnZTbljbpl12rFV1PNey0tqQsAFYfIFy4Kc0MBCC1kKqrR3Bey1GvMsM Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 45e8163bedcd493291ced82d4f5a6092 Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-LiveMigrationNegativeTest-1119711907 Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:40:30.675146 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:40:30.677750 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_45e8163bedcd493291ced82d4f5a6092", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/45e8163bedcd493291ced82d4f5a6092"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/45e8163bedcd493291ced82d4f5a6092"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/45e8163bedcd493291ced82d4f5a6092"}]}] Jun 16 14:40:30.677750 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-LiveMigrationNegativeTest-1119711907 Jun 16 14:40:30.677750 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 45e8163bedcd493291ced82d4f5a6092 Jun 16 14:40:30.677750 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1119711907 Jun 16 14:40:30.677750 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-LiveMigrationNegativeTest-1119711907-project-admin Jun 16 14:40:30.677750 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:40:30.677750 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:40:30.677750 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 254567906e684352b7881dd67857d311 Jun 16 14:40:30.677750 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-LiveMigrationNegativeTest-1119711907-project-admin Jun 16 14:40:30.677750 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:40:30.677750 n-d-836830-4 devstack@n-api.service[125863]: {"os-migrateLive": {"host": "n-h1-836830-4", "block_migration": true, "disk_over_commit": false}} Jun 16 14:40:30.677750 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: exception: Cannot 'os-migrateLive' instance 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 while it is in vm_state suspended Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '612d9d55-cc49-462c-8c30-6c4c91a0f5f9', 'body': {'os-migrateLive': {'host': 'n-h1-836830-4', 'block_migration': True, 'disk_over_commit': False}}} Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 16 14:40:30.679469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:40:30.681696 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 while it is in vm_state suspended Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 while it is in vm_state suspended Jun 16 14:40:30.685852 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:30.692893 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-44296247-63ba-4de5-ab39-a6ee991ce3cf tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 while it is in vm_state suspended {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:40:30.692893 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-44296247-63ba-4de5-ab39-a6ee991ce3cf tempest-LiveMigrationNegativeTest-1119711907 tempest-LiveMigrationNegativeTest-1119711907-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9/action" status: 409 len: 155 microversion: 2.1 time: 0.145460 Jun 16 14:40:30.692893 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 362/667] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:40:30 2022] POST /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9/action => generated 155 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:40:30.702419 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4da00d2b-6a22-4dc6-98ca-faea66357665 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:30.703994 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4da00d2b-6a22-4dc6-98ca-faea66357665 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:30.718055 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4da00d2b-6a22-4dc6-98ca-faea66357665 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:30.721493 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4da00d2b-6a22-4dc6-98ca-faea66357665 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:30.722573 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4da00d2b-6a22-4dc6-98ca-faea66357665 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:30.723132 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4da00d2b-6a22-4dc6-98ca-faea66357665 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:30.790975 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4da00d2b-6a22-4dc6-98ca-faea66357665 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:40:30.964077 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4da00d2b-6a22-4dc6-98ca-faea66357665 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "DELETE /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 204 len: 0 microversion: 2.1 time: 0.270429 Jun 16 14:40:30.966202 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 363/668] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:40:30 2022] DELETE /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:30.979138 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-97dd8149-b43d-4d6f-b837-c092532a8c8b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:30.980445 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-97dd8149-b43d-4d6f-b837-c092532a8c8b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:30.998917 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0c75f1b7-29e1-48e7-84fa-d8edeafe1a05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:31.012628 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97dd8149-b43d-4d6f-b837-c092532a8c8b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:31.013146 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97dd8149-b43d-4d6f-b837-c092532a8c8b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:31.014880 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97dd8149-b43d-4d6f-b837-c092532a8c8b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:31.017824 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97dd8149-b43d-4d6f-b837-c092532a8c8b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:31.049207 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0c75f1b7-29e1-48e7-84fa-d8edeafe1a05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:31.072926 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0c75f1b7-29e1-48e7-84fa-d8edeafe1a05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:31.083596 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0c75f1b7-29e1-48e7-84fa-d8edeafe1a05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1566 microversion: 2.25 time: 0.881356 Jun 16 14:40:31.089104 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 306/669] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:30 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1566 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:31.219870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3fa29e7b-9b7c-4a09-b72f-51976f776f53 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:31.220495 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3fa29e7b-9b7c-4a09-b72f-51976f776f53 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:31.231515 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3fa29e7b-9b7c-4a09-b72f-51976f776f53 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:31.232330 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3fa29e7b-9b7c-4a09-b72f-51976f776f53 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:31.233885 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3fa29e7b-9b7c-4a09-b72f-51976f776f53 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:31.235182 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3fa29e7b-9b7c-4a09-b72f-51976f776f53 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:31.392345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3fa29e7b-9b7c-4a09-b72f-51976f776f53 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:31.444396 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3fa29e7b-9b7c-4a09-b72f-51976f776f53 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1271 microversion: 2.1 time: 0.226029 Jun 16 14:40:31.448342 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 307/670] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:31 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1271 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:40:31.496508 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-97dd8149-b43d-4d6f-b837-c092532a8c8b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:31.505609 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-97dd8149-b43d-4d6f-b837-c092532a8c8b tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1466 microversion: 2.1 time: 0.533215 Jun 16 14:40:31.507005 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 364/671] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:30 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1466 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:32.117412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-82af5eaa-ef06-4b65-bd0e-f751ac91220b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:32.118878 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-82af5eaa-ef06-4b65-bd0e-f751ac91220b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:32.168138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-82af5eaa-ef06-4b65-bd0e-f751ac91220b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:32.169378 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-82af5eaa-ef06-4b65-bd0e-f751ac91220b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:32.171372 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-82af5eaa-ef06-4b65-bd0e-f751ac91220b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:32.172519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-82af5eaa-ef06-4b65-bd0e-f751ac91220b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:32.627068 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4f672d36-1d90-4ce3-a5f9-ff3723b4ee3d tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:32.631101 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:40:32.631101 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:40:32.634116 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f672d36-1d90-4ce3-a5f9-ff3723b4ee3d tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:32.635324 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f672d36-1d90-4ce3-a5f9-ff3723b4ee3d tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:32.637161 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f672d36-1d90-4ce3-a5f9-ff3723b4ee3d tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:32.638327 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f672d36-1d90-4ce3-a5f9-ff3723b4ee3d tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:32.707452 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4f672d36-1d90-4ce3-a5f9-ff3723b4ee3d tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.564586 Jun 16 14:40:32.721983 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 365/672] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:40:32 2022] GET /compute/v2.1/os-services => generated 944 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:32.731520 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-11a6bf9f-9abc-4abc-acb6-f75a4e895ef3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:32.732610 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-11a6bf9f-9abc-4abc-acb6-f75a4e895ef3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:32.746501 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-11a6bf9f-9abc-4abc-acb6-f75a4e895ef3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:32.749296 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-82af5eaa-ef06-4b65-bd0e-f751ac91220b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:32.756836 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-11a6bf9f-9abc-4abc-acb6-f75a4e895ef3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:32.761812 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-11a6bf9f-9abc-4abc-acb6-f75a4e895ef3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:32.763206 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-11a6bf9f-9abc-4abc-acb6-f75a4e895ef3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:32.763400 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-82af5eaa-ef06-4b65-bd0e-f751ac91220b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:32.768898 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-82af5eaa-ef06-4b65-bd0e-f751ac91220b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:32.770187 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-82af5eaa-ef06-4b65-bd0e-f751ac91220b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1566 microversion: 2.25 time: 0.657526 Jun 16 14:40:32.770813 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 308/673] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:32 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1566 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:40:32.798604 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ea918f2f-d823-43af-a15a-31e86c75f19d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:32.799479 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ea918f2f-d823-43af-a15a-31e86c75f19d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:32.807639 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ea918f2f-d823-43af-a15a-31e86c75f19d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:32.808415 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ea918f2f-d823-43af-a15a-31e86c75f19d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:32.809561 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ea918f2f-d823-43af-a15a-31e86c75f19d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:32.810198 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ea918f2f-d823-43af-a15a-31e86c75f19d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:33.242689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ea918f2f-d823-43af-a15a-31e86c75f19d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:33.266369 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ea918f2f-d823-43af-a15a-31e86c75f19d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1466 microversion: 2.1 time: 0.494211 Jun 16 14:40:33.271194 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 309/674] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:32 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1466 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:33.296349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-01f250d5-19f1-477a-9b16-29124c24ec27 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:33.307296 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:40:33.307296 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:40:33.310117 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01f250d5-19f1-477a-9b16-29124c24ec27 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:33.311219 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01f250d5-19f1-477a-9b16-29124c24ec27 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:33.312904 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01f250d5-19f1-477a-9b16-29124c24ec27 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:33.314101 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01f250d5-19f1-477a-9b16-29124c24ec27 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:33.382201 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-01f250d5-19f1-477a-9b16-29124c24ec27 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?host=n-d-836830-4" status: 200 len: 578 microversion: 2.1 time: 0.097332 Jun 16 14:40:33.398028 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 310/675] 10.222.0.57 () {58 vars in 1171 bytes} [Thu Jun 16 14:40:33 2022] GET /compute/v2.1/os-services?host=n-d-836830-4 => generated 578 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:33.415415 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-616762a5-b7bf-4630-95ff-995a0342d3f8 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:33.418860 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:40:33.418860 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:40:33.422222 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-616762a5-b7bf-4630-95ff-995a0342d3f8 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:33.423611 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-616762a5-b7bf-4630-95ff-995a0342d3f8 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:33.425605 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-616762a5-b7bf-4630-95ff-995a0342d3f8 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:33.426910 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-616762a5-b7bf-4630-95ff-995a0342d3f8 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:33.534643 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-616762a5-b7bf-4630-95ff-995a0342d3f8 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.134542 Jun 16 14:40:33.536068 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 311/676] 10.222.0.57 () {58 vars in 1175 bytes} [Thu Jun 16 14:40:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:40:33.561652 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4aa7c96f-9c4f-49ff-908a-232ed023c4e5 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:33.564112 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:40:33.564112 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:40:33.574627 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4aa7c96f-9c4f-49ff-908a-232ed023c4e5 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:33.576259 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4aa7c96f-9c4f-49ff-908a-232ed023c4e5 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:33.577790 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4aa7c96f-9c4f-49ff-908a-232ed023c4e5 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:33.578918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4aa7c96f-9c4f-49ff-908a-232ed023c4e5 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:33.638317 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4aa7c96f-9c4f-49ff-908a-232ed023c4e5 tempest-ServicesAdminTestJSON-1176981814 tempest-ServicesAdminTestJSON-1176981814-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.087590 Jun 16 14:40:33.640223 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 312/677] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:40:33 2022] GET /compute/v2.1/os-services => generated 944 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:33.803452 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-859682e3-53cf-49f9-b74b-6f5cd3d3946c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:33.804415 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-859682e3-53cf-49f9-b74b-6f5cd3d3946c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:33.812951 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-859682e3-53cf-49f9-b74b-6f5cd3d3946c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:33.813562 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-859682e3-53cf-49f9-b74b-6f5cd3d3946c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:33.814489 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-859682e3-53cf-49f9-b74b-6f5cd3d3946c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:33.815234 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-859682e3-53cf-49f9-b74b-6f5cd3d3946c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:33.852959 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-11a6bf9f-9abc-4abc-acb6-f75a4e895ef3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:33.889856 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-11a6bf9f-9abc-4abc-acb6-f75a4e895ef3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1313 microversion: 2.1 time: 1.158455 Jun 16 14:40:33.891032 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 366/678] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:32 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1313 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:33.939484 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-0ea7cadf-5748-463b-847c-16d0a0397c68 req-6b9afb54-4d9f-41cb-9858-c444ee0e3005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e428ca7a-f7f8-4dff-a272-52fb03083fd2", "tag": "e583603f-657e-4f58-aa10-f2482dfad9de"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:33.975776 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-0ea7cadf-5748-463b-847c-16d0a0397c68 req-6b9afb54-4d9f-41cb-9858-c444ee0e3005 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:33.976520 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-0ea7cadf-5748-463b-847c-16d0a0397c68 req-6b9afb54-4d9f-41cb-9858-c444ee0e3005 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:34.008239 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-0ea7cadf-5748-463b-847c-16d0a0397c68 req-6b9afb54-4d9f-41cb-9858-c444ee0e3005 service nova] Creating event network-changed:e583603f-657e-4f58-aa10-f2482dfad9de for instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 on n-h1-836830-4 Jun 16 14:40:34.018618 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-0ea7cadf-5748-463b-847c-16d0a0397c68 req-6b9afb54-4d9f-41cb-9858-c444ee0e3005 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103767 Jun 16 14:40:34.019991 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 367/679] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:40:34.301026 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-06e295ab-bbcf-4b6f-bc70-f13a66bafb2d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:34.301891 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-06e295ab-bbcf-4b6f-bc70-f13a66bafb2d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:34.324125 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06e295ab-bbcf-4b6f-bc70-f13a66bafb2d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:34.324958 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06e295ab-bbcf-4b6f-bc70-f13a66bafb2d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:34.326144 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06e295ab-bbcf-4b6f-bc70-f13a66bafb2d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:34.326920 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06e295ab-bbcf-4b6f-bc70-f13a66bafb2d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:34.604186 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-859682e3-53cf-49f9-b74b-6f5cd3d3946c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:34.627797 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-859682e3-53cf-49f9-b74b-6f5cd3d3946c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:34.635843 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-859682e3-53cf-49f9-b74b-6f5cd3d3946c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:34.644834 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-859682e3-53cf-49f9-b74b-6f5cd3d3946c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1566 microversion: 2.25 time: 0.848074 Jun 16 14:40:34.664523 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 313/680] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:33 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1566 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:40:34.675396 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-93c2845e-1d19-4d9c-bce9-07ad533b6ef6 req-ac956701-ecf7-426b-969b-007c581a2188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e048775-afa2-4ec5-91fd-f5d06c1fe6d3", "name": "network-vif-unplugged", "status": "completed", "tag": "f802939c-946a-4ee0-9525-cc56a9c04b53"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:34.706798 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-93c2845e-1d19-4d9c-bce9-07ad533b6ef6 req-ac956701-ecf7-426b-969b-007c581a2188 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:34.708096 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-93c2845e-1d19-4d9c-bce9-07ad533b6ef6 req-ac956701-ecf7-426b-969b-007c581a2188 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:34.737493 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-93c2845e-1d19-4d9c-bce9-07ad533b6ef6 req-ac956701-ecf7-426b-969b-007c581a2188 service nova] Creating event network-vif-unplugged:f802939c-946a-4ee0-9525-cc56a9c04b53 for instance 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 on n-h1-836830-4 Jun 16 14:40:34.749567 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-93c2845e-1d19-4d9c-bce9-07ad533b6ef6 req-ac956701-ecf7-426b-969b-007c581a2188 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082238 Jun 16 14:40:34.751179 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 314/681] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:34.915710 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bd874c75-319f-40bc-b4a6-3b86a9a9462e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:34.917505 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bd874c75-319f-40bc-b4a6-3b86a9a9462e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:34.930222 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bd874c75-319f-40bc-b4a6-3b86a9a9462e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:34.931586 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bd874c75-319f-40bc-b4a6-3b86a9a9462e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:34.933380 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bd874c75-319f-40bc-b4a6-3b86a9a9462e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:34.934190 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bd874c75-319f-40bc-b4a6-3b86a9a9462e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:35.309088 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bd874c75-319f-40bc-b4a6-3b86a9a9462e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:35.323073 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bd874c75-319f-40bc-b4a6-3b86a9a9462e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1313 microversion: 2.1 time: 0.416222 Jun 16 14:40:35.339206 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 315/682] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:34 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:35.421800 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-06e295ab-bbcf-4b6f-bc70-f13a66bafb2d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:35.434453 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-06e295ab-bbcf-4b6f-bc70-f13a66bafb2d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1466 microversion: 2.1 time: 1.138531 Jun 16 14:40:35.435215 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 368/683] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:34 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1466 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:40:35.685339 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1d360ea1-eee3-4bbe-80b8-c1e1c4433d98 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:35.702317 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1d360ea1-eee3-4bbe-80b8-c1e1c4433d98 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:35.727164 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1d360ea1-eee3-4bbe-80b8-c1e1c4433d98 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:35.728773 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1d360ea1-eee3-4bbe-80b8-c1e1c4433d98 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:35.734219 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1d360ea1-eee3-4bbe-80b8-c1e1c4433d98 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:35.736918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1d360ea1-eee3-4bbe-80b8-c1e1c4433d98 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:36.132998 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1d360ea1-eee3-4bbe-80b8-c1e1c4433d98 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:36.169825 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1d360ea1-eee3-4bbe-80b8-c1e1c4433d98 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:36.173912 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1d360ea1-eee3-4bbe-80b8-c1e1c4433d98 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:36.177140 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1d360ea1-eee3-4bbe-80b8-c1e1c4433d98 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1566 microversion: 2.25 time: 0.504050 Jun 16 14:40:36.178514 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 316/684] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:35 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1566 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:36.321960 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-994095718", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "b3568ba0-4c94-455d-b4a9-861990b40618"}], "security_groups": [{"name": "tempest-securitygroup--158605938"}], "key_name": "tempest-keypair-655384762", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:36.352133 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e41b1f89-20da-49b2-9730-5bed3ae27355 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:36.354559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e41b1f89-20da-49b2-9730-5bed3ae27355 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:36.365231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e41b1f89-20da-49b2-9730-5bed3ae27355 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:36.365837 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e41b1f89-20da-49b2-9730-5bed3ae27355 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:36.367514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e41b1f89-20da-49b2-9730-5bed3ae27355 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:36.368171 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e41b1f89-20da-49b2-9730-5bed3ae27355 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:36.547653 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] validate_networks() for [('b3568ba0-4c94-455d-b4a9-861990b40618', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:40:36.597333 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e41b1f89-20da-49b2-9730-5bed3ae27355 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:36.603982 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:36.619018 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e41b1f89-20da-49b2-9730-5bed3ae27355 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1313 microversion: 2.1 time: 0.271940 Jun 16 14:40:36.620599 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 317/685] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:36 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:40:36.629020 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-50141b0e-1adf-412c-a1ee-b2534019ca29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:36.630149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-50141b0e-1adf-412c-a1ee-b2534019ca29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:36.644802 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50141b0e-1adf-412c-a1ee-b2534019ca29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:36.646618 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50141b0e-1adf-412c-a1ee-b2534019ca29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:36.647781 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50141b0e-1adf-412c-a1ee-b2534019ca29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:36.650488 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50141b0e-1adf-412c-a1ee-b2534019ca29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:36.722528 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50141b0e-1adf-412c-a1ee-b2534019ca29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:36.723559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50141b0e-1adf-412c-a1ee-b2534019ca29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:36.724620 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-50141b0e-1adf-412c-a1ee-b2534019ca29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lazy-loading 'fault' on Instance uuid 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:40:36.841038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-50141b0e-1adf-412c-a1ee-b2534019ca29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:36.856375 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-50141b0e-1adf-412c-a1ee-b2534019ca29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 200 len: 1309 microversion: 2.1 time: 0.234007 Jun 16 14:40:36.857714 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 318/686] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:36 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 1309 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:37.057030 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-7a10bb18-7d2b-4e64-9081-b88c67b91bd9 req-d48edb49-a958-42c2-999b-2dc28bebe5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "612d9d55-cc49-462c-8c30-6c4c91a0f5f9", "name": "network-vif-deleted", "tag": "6d716415-3fc5-4be2-8287-f2692f5b4efb"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:37.076089 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-7a10bb18-7d2b-4e64-9081-b88c67b91bd9 req-d48edb49-a958-42c2-999b-2dc28bebe5a3 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:37.077199 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-7a10bb18-7d2b-4e64-9081-b88c67b91bd9 req-d48edb49-a958-42c2-999b-2dc28bebe5a3 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:37.115946 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-7a10bb18-7d2b-4e64-9081-b88c67b91bd9 req-d48edb49-a958-42c2-999b-2dc28bebe5a3 service nova] Creating event network-vif-deleted:6d716415-3fc5-4be2-8287-f2692f5b4efb for instance 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 on n-h2-836830-4 Jun 16 14:40:37.126505 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-7a10bb18-7d2b-4e64-9081-b88c67b91bd9 req-d48edb49-a958-42c2-999b-2dc28bebe5a3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076722 Jun 16 14:40:37.128124 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 319/687] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:37.216563 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5907eddf-da45-4ab9-aabb-fe95b714595c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:37.218019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5907eddf-da45-4ab9-aabb-fe95b714595c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:37.231335 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5907eddf-da45-4ab9-aabb-fe95b714595c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:37.232312 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5907eddf-da45-4ab9-aabb-fe95b714595c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:37.233929 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5907eddf-da45-4ab9-aabb-fe95b714595c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:37.234893 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5907eddf-da45-4ab9-aabb-fe95b714595c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:37.260121 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:40:37.260806 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:40:37.261447 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:40:37.261998 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:40:37.263012 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:40:37.278838 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:37.279587 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:37.280966 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:37.281995 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:37.318197 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Getting quotas for project 1cb259849be2454ba564207db28025d4. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:40:37.331003 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Getting quotas for user 960ce02e58de4a02a547844c88034159 and project 1cb259849be2454ba564207db28025d4. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:40:37.359188 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:40:37.363718 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:40:37.476924 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7ff82c0c-f718-43d4-88fb-693654a4e058 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.167580 Jun 16 14:40:37.481737 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 369/688] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:40:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:40:37.495929 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5907eddf-da45-4ab9-aabb-fe95b714595c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:37.503014 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cba5e9ad-44c7-477c-8d38-06b94fd8a1cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:37.504140 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cba5e9ad-44c7-477c-8d38-06b94fd8a1cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:37.521062 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5907eddf-da45-4ab9-aabb-fe95b714595c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:37.522894 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5907eddf-da45-4ab9-aabb-fe95b714595c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:37.524078 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5907eddf-da45-4ab9-aabb-fe95b714595c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1566 microversion: 2.25 time: 0.315896 Jun 16 14:40:37.526370 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 320/689] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:37 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1566 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:37.603503 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-cba5e9ad-44c7-477c-8d38-06b94fd8a1cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:37.613748 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cba5e9ad-44c7-477c-8d38-06b94fd8a1cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 200 len: 1240 microversion: 2.1 time: 0.124009 Jun 16 14:40:37.616170 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 370/690] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:37 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 1240 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:37.644737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a6d1650b-91d6-4c47-87c3-b6710095d3b3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:37.645631 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a6d1650b-91d6-4c47-87c3-b6710095d3b3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:37.651519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:37.658940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a6d1650b-91d6-4c47-87c3-b6710095d3b3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:37.659722 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a6d1650b-91d6-4c47-87c3-b6710095d3b3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:37.661165 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a6d1650b-91d6-4c47-87c3-b6710095d3b3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:37.662175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a6d1650b-91d6-4c47-87c3-b6710095d3b3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:37.882815 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7a483812-7ee6-4cb5-a3f6-2266c1b86998 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:37.886186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7a483812-7ee6-4cb5-a3f6-2266c1b86998 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: 612d9d55-cc49-462c-8c30-6c4c91a0f5f9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:37.908579 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a483812-7ee6-4cb5-a3f6-2266c1b86998 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:37.910950 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a483812-7ee6-4cb5-a3f6-2266c1b86998 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:37.913991 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a483812-7ee6-4cb5-a3f6-2266c1b86998 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:37.921047 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a483812-7ee6-4cb5-a3f6-2266c1b86998 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:37.983453 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a6d1650b-91d6-4c47-87c3-b6710095d3b3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:37.996808 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-7a483812-7ee6-4cb5-a3f6-2266c1b86998 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] HTTP exception thrown: Instance 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 could not be found. Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7a483812-7ee6-4cb5-a3f6-2266c1b86998 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Request method failure captured: Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 HTTP/1.1 Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0COAnpQEPBVesd3FKV-DqBZpSI7zQDwgBLVoqHXO2vHw2_qpFQCPbUYoyieLObMZo2I7aIsLTBMOUYNwMM_-lQuSdpYCgcQOgsQF113Lh3hsCZVChA-6HMkC4rvbBoUCO7fHq1bJlVQ9Kg83-KcrWPbIS-eXSbFrM75E2XnbCvl9BA Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: f1abbeadf6d14290a877226e9c7aaba5 Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-LiveMigrationNegativeTest-698081204 Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:40:38.001781 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:40:38.004790 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f1abbeadf6d14290a877226e9c7aaba5", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1abbeadf6d14290a877226e9c7aaba5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1abbeadf6d14290a877226e9c7aaba5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f1abbeadf6d14290a877226e9c7aaba5"}]}] Jun 16 14:40:38.004790 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-LiveMigrationNegativeTest-698081204 Jun 16 14:40:38.004790 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: f1abbeadf6d14290a877226e9c7aaba5 Jun 16 14:40:38.004790 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-698081204 Jun 16 14:40:38.004790 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-LiveMigrationNegativeTest-698081204-project Jun 16 14:40:38.004790 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:40:38.004790 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:40:38.004790 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: fb3c3d0c6cae46fd9580de9fa58447d2 Jun 16 14:40:38.004790 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-LiveMigrationNegativeTest-698081204-project Jun 16 14:40:38.004790 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:40:38.004790 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 could not be found. Jun 16 14:40:38.004790 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '612d9d55-cc49-462c-8c30-6c4c91a0f5f9'} Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 could not be found. Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:40:38.006203 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 could not be found. Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 could not be found. Jun 16 14:40:38.008292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:38.012116 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7a483812-7ee6-4cb5-a3f6-2266c1b86998 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Returning 404 to user: Instance 612d9d55-cc49-462c-8c30-6c4c91a0f5f9 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:40:38.018199 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7a483812-7ee6-4cb5-a3f6-2266c1b86998 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9" status: 404 len: 111 microversion: 2.1 time: 0.143450 Jun 16 14:40:38.019466 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 371/691] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:37 2022] GET /compute/v2.1/servers/612d9d55-cc49-462c-8c30-6c4c91a0f5f9 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:40:38.020225 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a6d1650b-91d6-4c47-87c3-b6710095d3b3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1313 microversion: 2.1 time: 0.380358 Jun 16 14:40:38.023134 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 321/692] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:37 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:38.052194 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d440d251-9199-4b93-8609-fd74eae78bbb tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:38.053110 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d440d251-9199-4b93-8609-fd74eae78bbb tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:38.068943 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d440d251-9199-4b93-8609-fd74eae78bbb tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:38.069816 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d440d251-9199-4b93-8609-fd74eae78bbb tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:38.073635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d440d251-9199-4b93-8609-fd74eae78bbb tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:38.075144 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d440d251-9199-4b93-8609-fd74eae78bbb tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:38.081368 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:38.136138 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d440d251-9199-4b93-8609-fd74eae78bbb tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:40:38.335030 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d440d251-9199-4b93-8609-fd74eae78bbb tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 204 len: 0 microversion: 2.1 time: 0.302552 Jun 16 14:40:38.342262 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 372/693] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:40:38 2022] DELETE /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:38.347540 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b122b063-2ebc-4ecd-b7f5-14793ae54555 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:38.349119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b122b063-2ebc-4ecd-b7f5-14793ae54555 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:38.358520 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b122b063-2ebc-4ecd-b7f5-14793ae54555 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:38.359100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b122b063-2ebc-4ecd-b7f5-14793ae54555 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:38.360368 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b122b063-2ebc-4ecd-b7f5-14793ae54555 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:38.361107 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b122b063-2ebc-4ecd-b7f5-14793ae54555 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:38.564500 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0e538a4d-20ce-4b3a-93ba-0f5818a24cb6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:38.566900 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0e538a4d-20ce-4b3a-93ba-0f5818a24cb6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:38.587984 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0e538a4d-20ce-4b3a-93ba-0f5818a24cb6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:38.589945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0e538a4d-20ce-4b3a-93ba-0f5818a24cb6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:38.591883 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0e538a4d-20ce-4b3a-93ba-0f5818a24cb6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:38.593076 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0e538a4d-20ce-4b3a-93ba-0f5818a24cb6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:38.648811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b122b063-2ebc-4ecd-b7f5-14793ae54555 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:38.666163 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b122b063-2ebc-4ecd-b7f5-14793ae54555 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1474 microversion: 2.1 time: 0.321977 Jun 16 14:40:38.683589 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 322/694] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:38 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1474 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:38.699239 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e5805940-8563-4d6f-b569-951fe8251411 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:38.701131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e5805940-8563-4d6f-b569-951fe8251411 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:38.714935 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e5805940-8563-4d6f-b569-951fe8251411 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:38.716620 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e5805940-8563-4d6f-b569-951fe8251411 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:38.718447 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e5805940-8563-4d6f-b569-951fe8251411 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:38.719611 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e5805940-8563-4d6f-b569-951fe8251411 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:38.834473 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e5805940-8563-4d6f-b569-951fe8251411 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:38.847188 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e5805940-8563-4d6f-b569-951fe8251411 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 200 len: 1236 microversion: 2.1 time: 0.161336 Jun 16 14:40:38.848400 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 323/695] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:38 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 1236 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:39.042964 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0e538a4d-20ce-4b3a-93ba-0f5818a24cb6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:39.053600 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b6a45c77-fbc2-4ca6-8c88-a5fdb933ef9e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:39.054640 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b6a45c77-fbc2-4ca6-8c88-a5fdb933ef9e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:39.068434 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0e538a4d-20ce-4b3a-93ba-0f5818a24cb6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:39.068768 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b6a45c77-fbc2-4ca6-8c88-a5fdb933ef9e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:39.069092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b6a45c77-fbc2-4ca6-8c88-a5fdb933ef9e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:39.070328 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b6a45c77-fbc2-4ca6-8c88-a5fdb933ef9e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:39.072431 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0e538a4d-20ce-4b3a-93ba-0f5818a24cb6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:39.074119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b6a45c77-fbc2-4ca6-8c88-a5fdb933ef9e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:39.075050 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0e538a4d-20ce-4b3a-93ba-0f5818a24cb6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1566 microversion: 2.25 time: 0.521019 Jun 16 14:40:39.076145 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 373/696] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:38 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1566 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:39.315181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b6a45c77-fbc2-4ca6-8c88-a5fdb933ef9e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:39.328502 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b6a45c77-fbc2-4ca6-8c88-a5fdb933ef9e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1313 microversion: 2.1 time: 0.280099 Jun 16 14:40:39.329918 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 324/697] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:39 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:40:39.702055 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-66ccbd43-cec1-4812-84c4-6078df8bb083 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:39.708551 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-66ccbd43-cec1-4812-84c4-6078df8bb083 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:39.722402 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-66ccbd43-cec1-4812-84c4-6078df8bb083 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:39.723748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-66ccbd43-cec1-4812-84c4-6078df8bb083 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:39.725508 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-66ccbd43-cec1-4812-84c4-6078df8bb083 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:39.726526 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-66ccbd43-cec1-4812-84c4-6078df8bb083 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:39.868248 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-64addc68-c514-46ad-93f6-2b694d449db6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:39.877879 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-64addc68-c514-46ad-93f6-2b694d449db6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:39.896607 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-64addc68-c514-46ad-93f6-2b694d449db6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:39.898944 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-64addc68-c514-46ad-93f6-2b694d449db6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:39.901345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-64addc68-c514-46ad-93f6-2b694d449db6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:39.905546 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-64addc68-c514-46ad-93f6-2b694d449db6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:40.069420 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-64addc68-c514-46ad-93f6-2b694d449db6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:40.093433 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-64addc68-c514-46ad-93f6-2b694d449db6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 200 len: 1298 microversion: 2.1 time: 0.230126 Jun 16 14:40:40.106215 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 325/698] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:39 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 1298 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:40:40.119242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e9b2b56e-4cc5-4036-828f-6a929ce33905 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:40.120090 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e9b2b56e-4cc5-4036-828f-6a929ce33905 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:40.127422 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e9b2b56e-4cc5-4036-828f-6a929ce33905 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:40.127877 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e9b2b56e-4cc5-4036-828f-6a929ce33905 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:40.128684 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e9b2b56e-4cc5-4036-828f-6a929ce33905 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:40.129123 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e9b2b56e-4cc5-4036-828f-6a929ce33905 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:40.241012 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-66ccbd43-cec1-4812-84c4-6078df8bb083 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:40.250563 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-66ccbd43-cec1-4812-84c4-6078df8bb083 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1474 microversion: 2.1 time: 0.556344 Jun 16 14:40:40.251454 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 374/699] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:39 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1474 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:40.351787 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a7803a5f-9316-4761-8e72-64add50c8762 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:40.353320 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a7803a5f-9316-4761-8e72-64add50c8762 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:40.356228 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:40.370158 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7803a5f-9316-4761-8e72-64add50c8762 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:40.371186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7803a5f-9316-4761-8e72-64add50c8762 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:40.373062 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7803a5f-9316-4761-8e72-64add50c8762 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:40.375258 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7803a5f-9316-4761-8e72-64add50c8762 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:40.478869 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e9b2b56e-4cc5-4036-828f-6a929ce33905 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:40.499039 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e9b2b56e-4cc5-4036-828f-6a929ce33905 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:40.503070 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e9b2b56e-4cc5-4036-828f-6a929ce33905 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:40.525769 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e9b2b56e-4cc5-4036-828f-6a929ce33905 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1566 microversion: 2.25 time: 0.416915 Jun 16 14:40:40.539727 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 326/700] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:40 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1566 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:41.114808 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-16aa7c01-bb5f-462b-ac3a-53d0e508a6b2 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:41.116585 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-16aa7c01-bb5f-462b-ac3a-53d0e508a6b2 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:41.127287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-16aa7c01-bb5f-462b-ac3a-53d0e508a6b2 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:41.129335 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-16aa7c01-bb5f-462b-ac3a-53d0e508a6b2 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:41.131037 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-16aa7c01-bb5f-462b-ac3a-53d0e508a6b2 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:41.132164 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-16aa7c01-bb5f-462b-ac3a-53d0e508a6b2 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:41.280058 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a7803a5f-9316-4761-8e72-64add50c8762 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:41.296893 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a7803a5f-9316-4761-8e72-64add50c8762 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1313 microversion: 2.1 time: 0.948061 Jun 16 14:40:41.297149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-16aa7c01-bb5f-462b-ac3a-53d0e508a6b2 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:41.314443 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-16aa7c01-bb5f-462b-ac3a-53d0e508a6b2 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 200 len: 1298 microversion: 2.1 time: 0.205954 Jun 16 14:40:41.315628 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 375/701] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:40 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1313 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:40:41.320894 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 327/702] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:41 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 1298 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:40:41.337373 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5f994ef4-e6ba-4ec9-bb2b-f5480824e81d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:41.338361 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5f994ef4-e6ba-4ec9-bb2b-f5480824e81d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:41.367258 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5f994ef4-e6ba-4ec9-bb2b-f5480824e81d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:41.370133 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5f994ef4-e6ba-4ec9-bb2b-f5480824e81d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:41.373857 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5f994ef4-e6ba-4ec9-bb2b-f5480824e81d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:41.375021 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5f994ef4-e6ba-4ec9-bb2b-f5480824e81d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:41.550082 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-23852ad4-09b5-43e2-9742-39d140bd819a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:41.550941 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-23852ad4-09b5-43e2-9742-39d140bd819a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:41.562192 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23852ad4-09b5-43e2-9742-39d140bd819a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:41.563094 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23852ad4-09b5-43e2-9742-39d140bd819a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:41.564485 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23852ad4-09b5-43e2-9742-39d140bd819a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:41.565281 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23852ad4-09b5-43e2-9742-39d140bd819a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:41.999197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-23852ad4-09b5-43e2-9742-39d140bd819a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:42.047013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5f994ef4-e6ba-4ec9-bb2b-f5480824e81d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:42.076350 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-23852ad4-09b5-43e2-9742-39d140bd819a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:42.110461 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-23852ad4-09b5-43e2-9742-39d140bd819a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:42.114663 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-23852ad4-09b5-43e2-9742-39d140bd819a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1566 microversion: 2.25 time: 0.568587 Jun 16 14:40:42.122233 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 328/703] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:41 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1566 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:42.157399 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5f994ef4-e6ba-4ec9-bb2b-f5480824e81d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1474 microversion: 2.1 time: 0.828176 Jun 16 14:40:42.159696 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 376/704] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:41 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1474 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:42.234097 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-8e8ab783-361c-4a51-b02a-20864a30bab8 req-619cc756-8770-4876-a9dc-d029edc174a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e428ca7a-f7f8-4dff-a272-52fb03083fd2", "name": "network-vif-plugged", "status": "completed", "tag": "e583603f-657e-4f58-aa10-f2482dfad9de"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:42.254687 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-8e8ab783-361c-4a51-b02a-20864a30bab8 req-619cc756-8770-4876-a9dc-d029edc174a6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:42.255819 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-8e8ab783-361c-4a51-b02a-20864a30bab8 req-619cc756-8770-4876-a9dc-d029edc174a6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:42.287472 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-8e8ab783-361c-4a51-b02a-20864a30bab8 req-619cc756-8770-4876-a9dc-d029edc174a6 service nova] Creating event network-vif-plugged:e583603f-657e-4f58-aa10-f2482dfad9de for instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 on n-h1-836830-4 Jun 16 14:40:42.300048 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-8e8ab783-361c-4a51-b02a-20864a30bab8 req-619cc756-8770-4876-a9dc-d029edc174a6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079123 Jun 16 14:40:42.315422 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 329/705] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:42.332736 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6e4e261f-2b47-4bd9-9e47-540ade489488 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:42.335839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6e4e261f-2b47-4bd9-9e47-540ade489488 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:42.358880 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5033741b-923c-4732-95d3-98c89adcbf12 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:42.361519 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6e4e261f-2b47-4bd9-9e47-540ade489488 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:42.363162 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5033741b-923c-4732-95d3-98c89adcbf12 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:42.364783 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6e4e261f-2b47-4bd9-9e47-540ade489488 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:42.368201 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6e4e261f-2b47-4bd9-9e47-540ade489488 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:42.369545 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6e4e261f-2b47-4bd9-9e47-540ade489488 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:42.380214 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5033741b-923c-4732-95d3-98c89adcbf12 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:42.380894 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5033741b-923c-4732-95d3-98c89adcbf12 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:42.383637 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5033741b-923c-4732-95d3-98c89adcbf12 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:42.387496 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5033741b-923c-4732-95d3-98c89adcbf12 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:42.932463 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5033741b-923c-4732-95d3-98c89adcbf12 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:42.964685 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5033741b-923c-4732-95d3-98c89adcbf12 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 200 len: 1365 microversion: 2.1 time: 0.612232 Jun 16 14:40:42.965844 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 330/706] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:42 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 1365 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:40:42.994308 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-7fd0e3f2-6292-4749-880c-95c107025aac req-6266ef8b-d78e-4cbc-94c7-723904e8c3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a046e36a-76db-4e7d-9b92-02e62742e14a", "name": "network-vif-deleted", "tag": "ed1256fa-5568-4d60-8d9f-e8b1a8491c98"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:43.026659 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-7fd0e3f2-6292-4749-880c-95c107025aac req-6266ef8b-d78e-4cbc-94c7-723904e8c3a4 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:43.027473 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-7fd0e3f2-6292-4749-880c-95c107025aac req-6266ef8b-d78e-4cbc-94c7-723904e8c3a4 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:43.084324 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-7fd0e3f2-6292-4749-880c-95c107025aac req-6266ef8b-d78e-4cbc-94c7-723904e8c3a4 service nova] Creating event network-vif-deleted:ed1256fa-5568-4d60-8d9f-e8b1a8491c98 for instance a046e36a-76db-4e7d-9b92-02e62742e14a on n-h2-836830-4 Jun 16 14:40:43.121843 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-7fd0e3f2-6292-4749-880c-95c107025aac req-6266ef8b-d78e-4cbc-94c7-723904e8c3a4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140820 Jun 16 14:40:43.126412 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 331/707] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:43.168697 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b3795d58-3871-4358-a270-d712dee5d15a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:43.172695 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b3795d58-3871-4358-a270-d712dee5d15a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:43.195867 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b3795d58-3871-4358-a270-d712dee5d15a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:43.199025 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b3795d58-3871-4358-a270-d712dee5d15a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:43.201203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b3795d58-3871-4358-a270-d712dee5d15a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:43.202364 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b3795d58-3871-4358-a270-d712dee5d15a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:43.244632 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6e4e261f-2b47-4bd9-9e47-540ade489488 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:43.268852 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6e4e261f-2b47-4bd9-9e47-540ade489488 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1313 microversion: 2.1 time: 0.939540 Jun 16 14:40:43.272400 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 377/708] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:42 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1313 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:43.281052 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f009cb4d-c5df-49db-8774-b5abc578ec29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:43.282139 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f009cb4d-c5df-49db-8774-b5abc578ec29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:43.329721 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f009cb4d-c5df-49db-8774-b5abc578ec29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:43.335039 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f009cb4d-c5df-49db-8774-b5abc578ec29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:43.339114 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f009cb4d-c5df-49db-8774-b5abc578ec29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:43.340774 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f009cb4d-c5df-49db-8774-b5abc578ec29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:43.428436 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f009cb4d-c5df-49db-8774-b5abc578ec29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:43.429195 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f009cb4d-c5df-49db-8774-b5abc578ec29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:43.429834 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-f009cb4d-c5df-49db-8774-b5abc578ec29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lazy-loading 'fault' on Instance uuid a046e36a-76db-4e7d-9b92-02e62742e14a {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:40:43.570154 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f009cb4d-c5df-49db-8774-b5abc578ec29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3c3d0c6cae46fd9580de9fa58447d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1abbeadf6d14290a877226e9c7aaba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:43.585316 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f009cb4d-c5df-49db-8774-b5abc578ec29 tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 200 len: 1308 microversion: 2.1 time: 0.308891 Jun 16 14:40:43.587667 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 378/709] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:43 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 1308 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:43.595415 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=6 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:43.800950 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b3795d58-3871-4358-a270-d712dee5d15a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:43.872509 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b3795d58-3871-4358-a270-d712dee5d15a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:43.878535 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b3795d58-3871-4358-a270-d712dee5d15a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:43.901392 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b3795d58-3871-4358-a270-d712dee5d15a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1556 microversion: 2.25 time: 0.735152 Jun 16 14:40:43.902107 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 332/710] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:43 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1556 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:43.920381 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7ae345e4-258f-470e-a5eb-d29f46384061 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '.version_select at 0x7fdf0c2d2790>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:43.923716 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ae345e4-258f-470e-a5eb-d29f46384061 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:43.925446 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ae345e4-258f-470e-a5eb-d29f46384061 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:43.945827 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7ae345e4-258f-470e-a5eb-d29f46384061 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.030128 Jun 16 14:40:43.957483 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 379/711] 10.222.0.57 () {60 vars in 1183 bytes} [Thu Jun 16 14:40:43 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:40:43.971147 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4bf35990-6674-4a31-b954-a4f280b2d660 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:43.971782 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4bf35990-6674-4a31-b954-a4f280b2d660 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:43.985649 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4bf35990-6674-4a31-b954-a4f280b2d660 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:43.986106 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4bf35990-6674-4a31-b954-a4f280b2d660 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:43.990550 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4bf35990-6674-4a31-b954-a4f280b2d660 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:43.996203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4bf35990-6674-4a31-b954-a4f280b2d660 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:43.997860 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6bb8c636-e268-4cf1-bd38-849a2ae3292d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:43.999066 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6bb8c636-e268-4cf1-bd38-849a2ae3292d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:44.012612 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6bb8c636-e268-4cf1-bd38-849a2ae3292d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:44.014519 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6bb8c636-e268-4cf1-bd38-849a2ae3292d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:44.018823 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6bb8c636-e268-4cf1-bd38-849a2ae3292d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:44.019620 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6bb8c636-e268-4cf1-bd38-849a2ae3292d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:44.564190 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-4bf35990-6674-4a31-b954-a4f280b2d660 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'services' on Instance uuid 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:40:44.676272 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4bf35990-6674-4a31-b954-a4f280b2d660 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 2048 microversion: 2.25 time: 0.708616 Jun 16 14:40:44.687320 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 333/712] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:43 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 2048 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:44.707282 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9b3beeea-57c9-474e-83ed-e1855600afa1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:44.708447 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9b3beeea-57c9-474e-83ed-e1855600afa1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:44.739318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9b3beeea-57c9-474e-83ed-e1855600afa1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:44.739527 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9b3beeea-57c9-474e-83ed-e1855600afa1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:44.747693 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9b3beeea-57c9-474e-83ed-e1855600afa1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:44.748488 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9b3beeea-57c9-474e-83ed-e1855600afa1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:45.325739 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6bb8c636-e268-4cf1-bd38-849a2ae3292d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:45.364112 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9b3beeea-57c9-474e-83ed-e1855600afa1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:45.371646 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6bb8c636-e268-4cf1-bd38-849a2ae3292d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 200 len: 1365 microversion: 2.1 time: 1.372513 Jun 16 14:40:45.373714 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 380/713] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:43 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 1365 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:40:45.386141 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9b3beeea-57c9-474e-83ed-e1855600afa1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1463 microversion: 2.1 time: 0.696803 Jun 16 14:40:45.387585 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-353f09c9-18bd-4a53-95b4-ea7aa5e24b1d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:45.388466 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-353f09c9-18bd-4a53-95b4-ea7aa5e24b1d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] [instance: a046e36a-76db-4e7d-9b92-02e62742e14a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:45.388781 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 334/714] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:44 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1463 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:45.396875 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1323954838", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "174724bb-1f38-4b2e-afaf-aad767c219ae"}]}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:45.406024 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-353f09c9-18bd-4a53-95b4-ea7aa5e24b1d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:45.409568 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-353f09c9-18bd-4a53-95b4-ea7aa5e24b1d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:45.410715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-353f09c9-18bd-4a53-95b4-ea7aa5e24b1d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:45.413281 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-353f09c9-18bd-4a53-95b4-ea7aa5e24b1d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:45.466521 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-353f09c9-18bd-4a53-95b4-ea7aa5e24b1d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] HTTP exception thrown: Instance a046e36a-76db-4e7d-9b92-02e62742e14a could not be found. Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-353f09c9-18bd-4a53-95b4-ea7aa5e24b1d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Request method failure captured: Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a HTTP/1.1 Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0COAnpQEPBVesd3FKV-DqBZpSI7zQDwgBLVoqHXO2vHw2_qpFQCPbUYoyieLObMZo2I7aIsLTBMOUYNwMM_-lQuSdpYCgcQOgsQF113Lh3hsCZVChA-6HMkC4rvbBoUCO7fHq1bJlVQ9Kg83-KcrWPbIS-eXSbFrM75E2XnbCvl9BA Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: f1abbeadf6d14290a877226e9c7aaba5 Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-LiveMigrationNegativeTest-698081204 Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:40:45.468277 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:40:45.469930 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f1abbeadf6d14290a877226e9c7aaba5", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1abbeadf6d14290a877226e9c7aaba5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f1abbeadf6d14290a877226e9c7aaba5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f1abbeadf6d14290a877226e9c7aaba5"}]}] Jun 16 14:40:45.469930 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-LiveMigrationNegativeTest-698081204 Jun 16 14:40:45.469930 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: f1abbeadf6d14290a877226e9c7aaba5 Jun 16 14:40:45.469930 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-698081204 Jun 16 14:40:45.469930 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-LiveMigrationNegativeTest-698081204-project Jun 16 14:40:45.469930 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:40:45.469930 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:40:45.469930 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: fb3c3d0c6cae46fd9580de9fa58447d2 Jun 16 14:40:45.469930 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-LiveMigrationNegativeTest-698081204-project Jun 16 14:40:45.469930 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:40:45.469930 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance a046e36a-76db-4e7d-9b92-02e62742e14a could not be found. Jun 16 14:40:45.469930 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'a046e36a-76db-4e7d-9b92-02e62742e14a'} Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a046e36a-76db-4e7d-9b92-02e62742e14a could not be found. Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:40:45.470854 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a046e36a-76db-4e7d-9b92-02e62742e14a could not be found. Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a046e36a-76db-4e7d-9b92-02e62742e14a could not be found. Jun 16 14:40:45.472206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:40:45.475307 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-353f09c9-18bd-4a53-95b4-ea7aa5e24b1d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] Returning 404 to user: Instance a046e36a-76db-4e7d-9b92-02e62742e14a could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:40:45.476667 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-353f09c9-18bd-4a53-95b4-ea7aa5e24b1d tempest-LiveMigrationNegativeTest-698081204 tempest-LiveMigrationNegativeTest-698081204-project] 10.222.0.57 "GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a" status: 404 len: 111 microversion: 2.1 time: 0.101679 Jun 16 14:40:45.477615 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 381/715] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:45 2022] GET /compute/v2.1/servers/a046e36a-76db-4e7d-9b92-02e62742e14a => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:40:45.577052 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] validate_networks() for [('174724bb-1f38-4b2e-afaf-aad767c219ae', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:40:46.366172 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c7efffbd-70ba-48af-a660-bfe815fbd9d7 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:46.367561 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c7efffbd-70ba-48af-a660-bfe815fbd9d7 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:46.381542 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c7efffbd-70ba-48af-a660-bfe815fbd9d7 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:46.382244 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c7efffbd-70ba-48af-a660-bfe815fbd9d7 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:46.383244 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c7efffbd-70ba-48af-a660-bfe815fbd9d7 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:46.387203 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c7efffbd-70ba-48af-a660-bfe815fbd9d7 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:46.812609 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:40:46.818941 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:40:46.819902 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:40:46.821040 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:40:46.823523 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:40:46.844129 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:46.845648 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:46.847844 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:46.848881 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:46.887868 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Getting quotas for project c04830ebf498422d9dddfbc009697728. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:40:46.900670 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Getting quotas for user ab3aa4e887694a0e9a42bf6db6b01555 and project c04830ebf498422d9dddfbc009697728. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:40:46.927770 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:40:46.933554 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:40:47.047278 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-939b1bbe-bbf4-4e70-a3fc-0b672d98bd5c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.656317 Jun 16 14:40:47.052001 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 335/716] 10.222.0.57 () {62 vars in 1187 bytes} [Thu Jun 16 14:40:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 14:40:47.059733 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-963cf4e4-97f6-4aa9-afa5-141875f4d94f req-25109c05-b9f3-4904-bbfd-fcc7c79b23f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3e44fe0-8c95-439e-b249-80c3791ff385", "tag": "bce297d7-6ae0-43d9-bf32-c0605158382b"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:47.082971 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:47.094405 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-963cf4e4-97f6-4aa9-afa5-141875f4d94f req-25109c05-b9f3-4904-bbfd-fcc7c79b23f8 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:47.095254 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-963cf4e4-97f6-4aa9-afa5-141875f4d94f req-25109c05-b9f3-4904-bbfd-fcc7c79b23f8 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:47.124401 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-963cf4e4-97f6-4aa9-afa5-141875f4d94f req-25109c05-b9f3-4904-bbfd-fcc7c79b23f8 service nova] Creating event network-changed:bce297d7-6ae0-43d9-bf32-c0605158382b for instance b3e44fe0-8c95-439e-b249-80c3791ff385 on n-h1-836830-4 Jun 16 14:40:47.130249 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-963cf4e4-97f6-4aa9-afa5-141875f4d94f req-25109c05-b9f3-4904-bbfd-fcc7c79b23f8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076668 Jun 16 14:40:47.131561 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 336/717] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:47.150854 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bf59df45-67d3-49ca-a0ad-3ae59098f766 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:47.151596 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bf59df45-67d3-49ca-a0ad-3ae59098f766 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:47.176276 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bf59df45-67d3-49ca-a0ad-3ae59098f766 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:47.176747 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bf59df45-67d3-49ca-a0ad-3ae59098f766 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:47.179468 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bf59df45-67d3-49ca-a0ad-3ae59098f766 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:47.184242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bf59df45-67d3-49ca-a0ad-3ae59098f766 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:47.188059 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:47.268540 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c7efffbd-70ba-48af-a660-bfe815fbd9d7 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1614 microversion: 2.1 time: 1.788966 Jun 16 14:40:47.269979 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 382/718] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:45 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1614 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:47.287998 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2766e6ae-32e6-46ea-a8c5-59b01a1d43cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:47.289037 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2766e6ae-32e6-46ea-a8c5-59b01a1d43cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:47.299096 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=8 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:47.427551 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2766e6ae-32e6-46ea-a8c5-59b01a1d43cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:47.461714 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2766e6ae-32e6-46ea-a8c5-59b01a1d43cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:47.469473 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2766e6ae-32e6-46ea-a8c5-59b01a1d43cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:47.472692 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2766e6ae-32e6-46ea-a8c5-59b01a1d43cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1262 microversion: 2.25 time: 0.200785 Jun 16 14:40:47.475974 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 383/719] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:47 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1262 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:47.503116 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-adda94ec-a124-41f4-834d-df3ffe52aabb tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:47.505060 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-adda94ec-a124-41f4-834d-df3ffe52aabb tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:47.518192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-adda94ec-a124-41f4-834d-df3ffe52aabb tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:47.520620 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-adda94ec-a124-41f4-834d-df3ffe52aabb tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:47.522654 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-adda94ec-a124-41f4-834d-df3ffe52aabb tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:47.523975 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-adda94ec-a124-41f4-834d-df3ffe52aabb tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:47.627825 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-adda94ec-a124-41f4-834d-df3ffe52aabb tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7027abf25d204ad0920f6fbf5ae3d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd3583f5c54aa9b355c861148731b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:47.630195 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-adda94ec-a124-41f4-834d-df3ffe52aabb tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] flavor_id is None. Assuming migration. {{(pid=125863) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 16 14:40:47.631714 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-adda94ec-a124-41f4-834d-df3ffe52aabb tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125863) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 14:40:47.749549 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bf59df45-67d3-49ca-a0ad-3ae59098f766 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:47.763062 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bf59df45-67d3-49ca-a0ad-3ae59098f766 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 200 len: 1365 microversion: 2.1 time: 0.629981 Jun 16 14:40:47.766184 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 337/720] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:47 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 1365 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:48.507853 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-80c52ba6-292a-43d3-b910-6ccccb3b7771 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:48.508506 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-80c52ba6-292a-43d3-b910-6ccccb3b7771 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:48.554448 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-80c52ba6-292a-43d3-b910-6ccccb3b7771 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:48.555406 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-80c52ba6-292a-43d3-b910-6ccccb3b7771 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:48.557007 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-80c52ba6-292a-43d3-b910-6ccccb3b7771 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:48.558197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-80c52ba6-292a-43d3-b910-6ccccb3b7771 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:48.603896 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-adda94ec-a124-41f4-834d-df3ffe52aabb tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2/action" status: 202 len: 0 microversion: 2.1 time: 1.121221 Jun 16 14:40:48.609969 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 384/721] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:40:47 2022] POST /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2/action => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:40:48.625768 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3035fe5e-81f1-456e-8eb1-a68751627db5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:48.627125 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3035fe5e-81f1-456e-8eb1-a68751627db5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:48.640029 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3035fe5e-81f1-456e-8eb1-a68751627db5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:48.641215 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3035fe5e-81f1-456e-8eb1-a68751627db5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:48.642235 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3035fe5e-81f1-456e-8eb1-a68751627db5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:48.642872 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3035fe5e-81f1-456e-8eb1-a68751627db5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:48.839740 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-80c52ba6-292a-43d3-b910-6ccccb3b7771 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:48.857780 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-80c52ba6-292a-43d3-b910-6ccccb3b7771 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:48.859975 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-80c52ba6-292a-43d3-b910-6ccccb3b7771 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:48.865095 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-80c52ba6-292a-43d3-b910-6ccccb3b7771 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1314 microversion: 2.25 time: 0.363722 Jun 16 14:40:48.876637 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 338/722] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:48 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:48.881829 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-96bf37da-b195-480f-a247-317c2d310586 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:48.882791 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-96bf37da-b195-480f-a247-317c2d310586 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:48.889980 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-96bf37da-b195-480f-a247-317c2d310586 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:48.890742 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-96bf37da-b195-480f-a247-317c2d310586 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:48.891790 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-96bf37da-b195-480f-a247-317c2d310586 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:48.892431 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-96bf37da-b195-480f-a247-317c2d310586 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:49.036724 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3035fe5e-81f1-456e-8eb1-a68751627db5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:49.050190 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3035fe5e-81f1-456e-8eb1-a68751627db5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1472 microversion: 2.1 time: 0.434048 Jun 16 14:40:49.062520 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 385/723] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:48 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1472 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:49.399571 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-96bf37da-b195-480f-a247-317c2d310586 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:49.412731 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-96bf37da-b195-480f-a247-317c2d310586 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 200 len: 1365 microversion: 2.1 time: 0.534590 Jun 16 14:40:49.419954 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 339/724] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:48 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 1365 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:49.884365 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-40070448-baf8-4263-81f4-49b818bd1f05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:49.885836 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-40070448-baf8-4263-81f4-49b818bd1f05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:49.897325 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40070448-baf8-4263-81f4-49b818bd1f05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:49.899287 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40070448-baf8-4263-81f4-49b818bd1f05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:49.900549 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40070448-baf8-4263-81f4-49b818bd1f05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:49.902345 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40070448-baf8-4263-81f4-49b818bd1f05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:50.070635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a0893c38-9431-440e-a8dd-3b2c0b3e762d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:50.076290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a0893c38-9431-440e-a8dd-3b2c0b3e762d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:50.098418 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a0893c38-9431-440e-a8dd-3b2c0b3e762d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:50.101630 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a0893c38-9431-440e-a8dd-3b2c0b3e762d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:50.103324 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a0893c38-9431-440e-a8dd-3b2c0b3e762d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:50.106913 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a0893c38-9431-440e-a8dd-3b2c0b3e762d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:50.131473 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-40070448-baf8-4263-81f4-49b818bd1f05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:50.159125 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-40070448-baf8-4263-81f4-49b818bd1f05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:50.162275 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-40070448-baf8-4263-81f4-49b818bd1f05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:50.186603 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-40070448-baf8-4263-81f4-49b818bd1f05 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1320 microversion: 2.25 time: 0.302310 Jun 16 14:40:50.192282 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 386/725] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:49 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1320 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:40:50.461425 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-da57e709-5a06-4dd5-98d7-66317b30d616 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:50.467331 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-da57e709-5a06-4dd5-98d7-66317b30d616 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:50.513529 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-da57e709-5a06-4dd5-98d7-66317b30d616 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:50.515772 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-da57e709-5a06-4dd5-98d7-66317b30d616 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:50.516677 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-da57e709-5a06-4dd5-98d7-66317b30d616 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:50.517319 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-da57e709-5a06-4dd5-98d7-66317b30d616 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:50.559556 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:50.654730 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a0893c38-9431-440e-a8dd-3b2c0b3e762d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:50.668582 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a0893c38-9431-440e-a8dd-3b2c0b3e762d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1472 microversion: 2.1 time: 0.603373 Jun 16 14:40:50.671782 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 340/726] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:50 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1472 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:51.219919 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3d83c5db-4b88-4b9f-aa31-fdbc44e444a6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:51.220719 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3d83c5db-4b88-4b9f-aa31-fdbc44e444a6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:51.242112 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d83c5db-4b88-4b9f-aa31-fdbc44e444a6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:51.243218 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d83c5db-4b88-4b9f-aa31-fdbc44e444a6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:51.245387 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d83c5db-4b88-4b9f-aa31-fdbc44e444a6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:51.246715 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d83c5db-4b88-4b9f-aa31-fdbc44e444a6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:51.417913 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3d83c5db-4b88-4b9f-aa31-fdbc44e444a6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:51.433785 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3d83c5db-4b88-4b9f-aa31-fdbc44e444a6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:51.438083 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3d83c5db-4b88-4b9f-aa31-fdbc44e444a6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:51.443886 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3d83c5db-4b88-4b9f-aa31-fdbc44e444a6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1320 microversion: 2.25 time: 0.228214 Jun 16 14:40:51.444620 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 341/727] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:51 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1320 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:40:51.607190 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-da57e709-5a06-4dd5-98d7-66317b30d616 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:51.623291 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-da57e709-5a06-4dd5-98d7-66317b30d616 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 200 len: 1365 microversion: 2.1 time: 1.177752 Jun 16 14:40:51.624285 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 387/728] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:50 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 1365 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:51.693705 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e1b7b501-f8d5-480d-8739-b46969135b46 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:51.694862 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e1b7b501-f8d5-480d-8739-b46969135b46 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:51.713328 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e1b7b501-f8d5-480d-8739-b46969135b46 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:51.714435 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e1b7b501-f8d5-480d-8739-b46969135b46 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:51.715475 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e1b7b501-f8d5-480d-8739-b46969135b46 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:51.717830 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e1b7b501-f8d5-480d-8739-b46969135b46 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:52.116360 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e1b7b501-f8d5-480d-8739-b46969135b46 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:52.140434 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e1b7b501-f8d5-480d-8739-b46969135b46 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1472 microversion: 2.1 time: 0.450348 Jun 16 14:40:52.158609 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 342/729] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:51 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1472 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:52.176990 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-20ed4339-1502-49ee-b46c-b52d37ddc20f tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] Action: 'create', calling method: .version_select at 0x7fdf0c522e50>, body: {"pool": null} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:52.391027 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5bd07db3-2baf-4024-bb0b-54fc3d25868f tempest-SecurityGroupsTestAdminJSON-1090076822 tempest-SecurityGroupsTestAdminJSON-1090076822-project] Action: 'create', calling method: .version_select at 0x7fdf0c5434c0>, body: {"security_group": {"name": "tempest-securitygroup-1433967993", "description": "tempest-description-1282638742"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:53.047209 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5bd07db3-2baf-4024-bb0b-54fc3d25868f tempest-SecurityGroupsTestAdminJSON-1090076822 tempest-SecurityGroupsTestAdminJSON-1090076822-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.886121 Jun 16 14:40:53.060591 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 343/730] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:40:52 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:53.072223 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bc739962-5fc6-4d85-a966-c77e9a688eea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:53.074465 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bc739962-5fc6-4d85-a966-c77e9a688eea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:53.091034 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bc739962-5fc6-4d85-a966-c77e9a688eea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:53.092584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bc739962-5fc6-4d85-a966-c77e9a688eea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:53.094609 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bc739962-5fc6-4d85-a966-c77e9a688eea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:53.095692 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bc739962-5fc6-4d85-a966-c77e9a688eea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:53.484942 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bc739962-5fc6-4d85-a966-c77e9a688eea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:53.496912 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bc739962-5fc6-4d85-a966-c77e9a688eea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:53.504175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bc739962-5fc6-4d85-a966-c77e9a688eea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:53.505921 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bc739962-5fc6-4d85-a966-c77e9a688eea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1362 microversion: 2.25 time: 0.440929 Jun 16 14:40:53.507305 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 344/731] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:53 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1362 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:53.514020 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-21ac7072-07d0-4cb3-95fa-4d75ac15fe64 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:53.518597 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-21ac7072-07d0-4cb3-95fa-4d75ac15fe64 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:53.532516 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-21ac7072-07d0-4cb3-95fa-4d75ac15fe64 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:53.533271 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-21ac7072-07d0-4cb3-95fa-4d75ac15fe64 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:53.534279 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-21ac7072-07d0-4cb3-95fa-4d75ac15fe64 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:53.534926 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-21ac7072-07d0-4cb3-95fa-4d75ac15fe64 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:53.907657 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-21ac7072-07d0-4cb3-95fa-4d75ac15fe64 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:53.940965 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-21ac7072-07d0-4cb3-95fa-4d75ac15fe64 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 200 len: 1365 microversion: 2.1 time: 0.430389 Jun 16 14:40:53.946115 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 345/732] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:53 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 1365 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:53.959067 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-5a20645c-2e03-4070-b476-4c26dd2162a9 req-96afe515-729b-4569-989a-8dd43305bc82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3e44fe0-8c95-439e-b249-80c3791ff385", "name": "network-vif-plugged", "status": "completed", "tag": "bce297d7-6ae0-43d9-bf32-c0605158382b"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:53.979617 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-5a20645c-2e03-4070-b476-4c26dd2162a9 req-96afe515-729b-4569-989a-8dd43305bc82 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:53.981162 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-5a20645c-2e03-4070-b476-4c26dd2162a9 req-96afe515-729b-4569-989a-8dd43305bc82 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:54.007046 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-5a20645c-2e03-4070-b476-4c26dd2162a9 req-96afe515-729b-4569-989a-8dd43305bc82 service nova] Creating event network-vif-plugged:bce297d7-6ae0-43d9-bf32-c0605158382b for instance b3e44fe0-8c95-439e-b249-80c3791ff385 on n-h1-836830-4 Jun 16 14:40:54.023807 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-5a20645c-2e03-4070-b476-4c26dd2162a9 req-96afe515-729b-4569-989a-8dd43305bc82 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074238 Jun 16 14:40:54.029237 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 346/733] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:54.044389 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5e1ffb75-6ad7-4e88-bc0f-b5e81a9f74c9 tempest-SecurityGroupsTestAdminJSON-1090076822 tempest-SecurityGroupsTestAdminJSON-1090076822-project] Action: 'create', calling method: .version_select at 0x7fdf0c588ca0>, body: {"security_group": {"name": "tempest-securitygroup-1220570044", "description": "tempest-description-1237366114"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:54.611689 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5e1ffb75-6ad7-4e88-bc0f-b5e81a9f74c9 tempest-SecurityGroupsTestAdminJSON-1090076822 tempest-SecurityGroupsTestAdminJSON-1090076822-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.579191 Jun 16 14:40:54.615704 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 347/734] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:40:54 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:54.644238 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e1f3aad9-9526-435b-a437-b59760e9d307 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:54.649234 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e1f3aad9-9526-435b-a437-b59760e9d307 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:54.678925 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e1f3aad9-9526-435b-a437-b59760e9d307 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:54.680906 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e1f3aad9-9526-435b-a437-b59760e9d307 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:54.686418 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e1f3aad9-9526-435b-a437-b59760e9d307 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:54.687616 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e1f3aad9-9526-435b-a437-b59760e9d307 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:55.134030 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e1f3aad9-9526-435b-a437-b59760e9d307 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:55.174421 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e1f3aad9-9526-435b-a437-b59760e9d307 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1472 microversion: 2.1 time: 0.550354 Jun 16 14:40:55.175523 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 348/735] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:54 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1472 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:55.189573 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1acf8c26-ef48-4af1-9787-b053ee2abf2f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:55.191595 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1acf8c26-ef48-4af1-9787-b053ee2abf2f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:55.202436 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1acf8c26-ef48-4af1-9787-b053ee2abf2f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:55.203380 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1acf8c26-ef48-4af1-9787-b053ee2abf2f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:55.204419 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1acf8c26-ef48-4af1-9787-b053ee2abf2f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:55.205056 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1acf8c26-ef48-4af1-9787-b053ee2abf2f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:55.625707 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1acf8c26-ef48-4af1-9787-b053ee2abf2f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:55.648088 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1acf8c26-ef48-4af1-9787-b053ee2abf2f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:55.660319 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1acf8c26-ef48-4af1-9787-b053ee2abf2f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:55.667603 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1acf8c26-ef48-4af1-9787-b053ee2abf2f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1362 microversion: 2.25 time: 0.486927 Jun 16 14:40:55.670233 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 349/736] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:55 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1362 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:55.835529 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5181c1ef-8c62-4f8a-ad4b-1f3f72799c49 tempest-SecurityGroupsTestAdminJSON-673923398 tempest-SecurityGroupsTestAdminJSON-673923398-project-admin] Action: 'create', calling method: .version_select at 0x7fdf0c5885e0>, body: {"security_group": {"name": "tempest-securitygroup-742344431", "description": "tempest-description-451299872"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:56.685622 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5181c1ef-8c62-4f8a-ad4b-1f3f72799c49 tempest-SecurityGroupsTestAdminJSON-673923398 tempest-SecurityGroupsTestAdminJSON-673923398-project-admin] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.012301 Jun 16 14:40:56.687378 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 350/737] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:40:55 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:56.693688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b5085198-7113-40f2-8876-1709a851280d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:56.694842 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b5085198-7113-40f2-8876-1709a851280d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:56.724409 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b5085198-7113-40f2-8876-1709a851280d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:56.725184 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b5085198-7113-40f2-8876-1709a851280d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:56.726309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b5085198-7113-40f2-8876-1709a851280d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:56.728174 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b5085198-7113-40f2-8876-1709a851280d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:56.864586 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:56.915143 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=6 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:57.094780 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b5085198-7113-40f2-8876-1709a851280d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:57.115826 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b5085198-7113-40f2-8876-1709a851280d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 200 len: 1555 microversion: 2.1 time: 0.426753 Jun 16 14:40:57.117454 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 351/738] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:56 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 1555 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:57.131971 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-448f4b20-ae1b-40f3-8399-0a84595d24ed req-611fccd2-b078-4b8f-a0b9-93ed7eaa08d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7db7635-8f84-4337-b9ba-d84b8c36e787", "tag": "b7334014-51f5-4bc4-84ad-f055776c3b7e"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:57.152959 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-448f4b20-ae1b-40f3-8399-0a84595d24ed req-611fccd2-b078-4b8f-a0b9-93ed7eaa08d4 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:57.153793 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-448f4b20-ae1b-40f3-8399-0a84595d24ed req-611fccd2-b078-4b8f-a0b9-93ed7eaa08d4 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:57.186444 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-448f4b20-ae1b-40f3-8399-0a84595d24ed req-611fccd2-b078-4b8f-a0b9-93ed7eaa08d4 service nova] Creating event network-changed:b7334014-51f5-4bc4-84ad-f055776c3b7e for instance b7db7635-8f84-4337-b9ba-d84b8c36e787 on n-h2-836830-4 Jun 16 14:40:57.200980 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-448f4b20-ae1b-40f3-8399-0a84595d24ed req-611fccd2-b078-4b8f-a0b9-93ed7eaa08d4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081480 Jun 16 14:40:57.202519 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 352/739] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:57.208535 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-56d3ff97-ce7a-4038-9599-a133a967421d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:57.209413 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-56d3ff97-ce7a-4038-9599-a133a967421d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:57.217230 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56d3ff97-ce7a-4038-9599-a133a967421d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:57.218057 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56d3ff97-ce7a-4038-9599-a133a967421d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:57.219117 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56d3ff97-ce7a-4038-9599-a133a967421d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:57.220058 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56d3ff97-ce7a-4038-9599-a133a967421d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:57.450618 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=20 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:40:57.488354 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-56d3ff97-ce7a-4038-9599-a133a967421d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:57.511332 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-56d3ff97-ce7a-4038-9599-a133a967421d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1477 microversion: 2.1 time: 0.305852 Jun 16 14:40:57.512589 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 353/740] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:57 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1477 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:57.521375 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9a874a17-9caa-4e07-b663-4bf168d6d0b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:57.522281 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9a874a17-9caa-4e07-b663-4bf168d6d0b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:57.547166 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a874a17-9caa-4e07-b663-4bf168d6d0b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:57.548632 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a874a17-9caa-4e07-b663-4bf168d6d0b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:57.555479 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a874a17-9caa-4e07-b663-4bf168d6d0b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:57.556131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a874a17-9caa-4e07-b663-4bf168d6d0b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:57.586840 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-20ed4339-1502-49ee-b46c-b52d37ddc20f tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.831537 Jun 16 14:40:57.587662 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 388/741] 10.222.0.57 () {60 vars in 1169 bytes} [Thu Jun 16 14:40:51 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:57.598167 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3e1cb883-c5e9-499e-94e2-f39b91523698 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:57.599347 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3e1cb883-c5e9-499e-94e2-f39b91523698 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:57.610936 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3e1cb883-c5e9-499e-94e2-f39b91523698 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:57.611744 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3e1cb883-c5e9-499e-94e2-f39b91523698 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:57.613462 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3e1cb883-c5e9-499e-94e2-f39b91523698 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:57.614560 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3e1cb883-c5e9-499e-94e2-f39b91523698 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:57.616660 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9a874a17-9caa-4e07-b663-4bf168d6d0b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:40:57.775373 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9a874a17-9caa-4e07-b663-4bf168d6d0b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 204 len: 0 microversion: 2.1 time: 0.260622 Jun 16 14:40:57.776878 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 354/742] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:40:57 2022] DELETE /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:40:57.782967 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-89956e45-a6e0-4efd-a927-cd87c2a7bf9e tempest-SecurityGroupsTestAdminJSON-673923398 tempest-SecurityGroupsTestAdminJSON-673923398-project-admin] Action: 'create', calling method: .version_select at 0x7fdf0c5afd30>, body: {"security_group": {"name": "tempest-securitygroup-327519625", "description": "tempest-description-253278262"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:57.843854 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3e1cb883-c5e9-499e-94e2-f39b91523698 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:57.867182 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3e1cb883-c5e9-499e-94e2-f39b91523698 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:57.872151 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3e1cb883-c5e9-499e-94e2-f39b91523698 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:57.874444 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3e1cb883-c5e9-499e-94e2-f39b91523698 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1362 microversion: 2.25 time: 0.283760 Jun 16 14:40:57.875377 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 389/743] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:40:57 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:40:57.906785 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ecac262f-ca4e-4046-b886-9af3f57ca5cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:57.907526 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ecac262f-ca4e-4046-b886-9af3f57ca5cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:57.916680 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ecac262f-ca4e-4046-b886-9af3f57ca5cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:57.917605 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ecac262f-ca4e-4046-b886-9af3f57ca5cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:57.919340 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ecac262f-ca4e-4046-b886-9af3f57ca5cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:57.920413 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ecac262f-ca4e-4046-b886-9af3f57ca5cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:58.048532 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-89956e45-a6e0-4efd-a927-cd87c2a7bf9e tempest-SecurityGroupsTestAdminJSON-673923398 tempest-SecurityGroupsTestAdminJSON-673923398-project-admin] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.263141 Jun 16 14:40:58.059638 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 355/744] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:40:57 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:58.061205 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ecac262f-ca4e-4046-b886-9af3f57ca5cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169602 Jun 16 14:40:58.061779 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-98e0d655-28eb-4186-8a96-015d53cb7fb0 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] Calling method '.version_select at 0x7fdf0c5431f0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:58.062732 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 390/745] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 16 14:40:57 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:58.073512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8020a812-3483-43af-9dad-08709c8a8f82 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:58.075056 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8020a812-3483-43af-9dad-08709c8a8f82 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:58.090119 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8020a812-3483-43af-9dad-08709c8a8f82 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:58.090713 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8020a812-3483-43af-9dad-08709c8a8f82 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:58.092300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8020a812-3483-43af-9dad-08709c8a8f82 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:58.093058 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8020a812-3483-43af-9dad-08709c8a8f82 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:58.389339 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-98e0d655-28eb-4186-8a96-015d53cb7fb0 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ips/98448358-dfdc-44a5-a915-95a63413ec8e" status: 200 len: 141 microversion: 2.1 time: 0.335954 Jun 16 14:40:58.390344 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 356/746] 10.222.0.57 () {58 vars in 1259 bytes} [Thu Jun 16 14:40:58 2022] GET /compute/v2.1/os-floating-ips/98448358-dfdc-44a5-a915-95a63413ec8e => generated 141 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:40:58.402098 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8020a812-3483-43af-9dad-08709c8a8f82 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:40:58.404019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d31666bc-f7e1-45ee-a9af-54427094d07f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e368e19c-e899-4393-af70-1a30817c24d2"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:40:58.406245 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d31666bc-f7e1-45ee-a9af-54427094d07f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:40:58.417928 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d31666bc-f7e1-45ee-a9af-54427094d07f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:58.418673 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d31666bc-f7e1-45ee-a9af-54427094d07f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:58.420029 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d31666bc-f7e1-45ee-a9af-54427094d07f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:40:58.421232 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d31666bc-f7e1-45ee-a9af-54427094d07f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:40:58.421442 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8020a812-3483-43af-9dad-08709c8a8f82 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 200 len: 1714 microversion: 2.1 time: 0.355820 Jun 16 14:40:58.422751 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 391/747] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:40:58 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 1714 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:40:58.435015 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cbfb37cb-1cd2-4c6a-a9d1-def0fb1a360e tempest-SecurityGroupsTestAdminJSON-673923398 tempest-SecurityGroupsTestAdminJSON-673923398-project-admin] Calling method '.version_select at 0x7fdf0c3a0940>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:40:59.898021 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:00.159046 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d31666bc-f7e1-45ee-a9af-54427094d07f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "POST /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.766820 Jun 16 14:41:00.159729 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 357/748] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 16 14:40:58 2022] POST /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c/os-volume_attachments => generated 194 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:00.165516 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-91913de7-c6e5-431a-a251-36f364ccb339 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] Calling method '.version_select at 0x7fdf0c4d28b0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:00.595963 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-91913de7-c6e5-431a-a251-36f364ccb339 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.434465 Jun 16 14:41:00.596863 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 358/749] 10.222.0.57 () {58 vars in 1148 bytes} [Thu Jun 16 14:41:00 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:00.608120 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f68a7244-1d8e-4a1e-8c50-607d9b2de5b6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:00.611148 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f68a7244-1d8e-4a1e-8c50-607d9b2de5b6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:00.634817 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f68a7244-1d8e-4a1e-8c50-607d9b2de5b6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:00.638667 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f68a7244-1d8e-4a1e-8c50-607d9b2de5b6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:00.639885 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f68a7244-1d8e-4a1e-8c50-607d9b2de5b6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:00.641410 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f68a7244-1d8e-4a1e-8c50-607d9b2de5b6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:00.925805 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f68a7244-1d8e-4a1e-8c50-607d9b2de5b6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:00.935515 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f68a7244-1d8e-4a1e-8c50-607d9b2de5b6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1477 microversion: 2.1 time: 0.337267 Jun 16 14:41:00.936805 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 359/750] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:00 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1477 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:00.941820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ebd473ad-788a-4687-a5c7-01829566927a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:00.942897 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ebd473ad-788a-4687-a5c7-01829566927a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:00.951737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ebd473ad-788a-4687-a5c7-01829566927a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:00.953508 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ebd473ad-788a-4687-a5c7-01829566927a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:00.953508 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ebd473ad-788a-4687-a5c7-01829566927a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:00.954149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ebd473ad-788a-4687-a5c7-01829566927a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:01.171993 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ebd473ad-788a-4687-a5c7-01829566927a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:01.221756 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ebd473ad-788a-4687-a5c7-01829566927a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:01.226329 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ebd473ad-788a-4687-a5c7-01829566927a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:01.230469 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ebd473ad-788a-4687-a5c7-01829566927a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1362 microversion: 2.25 time: 0.291341 Jun 16 14:41:01.233826 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 360/751] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:00 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:01.257282 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dd1f141d-6fe5-45f4-965d-31a7764e9978 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:01.259110 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-dd1f141d-6fe5-45f4-965d-31a7764e9978 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:01.274675 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dd1f141d-6fe5-45f4-965d-31a7764e9978 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:01.276634 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dd1f141d-6fe5-45f4-965d-31a7764e9978 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:01.278561 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dd1f141d-6fe5-45f4-965d-31a7764e9978 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:01.279739 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dd1f141d-6fe5-45f4-965d-31a7764e9978 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:01.606254 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-dd1f141d-6fe5-45f4-965d-31a7764e9978 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:01.634805 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-dd1f141d-6fe5-45f4-965d-31a7764e9978 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 200 len: 1714 microversion: 2.1 time: 0.398534 Jun 16 14:41:01.636955 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 361/752] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:01 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 1714 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:01.645662 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-c74f9e46-0a18-4ddb-99ba-b35359978eb4 req-2d758d90-ec15-4f61-b3dc-67085a7a0611 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3e44fe0-8c95-439e-b249-80c3791ff385", "tag": "bce297d7-6ae0-43d9-bf32-c0605158382b"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:01.664390 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-c74f9e46-0a18-4ddb-99ba-b35359978eb4 req-2d758d90-ec15-4f61-b3dc-67085a7a0611 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:01.665354 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-c74f9e46-0a18-4ddb-99ba-b35359978eb4 req-2d758d90-ec15-4f61-b3dc-67085a7a0611 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:01.691080 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-c74f9e46-0a18-4ddb-99ba-b35359978eb4 req-2d758d90-ec15-4f61-b3dc-67085a7a0611 service nova] Creating event network-changed:bce297d7-6ae0-43d9-bf32-c0605158382b for instance b3e44fe0-8c95-439e-b249-80c3791ff385 on n-h1-836830-4 Jun 16 14:41:01.701011 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-c74f9e46-0a18-4ddb-99ba-b35359978eb4 req-2d758d90-ec15-4f61-b3dc-67085a7a0611 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061549 Jun 16 14:41:01.702035 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 362/753] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:01.708153 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ccb50e7c-0c2a-40b3-b0f3-045444a65069 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] Calling method '.version_select at 0x7fdf0c488ee0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:03.575682 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ccb50e7c-0c2a-40b3-b0f3-045444a65069 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/98448358-dfdc-44a5-a915-95a63413ec8e" status: 202 len: 0 microversion: 2.1 time: 1.871853 Jun 16 14:41:03.576705 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 363/754] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jun 16 14:41:01 2022] DELETE /compute/v2.1/os-floating-ips/98448358-dfdc-44a5-a915-95a63413ec8e => generated 0 bytes in 1874 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:41:03.593935 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1ebc001d-62c5-46e1-96bc-7dd1a692a8ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:03.595502 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1ebc001d-62c5-46e1-96bc-7dd1a692a8ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:03.613164 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1ebc001d-62c5-46e1-96bc-7dd1a692a8ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:03.613954 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1ebc001d-62c5-46e1-96bc-7dd1a692a8ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:03.615732 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1ebc001d-62c5-46e1-96bc-7dd1a692a8ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:03.616885 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1ebc001d-62c5-46e1-96bc-7dd1a692a8ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:03.871888 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1ebc001d-62c5-46e1-96bc-7dd1a692a8ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:03.890837 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1ebc001d-62c5-46e1-96bc-7dd1a692a8ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1477 microversion: 2.1 time: 0.310106 Jun 16 14:41:03.898687 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 364/755] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:03 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1477 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:03.906663 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2b9b5f50-5390-45a8-82bf-04e5a5db657d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:03.908238 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2b9b5f50-5390-45a8-82bf-04e5a5db657d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:03.917507 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2b9b5f50-5390-45a8-82bf-04e5a5db657d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:03.918288 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2b9b5f50-5390-45a8-82bf-04e5a5db657d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:03.919407 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2b9b5f50-5390-45a8-82bf-04e5a5db657d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:03.920402 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2b9b5f50-5390-45a8-82bf-04e5a5db657d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:04.168178 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2b9b5f50-5390-45a8-82bf-04e5a5db657d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:04.178763 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2b9b5f50-5390-45a8-82bf-04e5a5db657d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:04.180987 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2b9b5f50-5390-45a8-82bf-04e5a5db657d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:04.182436 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2b9b5f50-5390-45a8-82bf-04e5a5db657d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1362 microversion: 2.25 time: 0.281771 Jun 16 14:41:04.183229 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 365/756] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:03 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:04.199515 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-31b50632-3dc2-4e2d-94b1-87a81dd034c0 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:04.200519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-31b50632-3dc2-4e2d-94b1-87a81dd034c0 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:04.209480 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-31b50632-3dc2-4e2d-94b1-87a81dd034c0 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:04.210038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-31b50632-3dc2-4e2d-94b1-87a81dd034c0 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:04.210958 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-31b50632-3dc2-4e2d-94b1-87a81dd034c0 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:04.211417 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-31b50632-3dc2-4e2d-94b1-87a81dd034c0 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:04.257886 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-31b50632-3dc2-4e2d-94b1-87a81dd034c0 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:04.258349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-31b50632-3dc2-4e2d-94b1-87a81dd034c0 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:04.258855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-31b50632-3dc2-4e2d-94b1-87a81dd034c0 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lazy-loading 'fault' on Instance uuid bc39a7a1-2d9e-4eec-b07d-9f85e148665e {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:41:04.311288 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-31b50632-3dc2-4e2d-94b1-87a81dd034c0 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7e98a72497450c98f5f05bf74213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3bb36eedcf640af98a6bc7f41473758', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:04.321830 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-31b50632-3dc2-4e2d-94b1-87a81dd034c0 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 200 len: 1355 microversion: 2.1 time: 0.126351 Jun 16 14:41:04.324247 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 366/757] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:04 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 1355 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:04.330201 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-36c29455-c264-4c24-b411-3bdba562a6ef req-394331f3-d907-4ce4-9725-13ee46b213a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7db7635-8f84-4337-b9ba-d84b8c36e787", "name": "network-vif-plugged", "status": "completed", "tag": "b7334014-51f5-4bc4-84ad-f055776c3b7e"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:04.367639 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-36c29455-c264-4c24-b411-3bdba562a6ef req-394331f3-d907-4ce4-9725-13ee46b213a8 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:04.368558 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-36c29455-c264-4c24-b411-3bdba562a6ef req-394331f3-d907-4ce4-9725-13ee46b213a8 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:04.386872 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-36c29455-c264-4c24-b411-3bdba562a6ef req-394331f3-d907-4ce4-9725-13ee46b213a8 service nova] Creating event network-vif-plugged:b7334014-51f5-4bc4-84ad-f055776c3b7e for instance b7db7635-8f84-4337-b9ba-d84b8c36e787 on n-h2-836830-4 Jun 16 14:41:04.395828 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-36c29455-c264-4c24-b411-3bdba562a6ef req-394331f3-d907-4ce4-9725-13ee46b213a8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069859 Jun 16 14:41:04.396452 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 367/758] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:04.413411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-31cf6d4d-a917-4b4d-bcbc-25dd8d39f3ca tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] Action: 'create', calling method: .version_select at 0x7fdf0c4d2f70>, body: {"pool": null} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:05.424202 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cbfb37cb-1cd2-4c6a-a9d1-def0fb1a360e tempest-SecurityGroupsTestAdminJSON-673923398 tempest-SecurityGroupsTestAdminJSON-673923398-project-admin] 10.222.0.57 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 15660 microversion: 2.1 time: 6.999219 Jun 16 14:41:05.425528 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 392/759] 10.222.0.57 () {58 vars in 1190 bytes} [Thu Jun 16 14:40:58 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 15660 bytes in 7002 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:41:05.430926 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-fe891a48-ac88-4fe9-ba61-6fc5c1bf861b req-69f0b820-3b40-4fde-9fbb-f5b393716705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc39a7a1-2d9e-4eec-b07d-9f85e148665e", "name": "network-vif-deleted", "tag": "8dc21a1c-aebf-4862-afc4-a9a93eaf0386"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:05.449359 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-fe891a48-ac88-4fe9-ba61-6fc5c1bf861b req-69f0b820-3b40-4fde-9fbb-f5b393716705 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:05.450365 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-fe891a48-ac88-4fe9-ba61-6fc5c1bf861b req-69f0b820-3b40-4fde-9fbb-f5b393716705 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:05.465601 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-fe891a48-ac88-4fe9-ba61-6fc5c1bf861b req-69f0b820-3b40-4fde-9fbb-f5b393716705 service nova] Creating event network-vif-deleted:8dc21a1c-aebf-4862-afc4-a9a93eaf0386 for instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e on n-h2-836830-4 Jun 16 14:41:05.471411 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-fe891a48-ac88-4fe9-ba61-6fc5c1bf861b req-69f0b820-3b40-4fde-9fbb-f5b393716705 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044385 Jun 16 14:41:05.472394 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 393/760] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:05.478493 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-966fe9dd-afde-4888-831f-f74d50683e67 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:05.479584 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-966fe9dd-afde-4888-831f-f74d50683e67 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:05.492443 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-966fe9dd-afde-4888-831f-f74d50683e67 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:05.493440 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-966fe9dd-afde-4888-831f-f74d50683e67 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:05.494593 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-966fe9dd-afde-4888-831f-f74d50683e67 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:05.495442 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-966fe9dd-afde-4888-831f-f74d50683e67 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:05.769256 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-966fe9dd-afde-4888-831f-f74d50683e67 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:05.779279 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-966fe9dd-afde-4888-831f-f74d50683e67 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1477 microversion: 2.1 time: 0.305508 Jun 16 14:41:05.784956 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 394/761] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:05 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1477 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:05.793539 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-64e8da39-f854-4a9d-9dcb-d148516c5e31 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:05.799397 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-64e8da39-f854-4a9d-9dcb-d148516c5e31 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:05.810710 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-64e8da39-f854-4a9d-9dcb-d148516c5e31 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:05.814883 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-64e8da39-f854-4a9d-9dcb-d148516c5e31 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:05.815242 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-64e8da39-f854-4a9d-9dcb-d148516c5e31 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:05.815700 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-64e8da39-f854-4a9d-9dcb-d148516c5e31 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:06.110440 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-64e8da39-f854-4a9d-9dcb-d148516c5e31 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:06.123446 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-64e8da39-f854-4a9d-9dcb-d148516c5e31 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:06.125399 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-64e8da39-f854-4a9d-9dcb-d148516c5e31 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:06.126926 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-64e8da39-f854-4a9d-9dcb-d148516c5e31 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1362 microversion: 2.25 time: 0.340652 Jun 16 14:41:06.127641 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 395/762] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:05 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:06.133244 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-26085783-30b4-476c-8c00-6b1fd5dcfb73 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:06.134186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-26085783-30b4-476c-8c00-6b1fd5dcfb73 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:06.143837 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-26085783-30b4-476c-8c00-6b1fd5dcfb73 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:06.144616 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-26085783-30b4-476c-8c00-6b1fd5dcfb73 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:06.145545 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-26085783-30b4-476c-8c00-6b1fd5dcfb73 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:06.146177 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-26085783-30b4-476c-8c00-6b1fd5dcfb73 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:06.164231 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-26085783-30b4-476c-8c00-6b1fd5dcfb73 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] HTTP exception thrown: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-26085783-30b4-476c-8c00-6b1fd5dcfb73 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Request method failure captured: Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e HTTP/1.1 Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0AbtbPfFaKC1wG8aNicPWViDwI-DZ8F8a7xip-jyE3wH1NVYSvYdrPOl2pZunsWUNvwGKl41LWRvGa2xr9pNtuXFn-Ki0Gy7jnwxVUs1FnvKg3A6JDvoD6Eh1onMJMXG1C7o95EJSpAXmkoyqQVBkfhEuvqNSTPC72GuWsJqFVxRI0 Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b3bb36eedcf640af98a6bc7f41473758 Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:41:06.165953 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:41:06.168020 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b3bb36eedcf640af98a6bc7f41473758", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3bb36eedcf640af98a6bc7f41473758"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3bb36eedcf640af98a6bc7f41473758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b3bb36eedcf640af98a6bc7f41473758"}]}] Jun 16 14:41:06.168020 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:06.168020 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b3bb36eedcf640af98a6bc7f41473758 Jun 16 14:41:06.168020 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:06.168020 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1075136416-project Jun 16 14:41:06.168020 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:06.168020 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:06.168020 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 2b7e98a72497450c98f5f05bf74213a0 Jun 16 14:41:06.168020 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416-project Jun 16 14:41:06.168020 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:41:06.168020 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. Jun 16 14:41:06.168020 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'bc39a7a1-2d9e-4eec-b07d-9f85e148665e'} Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:06.169486 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. Jun 16 14:41:06.171329 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:06.173074 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-26085783-30b4-476c-8c00-6b1fd5dcfb73 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Returning 404 to user: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:06.173074 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-26085783-30b4-476c-8c00-6b1fd5dcfb73 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 404 len: 111 microversion: 2.1 time: 0.038643 Jun 16 14:41:06.173074 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 396/763] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:06 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:41:06.177239 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f052a5da-d7b3-4b11-95e1-79e029f7cd74 tempest-SecurityGroupsTestAdminJSON-1090076822 tempest-SecurityGroupsTestAdminJSON-1090076822-project] Calling method '.version_select at 0x7fdf0c266280>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:06.444001 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f052a5da-d7b3-4b11-95e1-79e029f7cd74 tempest-SecurityGroupsTestAdminJSON-1090076822 tempest-SecurityGroupsTestAdminJSON-1090076822-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.270727 Jun 16 14:41:06.444661 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 397/764] 10.222.0.57 () {58 vars in 1190 bytes} [Thu Jun 16 14:41:06 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:06.450709 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-feb98bc4-f000-4278-92b2-834ae739c411 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:06.451528 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-feb98bc4-f000-4278-92b2-834ae739c411 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:06.459458 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-feb98bc4-f000-4278-92b2-834ae739c411 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:06.459923 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-feb98bc4-f000-4278-92b2-834ae739c411 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:06.460719 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-feb98bc4-f000-4278-92b2-834ae739c411 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:06.461365 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-feb98bc4-f000-4278-92b2-834ae739c411 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:06.483591 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-feb98bc4-f000-4278-92b2-834ae739c411 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] HTTP exception thrown: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-feb98bc4-f000-4278-92b2-834ae739c411 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Request method failure captured: Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 HTTP/1.1 Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0AbtbPfFaKC1wG8aNicPWViDwI-DZ8F8a7xip-jyE3wH1NVYSvYdrPOl2pZunsWUNvwGKl41LWRvGa2xr9pNtuXFn-Ki0Gy7jnwxVUs1FnvKg3A6JDvoD6Eh1onMJMXG1C7o95EJSpAXmkoyqQVBkfhEuvqNSTPC72GuWsJqFVxRI0 Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b3bb36eedcf640af98a6bc7f41473758 Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:41:06.486752 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:41:06.488537 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b3bb36eedcf640af98a6bc7f41473758", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3bb36eedcf640af98a6bc7f41473758"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3bb36eedcf640af98a6bc7f41473758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b3bb36eedcf640af98a6bc7f41473758"}]}] Jun 16 14:41:06.488537 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:06.488537 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b3bb36eedcf640af98a6bc7f41473758 Jun 16 14:41:06.488537 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:06.488537 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1075136416-project Jun 16 14:41:06.488537 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:06.488537 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:06.488537 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 2b7e98a72497450c98f5f05bf74213a0 Jun 16 14:41:06.488537 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416-project Jun 16 14:41:06.488537 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:41:06.488537 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:06.488537 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '2b36c679-5452-4c35-ba4a-a19aa69e3fd8'} Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:06.489477 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:06.490899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:06.497694 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-feb98bc4-f000-4278-92b2-834ae739c411 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Returning 404 to user: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:06.497694 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-feb98bc4-f000-4278-92b2-834ae739c411 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 404 len: 111 microversion: 2.1 time: 0.044548 Jun 16 14:41:06.497694 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 398/765] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:41:06 2022] DELETE /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:41:06.500863 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2b0bb40c-20fe-41a7-a994-cb3d395f710a tempest-SecurityGroupsTestAdminJSON-673923398 tempest-SecurityGroupsTestAdminJSON-673923398-project-admin] Calling method '.version_select at 0x7fdf0c7c43a0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:06.795113 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2b0bb40c-20fe-41a7-a994-cb3d395f710a tempest-SecurityGroupsTestAdminJSON-673923398 tempest-SecurityGroupsTestAdminJSON-673923398-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/6f441d2a-6265-4868-a824-51d4636f38e7" status: 202 len: 0 microversion: 2.1 time: 0.300860 Jun 16 14:41:06.796997 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 399/766] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:41:06 2022] DELETE /compute/v2.1/os-security-groups/6f441d2a-6265-4868-a824-51d4636f38e7 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:41:06.813485 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-06ef2eb0-87e2-442f-9d14-edcbd870ee7c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:06.815760 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-06ef2eb0-87e2-442f-9d14-edcbd870ee7c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:06.831581 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06ef2eb0-87e2-442f-9d14-edcbd870ee7c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:06.832314 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06ef2eb0-87e2-442f-9d14-edcbd870ee7c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:06.848048 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06ef2eb0-87e2-442f-9d14-edcbd870ee7c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:06.849179 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06ef2eb0-87e2-442f-9d14-edcbd870ee7c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:06.887361 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-06ef2eb0-87e2-442f-9d14-edcbd870ee7c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] HTTP exception thrown: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-06ef2eb0-87e2-442f-9d14-edcbd870ee7c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Request method failure captured: Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 HTTP/1.1 Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0AbtbPfFaKC1wG8aNicPWViDwI-DZ8F8a7xip-jyE3wH1NVYSvYdrPOl2pZunsWUNvwGKl41LWRvGa2xr9pNtuXFn-Ki0Gy7jnwxVUs1FnvKg3A6JDvoD6Eh1onMJMXG1C7o95EJSpAXmkoyqQVBkfhEuvqNSTPC72GuWsJqFVxRI0 Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b3bb36eedcf640af98a6bc7f41473758 Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:41:06.891933 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:41:06.894599 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b3bb36eedcf640af98a6bc7f41473758", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3bb36eedcf640af98a6bc7f41473758"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3bb36eedcf640af98a6bc7f41473758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b3bb36eedcf640af98a6bc7f41473758"}]}] Jun 16 14:41:06.894599 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:06.894599 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b3bb36eedcf640af98a6bc7f41473758 Jun 16 14:41:06.894599 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:06.894599 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1075136416-project Jun 16 14:41:06.894599 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:06.894599 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:06.894599 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 2b7e98a72497450c98f5f05bf74213a0 Jun 16 14:41:06.894599 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416-project Jun 16 14:41:06.894599 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:41:06.894599 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:06.894599 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '2b36c679-5452-4c35-ba4a-a19aa69e3fd8'} Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:06.896043 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:06.898129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:06.903575 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-06ef2eb0-87e2-442f-9d14-edcbd870ee7c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Returning 404 to user: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:06.903575 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-06ef2eb0-87e2-442f-9d14-edcbd870ee7c tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 404 len: 111 microversion: 2.1 time: 0.099250 Jun 16 14:41:06.903575 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 400/767] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:06 2022] GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:41:06.911974 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a806667b-9106-47c1-be4d-17e209563bc1 tempest-SecurityGroupsTestAdminJSON-673923398 tempest-SecurityGroupsTestAdminJSON-673923398-project-admin] Calling method '.version_select at 0x7fdf0c266670>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:07.225024 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a806667b-9106-47c1-be4d-17e209563bc1 tempest-SecurityGroupsTestAdminJSON-673923398 tempest-SecurityGroupsTestAdminJSON-673923398-project-admin] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/3247ef5b-cdbf-4224-a39d-3f266c96b95d" status: 202 len: 0 microversion: 2.1 time: 0.320474 Jun 16 14:41:07.225974 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 401/768] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:41:06 2022] DELETE /compute/v2.1/os-security-groups/3247ef5b-cdbf-4224-a39d-3f266c96b95d => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:41:07.232951 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-eb847ab7-d7c5-4439-925a-c93b299f1045 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:07.233613 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-eb847ab7-d7c5-4439-925a-c93b299f1045 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:07.240895 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb847ab7-d7c5-4439-925a-c93b299f1045 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:07.241400 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb847ab7-d7c5-4439-925a-c93b299f1045 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:07.242160 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb847ab7-d7c5-4439-925a-c93b299f1045 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:07.242795 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb847ab7-d7c5-4439-925a-c93b299f1045 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:07.394634 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-31cf6d4d-a917-4b4d-bcbc-25dd8d39f3ca tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.996691 Jun 16 14:41:07.396112 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 368/769] 10.222.0.57 () {60 vars in 1169 bytes} [Thu Jun 16 14:41:04 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:07.405797 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f99bb6fb-7808-4faf-b7a8-9b6a1cb0337a tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '.version_select at 0x7fdf0c4bb310>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:07.444318 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f99bb6fb-7808-4faf-b7a8-9b6a1cb0337a tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584692722" status: 202 len: 0 microversion: 2.1 time: 0.046422 Jun 16 14:41:07.445201 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 369/770] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jun 16 14:41:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584692722 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:41:07.453444 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-885b5941-4904-4b26-8cca-1c685c05efd1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:07.454774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-885b5941-4904-4b26-8cca-1c685c05efd1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:07.467181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-885b5941-4904-4b26-8cca-1c685c05efd1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:07.467773 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-885b5941-4904-4b26-8cca-1c685c05efd1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:07.469215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-885b5941-4904-4b26-8cca-1c685c05efd1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:07.470504 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-885b5941-4904-4b26-8cca-1c685c05efd1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:07.482002 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-eb847ab7-d7c5-4439-925a-c93b299f1045 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:07.497908 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-eb847ab7-d7c5-4439-925a-c93b299f1045 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1477 microversion: 2.1 time: 0.270033 Jun 16 14:41:07.499186 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 402/771] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:07 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1477 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:07.507709 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c8df3b54-dd21-4aba-bfd6-e75d1f509e56 tempest-SecurityGroupsTestAdminJSON-1090076822 tempest-SecurityGroupsTestAdminJSON-1090076822-project] Calling method '.version_select at 0x7fdf0c7c4160>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:07.772830 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-885b5941-4904-4b26-8cca-1c685c05efd1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:07.814709 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-885b5941-4904-4b26-8cca-1c685c05efd1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:07.825760 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-885b5941-4904-4b26-8cca-1c685c05efd1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:07.830071 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-885b5941-4904-4b26-8cca-1c685c05efd1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1557 microversion: 2.25 time: 0.382954 Jun 16 14:41:07.832657 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 370/772] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:07 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1557 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:07.843313 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a99032e5-9f47-4a3d-978e-1a862b0a1de8 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] Calling method '.version_select at 0x7fdf0c4bbf70>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:08.023997 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c8df3b54-dd21-4aba-bfd6-e75d1f509e56 tempest-SecurityGroupsTestAdminJSON-1090076822 tempest-SecurityGroupsTestAdminJSON-1090076822-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/e8a72fb0-4502-4669-ba8d-dea8e32a4eeb" status: 202 len: 0 microversion: 2.1 time: 0.522696 Jun 16 14:41:08.025898 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 403/773] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:41:07 2022] DELETE /compute/v2.1/os-security-groups/e8a72fb0-4502-4669-ba8d-dea8e32a4eeb => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:41:08.036788 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-14d06d55-04de-4821-b008-35f639ae80bc tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:08.039854 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-14d06d55-04de-4821-b008-35f639ae80bc tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:08.130322 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14d06d55-04de-4821-b008-35f639ae80bc tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:08.140162 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14d06d55-04de-4821-b008-35f639ae80bc tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:08.149858 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14d06d55-04de-4821-b008-35f639ae80bc tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:08.150779 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14d06d55-04de-4821-b008-35f639ae80bc tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:08.442141 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-14d06d55-04de-4821-b008-35f639ae80bc tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'services' on Instance uuid b7db7635-8f84-4337-b9ba-d84b8c36e787 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:41:08.459951 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-14d06d55-04de-4821-b008-35f639ae80bc tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 2050 microversion: 2.25 time: 0.431200 Jun 16 14:41:08.460850 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 404/774] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:08 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 2050 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:08.466618 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ddea378f-96fe-40a4-9f28-1d563c36d635 tempest-SecurityGroupsTestAdminJSON-1090076822 tempest-SecurityGroupsTestAdminJSON-1090076822-project] Calling method '.version_select at 0x7fdf0c7c43a0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:08.955639 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ddea378f-96fe-40a4-9f28-1d563c36d635 tempest-SecurityGroupsTestAdminJSON-1090076822 tempest-SecurityGroupsTestAdminJSON-1090076822-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/938c23a8-eab2-4765-b890-0fa903d753f5" status: 202 len: 0 microversion: 2.1 time: 0.492582 Jun 16 14:41:08.961044 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 405/775] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:41:08 2022] DELETE /compute/v2.1/os-security-groups/938c23a8-eab2-4765-b890-0fa903d753f5 => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:41:08.993791 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2d91442f-37ac-4d81-a877-ca789e08339b tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:09.018227 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2d91442f-37ac-4d81-a877-ca789e08339b tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:09.056334 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2d91442f-37ac-4d81-a877-ca789e08339b tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.059161 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2d91442f-37ac-4d81-a877-ca789e08339b tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:09.062871 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2d91442f-37ac-4d81-a877-ca789e08339b tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.067146 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2d91442f-37ac-4d81-a877-ca789e08339b tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:09.069136 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a99032e5-9f47-4a3d-978e-1a862b0a1de8 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/21df1717-bb99-45c0-b0c2-e12422f5cdd7" status: 202 len: 0 microversion: 2.1 time: 1.234139 Jun 16 14:41:09.070741 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 371/776] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jun 16 14:41:07 2022] DELETE /compute/v2.1/os-floating-ips/21df1717-bb99-45c0-b0c2-e12422f5cdd7 => generated 0 bytes in 1237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:41:09.093141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0464bbce-8d68-49b0-b818-9d3edf7ea82a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:09.094345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0464bbce-8d68-49b0-b818-9d3edf7ea82a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:09.111062 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0464bbce-8d68-49b0-b818-9d3edf7ea82a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.112507 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0464bbce-8d68-49b0-b818-9d3edf7ea82a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:09.114306 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0464bbce-8d68-49b0-b818-9d3edf7ea82a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.115349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0464bbce-8d68-49b0-b818-9d3edf7ea82a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:09.420250 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-2d91442f-37ac-4d81-a877-ca789e08339b tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'services' on Instance uuid b7db7635-8f84-4337-b9ba-d84b8c36e787 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:41:09.451162 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2d91442f-37ac-4d81-a877-ca789e08339b tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 2050 microversion: 2.25 time: 0.487179 Jun 16 14:41:09.452309 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 406/777] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:08 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 2050 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:09.459171 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8e37379e-5f3a-4a79-b4ae-c8f79090725f tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:09.460912 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:41:09.460912 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:41:09.494618 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0464bbce-8d68-49b0-b818-9d3edf7ea82a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:09.496058 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8e37379e-5f3a-4a79-b4ae-c8f79090725f tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1808692178" status: 202 len: 0 microversion: 2.1 time: 0.040669 Jun 16 14:41:09.497590 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 407/778] 10.222.0.57 () {58 vars in 1160 bytes} [Thu Jun 16 14:41:09 2022] DELETE /compute/v2.1/flavors/1808692178 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:41:09.509428 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-944e815e-b3a1-4d63-b36a-3aa60dbfee01 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] Calling method '.version_select at 0x7fdf0caf6c10>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:09.509885 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0464bbce-8d68-49b0-b818-9d3edf7ea82a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1477 microversion: 2.1 time: 0.437061 Jun 16 14:41:09.511907 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 372/779] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:09 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1477 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:09.522885 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-87ad0c3c-cd58-409a-b9e9-43a49ccd07b9 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:09.527447 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:41:09.527447 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:41:09.531257 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-87ad0c3c-cd58-409a-b9e9-43a49ccd07b9 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.532231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-87ad0c3c-cd58-409a-b9e9-43a49ccd07b9 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:09.533585 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-87ad0c3c-cd58-409a-b9e9-43a49ccd07b9 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.534712 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-87ad0c3c-cd58-409a-b9e9-43a49ccd07b9 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:09.576700 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-87ad0c3c-cd58-409a-b9e9-43a49ccd07b9 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.062325 Jun 16 14:41:09.578040 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 373/780] 10.222.0.57 () {60 vars in 1216 bytes} [Thu Jun 16 14:41:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:41:09.586771 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5f37ca27-16e3-457f-b6f0-1dc11f6af650 tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:09.605887 n-d-836830-4 devstack@n-api.service[125863]: DEBUG neutronclient.v2_0.client [None req-944e815e-b3a1-4d63-b36a-3aa60dbfee01 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 21df1717-bb99-45c0-b0c2-e12422f5cdd7 could not be found", "detail": ""}} {{(pid=125863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:41:09.608085 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-944e815e-b3a1-4d63-b36a-3aa60dbfee01 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] HTTP exception thrown: Floating IP not found for ID 21df1717-bb99-45c0-b0c2-e12422f5cdd7 Jun 16 14:41:09.617068 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5f37ca27-16e3-457f-b6f0-1dc11f6af650 tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.037116 Jun 16 14:41:09.618044 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 374/781] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:41:09 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:09.627279 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d55ea946-29b8-4890-90b3-52945e412af1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:09.628062 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d55ea946-29b8-4890-90b3-52945e412af1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:09.639577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d55ea946-29b8-4890-90b3-52945e412af1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.640813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d55ea946-29b8-4890-90b3-52945e412af1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:09.642433 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d55ea946-29b8-4890-90b3-52945e412af1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.643117 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d55ea946-29b8-4890-90b3-52945e412af1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-944e815e-b3a1-4d63-b36a-3aa60dbfee01 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] Request method failure captured: Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/os-floating-ips/21df1717-bb99-45c0-b0c2-e12422f5cdd7 HTTP/1.1 Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0DzFGhV8OOhHJe7CyfpF4kd0rh_YzPZgK8MK-pLACyuXQRxhvBB9PwO9J-c631oFvl0VvvPpxK_pS0Rnszws2NxGqGHH68zqFzedKDiF_aYrPfGPqWfa2-okN8MxETvYabkB33GLl-YruwlssrVlVdvoB0Vv6P-OlnklkhsI5KkMLw Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 26bd0a8bc1644e40afd89a7824f54c87 Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-FloatingIPsTestJSON-935866090 Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:41:09.656235 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:41:09.659205 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_26bd0a8bc1644e40afd89a7824f54c87", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26bd0a8bc1644e40afd89a7824f54c87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26bd0a8bc1644e40afd89a7824f54c87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/26bd0a8bc1644e40afd89a7824f54c87"}]}] Jun 16 14:41:09.659205 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-FloatingIPsTestJSON-935866090 Jun 16 14:41:09.659205 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 26bd0a8bc1644e40afd89a7824f54c87 Jun 16 14:41:09.659205 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-FloatingIPsTestJSON-935866090 Jun 16 14:41:09.659205 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-FloatingIPsTestJSON-935866090-project Jun 16 14:41:09.659205 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:09.659205 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:09.659205 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: b1c8179472f543a58c782c90c0b929ac Jun 16 14:41:09.659205 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-FloatingIPsTestJSON-935866090-project Jun 16 14:41:09.659205 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:41:09.659205 n-d-836830-4 devstack@n-api.service[125863]: exception: Floating IP not found for ID 21df1717-bb99-45c0-b0c2-e12422f5cdd7 Jun 16 14:41:09.659205 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '21df1717-bb99-45c0-b0c2-e12422f5cdd7'} Jun 16 14:41:09.659205 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:41:09.666579 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 21df1717-bb99-45c0-b0c2-e12422f5cdd7 could not be found Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ec56275-fc0f-4527-bdae-6d8435b0f3e9'] Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 21df1717-bb99-45c0-b0c2-e12422f5cdd7. Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:09.669163 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 21df1717-bb99-45c0-b0c2-e12422f5cdd7 Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:09.670765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:09.672321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 21df1717-bb99-45c0-b0c2-e12422f5cdd7 Jun 16 14:41:09.672321 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.672321 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-944e815e-b3a1-4d63-b36a-3aa60dbfee01 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] Returning 404 to user: Floating IP not found for ID 21df1717-bb99-45c0-b0c2-e12422f5cdd7 {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:09.672321 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-944e815e-b3a1-4d63-b36a-3aa60dbfee01 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ips/21df1717-bb99-45c0-b0c2-e12422f5cdd7" status: 404 len: 111 microversion: 2.1 time: 0.158413 Jun 16 14:41:09.672321 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 408/782] 10.222.0.57 () {58 vars in 1259 bytes} [Thu Jun 16 14:41:09 2022] GET /compute/v2.1/os-floating-ips/21df1717-bb99-45c0-b0c2-e12422f5cdd7 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:41:09.672321 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-75d2ace2-e6dd-4c04-97c6-4ae98b6001c8 tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:09.690461 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-75d2ace2-e6dd-4c04-97c6-4ae98b6001c8 tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1595615383" status: 202 len: 0 microversion: 2.1 time: 0.027595 Jun 16 14:41:09.691812 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 409/783] 10.222.0.57 () {58 vars in 1160 bytes} [Thu Jun 16 14:41:09 2022] DELETE /compute/v2.1/flavors/1595615383 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:41:09.697097 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-34af8f74-a136-4e7d-9b10-9d9c2e89e568 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] Calling method '.version_select at 0x7fdf0c32ff70>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:09.740961 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d55ea946-29b8-4890-90b3-52945e412af1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787/action" status: 202 len: 0 microversion: 2.25 time: 0.121064 Jun 16 14:41:09.742487 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 375/784] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jun 16 14:41:09 2022] POST /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:09.748565 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3284174b-ca3a-4632-b542-87679fde0391 tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:09.771750 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3284174b-ca3a-4632-b542-87679fde0391 tempest-ServersWithSpecificFlavorTestJSON-1433147619 tempest-ServersWithSpecificFlavorTestJSON-1433147619-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028347 Jun 16 14:41:09.772663 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 376/785] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:41:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:09.779150 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-166a3c40-3b3a-4983-bb89-a8dfd0ddfb7a tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:09.783078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-166a3c40-3b3a-4983-bb89-a8dfd0ddfb7a tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:09.784974 n-d-836830-4 devstack@n-api.service[125863]: DEBUG neutronclient.v2_0.client [None req-34af8f74-a136-4e7d-9b10-9d9c2e89e568 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 21df1717-bb99-45c0-b0c2-e12422f5cdd7 could not be found", "detail": ""}} {{(pid=125863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:41:09.785675 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-34af8f74-a136-4e7d-9b10-9d9c2e89e568 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] HTTP exception thrown: Floating IP not found for ID 21df1717-bb99-45c0-b0c2-e12422f5cdd7 Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-34af8f74-a136-4e7d-9b10-9d9c2e89e568 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] Request method failure captured: Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/os-floating-ips/21df1717-bb99-45c0-b0c2-e12422f5cdd7 HTTP/1.1 Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0DzFGhV8OOhHJe7CyfpF4kd0rh_YzPZgK8MK-pLACyuXQRxhvBB9PwO9J-c631oFvl0VvvPpxK_pS0Rnszws2NxGqGHH68zqFzedKDiF_aYrPfGPqWfa2-okN8MxETvYabkB33GLl-YruwlssrVlVdvoB0Vv6P-OlnklkhsI5KkMLw Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 26bd0a8bc1644e40afd89a7824f54c87 Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-FloatingIPsTestJSON-935866090 Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:41:09.787799 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:41:09.790714 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_26bd0a8bc1644e40afd89a7824f54c87", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26bd0a8bc1644e40afd89a7824f54c87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/26bd0a8bc1644e40afd89a7824f54c87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/26bd0a8bc1644e40afd89a7824f54c87"}]}] Jun 16 14:41:09.790714 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-FloatingIPsTestJSON-935866090 Jun 16 14:41:09.790714 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 26bd0a8bc1644e40afd89a7824f54c87 Jun 16 14:41:09.790714 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-FloatingIPsTestJSON-935866090 Jun 16 14:41:09.790714 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-FloatingIPsTestJSON-935866090-project Jun 16 14:41:09.790714 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:09.790714 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:09.790714 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: b1c8179472f543a58c782c90c0b929ac Jun 16 14:41:09.790714 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-FloatingIPsTestJSON-935866090-project Jun 16 14:41:09.790714 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:41:09.790714 n-d-836830-4 devstack@n-api.service[125863]: exception: Floating IP not found for ID 21df1717-bb99-45c0-b0c2-e12422f5cdd7 Jun 16 14:41:09.790714 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '21df1717-bb99-45c0-b0c2-e12422f5cdd7'} Jun 16 14:41:09.790714 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:41:09.792490 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 21df1717-bb99-45c0-b0c2-e12422f5cdd7 could not be found Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0d691c9-ee78-43f5-b900-41a73ad0e47b'] Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 21df1717-bb99-45c0-b0c2-e12422f5cdd7. Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:09.796788 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 21df1717-bb99-45c0-b0c2-e12422f5cdd7 Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:09.799429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:09.801902 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 21df1717-bb99-45c0-b0c2-e12422f5cdd7 Jun 16 14:41:09.801902 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.801902 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-34af8f74-a136-4e7d-9b10-9d9c2e89e568 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] Returning 404 to user: Floating IP not found for ID 21df1717-bb99-45c0-b0c2-e12422f5cdd7 {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:09.801902 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-34af8f74-a136-4e7d-9b10-9d9c2e89e568 tempest-FloatingIPsTestJSON-935866090 tempest-FloatingIPsTestJSON-935866090-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/21df1717-bb99-45c0-b0c2-e12422f5cdd7" status: 404 len: 111 microversion: 2.1 time: 0.096601 Jun 16 14:41:09.801902 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 410/786] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jun 16 14:41:09 2022] DELETE /compute/v2.1/os-floating-ips/21df1717-bb99-45c0-b0c2-e12422f5cdd7 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:41:09.817488 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-166a3c40-3b3a-4983-bb89-a8dfd0ddfb7a tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.818685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-166a3c40-3b3a-4983-bb89-a8dfd0ddfb7a tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:09.826516 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-166a3c40-3b3a-4983-bb89-a8dfd0ddfb7a tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.827689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-166a3c40-3b3a-4983-bb89-a8dfd0ddfb7a tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:09.828221 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-70211733-e7f2-4441-a97d-8c54475757d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:09.829438 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-70211733-e7f2-4441-a97d-8c54475757d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:09.845717 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-70211733-e7f2-4441-a97d-8c54475757d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.846951 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-70211733-e7f2-4441-a97d-8c54475757d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:09.848755 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-70211733-e7f2-4441-a97d-8c54475757d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.849860 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-70211733-e7f2-4441-a97d-8c54475757d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:09.872222 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-70211733-e7f2-4441-a97d-8c54475757d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] HTTP exception thrown: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-70211733-e7f2-4441-a97d-8c54475757d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Request method failure captured: Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e HTTP/1.1 Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0AbtbPfFaKC1wG8aNicPWViDwI-DZ8F8a7xip-jyE3wH1NVYSvYdrPOl2pZunsWUNvwGKl41LWRvGa2xr9pNtuXFn-Ki0Gy7jnwxVUs1FnvKg3A6JDvoD6Eh1onMJMXG1C7o95EJSpAXmkoyqQVBkfhEuvqNSTPC72GuWsJqFVxRI0 Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b3bb36eedcf640af98a6bc7f41473758 Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:41:09.874302 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:41:09.877270 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b3bb36eedcf640af98a6bc7f41473758", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3bb36eedcf640af98a6bc7f41473758"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3bb36eedcf640af98a6bc7f41473758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b3bb36eedcf640af98a6bc7f41473758"}]}] Jun 16 14:41:09.877270 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:09.877270 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b3bb36eedcf640af98a6bc7f41473758 Jun 16 14:41:09.877270 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:09.877270 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1075136416-project Jun 16 14:41:09.877270 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:09.877270 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:09.877270 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 2b7e98a72497450c98f5f05bf74213a0 Jun 16 14:41:09.877270 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416-project Jun 16 14:41:09.877270 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:41:09.877270 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. Jun 16 14:41:09.877270 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'bc39a7a1-2d9e-4eec-b07d-9f85e148665e'} Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:09.883415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. Jun 16 14:41:09.885912 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.888750 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-70211733-e7f2-4441-a97d-8c54475757d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Returning 404 to user: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:09.888750 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-70211733-e7f2-4441-a97d-8c54475757d7 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "DELETE /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 404 len: 111 microversion: 2.1 time: 0.058586 Jun 16 14:41:09.888750 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 411/787] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:41:09 2022] DELETE /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:41:09.892366 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-694177d7-3d4b-4b48-84ae-6d26e37f35b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:09.893900 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-694177d7-3d4b-4b48-84ae-6d26e37f35b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: bc39a7a1-2d9e-4eec-b07d-9f85e148665e] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:09.905553 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-694177d7-3d4b-4b48-84ae-6d26e37f35b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.906325 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-694177d7-3d4b-4b48-84ae-6d26e37f35b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:09.907873 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-694177d7-3d4b-4b48-84ae-6d26e37f35b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.908686 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-694177d7-3d4b-4b48-84ae-6d26e37f35b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:09.940118 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-694177d7-3d4b-4b48-84ae-6d26e37f35b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] HTTP exception thrown: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-694177d7-3d4b-4b48-84ae-6d26e37f35b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Request method failure captured: Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e HTTP/1.1 Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0AbtbPfFaKC1wG8aNicPWViDwI-DZ8F8a7xip-jyE3wH1NVYSvYdrPOl2pZunsWUNvwGKl41LWRvGa2xr9pNtuXFn-Ki0Gy7jnwxVUs1FnvKg3A6JDvoD6Eh1onMJMXG1C7o95EJSpAXmkoyqQVBkfhEuvqNSTPC72GuWsJqFVxRI0 Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b3bb36eedcf640af98a6bc7f41473758 Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:41:09.943284 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:41:09.946471 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b3bb36eedcf640af98a6bc7f41473758", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3bb36eedcf640af98a6bc7f41473758"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3bb36eedcf640af98a6bc7f41473758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b3bb36eedcf640af98a6bc7f41473758"}]}] Jun 16 14:41:09.946471 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:09.946471 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b3bb36eedcf640af98a6bc7f41473758 Jun 16 14:41:09.946471 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:09.946471 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1075136416-project Jun 16 14:41:09.946471 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:09.946471 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:09.946471 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 2b7e98a72497450c98f5f05bf74213a0 Jun 16 14:41:09.946471 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416-project Jun 16 14:41:09.946471 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:41:09.946471 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. Jun 16 14:41:09.946471 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'bc39a7a1-2d9e-4eec-b07d-9f85e148665e'} Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:09.948139 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. Jun 16 14:41:09.957512 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:09.959908 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-694177d7-3d4b-4b48-84ae-6d26e37f35b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Returning 404 to user: Instance bc39a7a1-2d9e-4eec-b07d-9f85e148665e could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:09.959908 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-694177d7-3d4b-4b48-84ae-6d26e37f35b5 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e" status: 404 len: 111 microversion: 2.1 time: 0.061707 Jun 16 14:41:09.959908 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 412/788] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:09 2022] GET /compute/v2.1/servers/bc39a7a1-2d9e-4eec-b07d-9f85e148665e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:41:09.961247 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ed7615cf-1e8f-4a7d-b29a-681e67e94e44 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:09.962422 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ed7615cf-1e8f-4a7d-b29a-681e67e94e44 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:09.974656 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ed7615cf-1e8f-4a7d-b29a-681e67e94e44 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.975855 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ed7615cf-1e8f-4a7d-b29a-681e67e94e44 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:09.977273 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ed7615cf-1e8f-4a7d-b29a-681e67e94e44 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:09.978090 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ed7615cf-1e8f-4a7d-b29a-681e67e94e44 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:10.008421 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-ed7615cf-1e8f-4a7d-b29a-681e67e94e44 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] HTTP exception thrown: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ed7615cf-1e8f-4a7d-b29a-681e67e94e44 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Request method failure captured: Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 HTTP/1.1 Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0AbtbPfFaKC1wG8aNicPWViDwI-DZ8F8a7xip-jyE3wH1NVYSvYdrPOl2pZunsWUNvwGKl41LWRvGa2xr9pNtuXFn-Ki0Gy7jnwxVUs1FnvKg3A6JDvoD6Eh1onMJMXG1C7o95EJSpAXmkoyqQVBkfhEuvqNSTPC72GuWsJqFVxRI0 Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b3bb36eedcf640af98a6bc7f41473758 Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:41:10.012772 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:41:10.015498 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b3bb36eedcf640af98a6bc7f41473758", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3bb36eedcf640af98a6bc7f41473758"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3bb36eedcf640af98a6bc7f41473758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b3bb36eedcf640af98a6bc7f41473758"}]}] Jun 16 14:41:10.015498 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:10.015498 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b3bb36eedcf640af98a6bc7f41473758 Jun 16 14:41:10.015498 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:10.015498 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1075136416-project Jun 16 14:41:10.015498 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:10.015498 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:10.015498 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 2b7e98a72497450c98f5f05bf74213a0 Jun 16 14:41:10.015498 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416-project Jun 16 14:41:10.015498 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:41:10.015498 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:10.015498 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '2b36c679-5452-4c35-ba4a-a19aa69e3fd8'} Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:10.016767 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:10.021469 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:10.026050 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ed7615cf-1e8f-4a7d-b29a-681e67e94e44 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Returning 404 to user: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:10.026050 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ed7615cf-1e8f-4a7d-b29a-681e67e94e44 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 404 len: 111 microversion: 2.1 time: 0.065943 Jun 16 14:41:10.030627 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 413/789] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:41:09 2022] DELETE /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:41:10.044693 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-db0ca8fb-3a33-429c-956b-33d7bd462cc8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:10.046160 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-db0ca8fb-3a33-429c-956b-33d7bd462cc8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] [instance: 2b36c679-5452-4c35-ba4a-a19aa69e3fd8] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:10.060257 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-db0ca8fb-3a33-429c-956b-33d7bd462cc8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:10.061380 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-db0ca8fb-3a33-429c-956b-33d7bd462cc8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:10.062959 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-db0ca8fb-3a33-429c-956b-33d7bd462cc8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:10.063928 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-db0ca8fb-3a33-429c-956b-33d7bd462cc8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:10.096112 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-db0ca8fb-3a33-429c-956b-33d7bd462cc8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] HTTP exception thrown: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-db0ca8fb-3a33-429c-956b-33d7bd462cc8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Request method failure captured: Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 HTTP/1.1 Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0AbtbPfFaKC1wG8aNicPWViDwI-DZ8F8a7xip-jyE3wH1NVYSvYdrPOl2pZunsWUNvwGKl41LWRvGa2xr9pNtuXFn-Ki0Gy7jnwxVUs1FnvKg3A6JDvoD6Eh1onMJMXG1C7o95EJSpAXmkoyqQVBkfhEuvqNSTPC72GuWsJqFVxRI0 Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b3bb36eedcf640af98a6bc7f41473758 Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:41:10.099477 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:41:10.101932 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b3bb36eedcf640af98a6bc7f41473758", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3bb36eedcf640af98a6bc7f41473758"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b3bb36eedcf640af98a6bc7f41473758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b3bb36eedcf640af98a6bc7f41473758"}]}] Jun 16 14:41:10.101932 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:10.101932 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b3bb36eedcf640af98a6bc7f41473758 Jun 16 14:41:10.101932 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416 Jun 16 14:41:10.101932 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1075136416-project Jun 16 14:41:10.101932 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:10.101932 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:10.101932 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 2b7e98a72497450c98f5f05bf74213a0 Jun 16 14:41:10.101932 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1075136416-project Jun 16 14:41:10.101932 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:41:10.101932 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:10.101932 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '2b36c679-5452-4c35-ba4a-a19aa69e3fd8'} Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:10.102814 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. Jun 16 14:41:10.104232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:10.105913 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-db0ca8fb-3a33-429c-956b-33d7bd462cc8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] Returning 404 to user: Instance 2b36c679-5452-4c35-ba4a-a19aa69e3fd8 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:10.105913 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-db0ca8fb-3a33-429c-956b-33d7bd462cc8 tempest-ServersWithSpecificFlavorTestJSON-1075136416 tempest-ServersWithSpecificFlavorTestJSON-1075136416-project] 10.222.0.57 "GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8" status: 404 len: 111 microversion: 2.1 time: 0.073265 Jun 16 14:41:10.105913 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 414/790] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:10 2022] GET /compute/v2.1/servers/2b36c679-5452-4c35-ba4a-a19aa69e3fd8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:41:10.273844 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-166a3c40-3b3a-4983-bb89-a8dfd0ddfb7a tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'services' on Instance uuid b7db7635-8f84-4337-b9ba-d84b8c36e787 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:41:10.305168 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-166a3c40-3b3a-4983-bb89-a8dfd0ddfb7a tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 2055 microversion: 2.25 time: 0.530741 Jun 16 14:41:10.306231 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 377/791] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:09 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 2055 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:10.556691 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-801326ec-98c4-45a4-92f6-8d547aa016bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:10.558547 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-801326ec-98c4-45a4-92f6-8d547aa016bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:10.582976 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=6 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:10.611818 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-801326ec-98c4-45a4-92f6-8d547aa016bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:10.614876 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-801326ec-98c4-45a4-92f6-8d547aa016bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:10.616436 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-801326ec-98c4-45a4-92f6-8d547aa016bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:10.617761 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-801326ec-98c4-45a4-92f6-8d547aa016bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:11.333455 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-41e26cd3-33a0-4361-bbdb-942bbb41dc91 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:11.335020 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-41e26cd3-33a0-4361-bbdb-942bbb41dc91 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:11.345730 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-41e26cd3-33a0-4361-bbdb-942bbb41dc91 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:11.347362 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-41e26cd3-33a0-4361-bbdb-942bbb41dc91 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:11.349149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-41e26cd3-33a0-4361-bbdb-942bbb41dc91 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:11.350003 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-41e26cd3-33a0-4361-bbdb-942bbb41dc91 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:11.388954 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-801326ec-98c4-45a4-92f6-8d547aa016bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:11.410806 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-801326ec-98c4-45a4-92f6-8d547aa016bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1477 microversion: 2.1 time: 0.873472 Jun 16 14:41:11.413194 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 415/792] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:10 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1477 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:11.720828 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-41e26cd3-33a0-4361-bbdb-942bbb41dc91 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'services' on Instance uuid b7db7635-8f84-4337-b9ba-d84b8c36e787 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:41:11.755898 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-41e26cd3-33a0-4361-bbdb-942bbb41dc91 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 2035 microversion: 2.25 time: 0.429739 Jun 16 14:41:11.757217 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 378/793] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:11 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 2035 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:41:11.800723 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-16973957-1585-48a4-980b-7cdf99f93702 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-4", "block_migration": "auto"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:11.806804 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-16973957-1585-48a4-980b-7cdf99f93702 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:11.834189 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-16973957-1585-48a4-980b-7cdf99f93702 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:11.835158 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-16973957-1585-48a4-980b-7cdf99f93702 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:11.836826 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-16973957-1585-48a4-980b-7cdf99f93702 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:11.837732 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-16973957-1585-48a4-980b-7cdf99f93702 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:11.910808 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-16973957-1585-48a4-980b-7cdf99f93702 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'flavor' on Instance uuid b7db7635-8f84-4337-b9ba-d84b8c36e787 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:41:11.939407 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-16973957-1585-48a4-980b-7cdf99f93702 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Going to try to live migrate instance to n-h1-836830-4 {{(pid=125863) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 14:41:12.431165 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6eda39b8-04eb-442e-8f89-43ea04941fdf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:12.432685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6eda39b8-04eb-442e-8f89-43ea04941fdf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:12.450752 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6eda39b8-04eb-442e-8f89-43ea04941fdf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:12.453821 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6eda39b8-04eb-442e-8f89-43ea04941fdf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:12.454850 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6eda39b8-04eb-442e-8f89-43ea04941fdf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:12.455324 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6eda39b8-04eb-442e-8f89-43ea04941fdf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:13.206027 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6eda39b8-04eb-442e-8f89-43ea04941fdf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:13.255661 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6eda39b8-04eb-442e-8f89-43ea04941fdf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1477 microversion: 2.1 time: 0.829549 Jun 16 14:41:13.262343 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 379/794] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:12 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1477 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:41:14.291611 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-11ef0860-49ed-450f-ad73-afedbd037d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:14.293160 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-11ef0860-49ed-450f-ad73-afedbd037d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:14.315799 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11ef0860-49ed-450f-ad73-afedbd037d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:14.319196 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11ef0860-49ed-450f-ad73-afedbd037d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:14.322683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11ef0860-49ed-450f-ad73-afedbd037d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:14.332892 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11ef0860-49ed-450f-ad73-afedbd037d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:15.283370 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-11ef0860-49ed-450f-ad73-afedbd037d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:15.314838 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:15.322335 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-11ef0860-49ed-450f-ad73-afedbd037d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1477 microversion: 2.1 time: 1.034658 Jun 16 14:41:15.323358 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 380/795] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:14 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1477 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:41:15.900555 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-84025227", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:16.052234 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] validate_networks() for None {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:41:16.531607 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-16973957-1585-48a4-980b-7cdf99f93702 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787/action" status: 202 len: 0 microversion: 2.25 time: 4.744573 Jun 16 14:41:16.537178 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 416/796] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jun 16 14:41:11 2022] POST /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787/action => generated 0 bytes in 4751 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:16.544081 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2ccf8bc5-b004-4343-be8c-8f1e96e8f3e4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:16.545223 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2ccf8bc5-b004-4343-be8c-8f1e96e8f3e4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:16.554146 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ccf8bc5-b004-4343-be8c-8f1e96e8f3e4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:16.555532 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ccf8bc5-b004-4343-be8c-8f1e96e8f3e4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:16.557563 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ccf8bc5-b004-4343-be8c-8f1e96e8f3e4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:16.559283 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ccf8bc5-b004-4343-be8c-8f1e96e8f3e4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:17.123741 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:41:17.125357 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:41:17.126901 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:41:17.128174 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:41:17.129212 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:41:17.134618 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:17.154777 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:17.155987 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:17.158884 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:17.160343 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:17.212255 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Getting quotas for project b50858433c774049b7c3fe4a4f98e948. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:41:17.225952 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Getting quotas for user 23594325f9174f3a80dd744eaaaba379 and project b50858433c774049b7c3fe4a4f98e948. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:41:17.254694 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:41:17.259686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:41:17.387158 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-dfc6987f-9c39-4eb3-a067-739d5a1adf4d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.732934 Jun 16 14:41:17.396346 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 381/797] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:41:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 14:41:17.412940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-00df72fd-02a1-40ed-bc56-1ed78a2023a2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:17.414524 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-00df72fd-02a1-40ed-bc56-1ed78a2023a2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:17.430116 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00df72fd-02a1-40ed-bc56-1ed78a2023a2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:17.430999 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00df72fd-02a1-40ed-bc56-1ed78a2023a2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:17.432615 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00df72fd-02a1-40ed-bc56-1ed78a2023a2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:17.434044 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00df72fd-02a1-40ed-bc56-1ed78a2023a2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:17.532194 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2ccf8bc5-b004-4343-be8c-8f1e96e8f3e4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:17.557848 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2ccf8bc5-b004-4343-be8c-8f1e96e8f3e4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1477 microversion: 2.1 time: 1.018756 Jun 16 14:41:17.565712 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 417/798] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:16 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1477 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:17.603970 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-917451349", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:17.802805 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:41:17.904234 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-00df72fd-02a1-40ed-bc56-1ed78a2023a2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:17.926565 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-00df72fd-02a1-40ed-bc56-1ed78a2023a2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:17.935827 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-00df72fd-02a1-40ed-bc56-1ed78a2023a2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:17.941226 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-00df72fd-02a1-40ed-bc56-1ed78a2023a2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1567 microversion: 2.25 time: 0.534493 Jun 16 14:41:17.943061 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 382/799] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:17 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1567 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:18.099883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ffd7f645-8a4c-4e32-a23f-c6d2b79bc49f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:18.102237 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ffd7f645-8a4c-4e32-a23f-c6d2b79bc49f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:18.132556 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffd7f645-8a4c-4e32-a23f-c6d2b79bc49f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:18.133883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffd7f645-8a4c-4e32-a23f-c6d2b79bc49f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:18.134823 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffd7f645-8a4c-4e32-a23f-c6d2b79bc49f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:18.135731 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffd7f645-8a4c-4e32-a23f-c6d2b79bc49f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:18.192352 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ffd7f645-8a4c-4e32-a23f-c6d2b79bc49f tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111737 Jun 16 14:41:18.193993 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 383/800] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:41:18 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:41:18.240409 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f9fc97fd-7b30-4f40-a755-ca474be7c8b4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:18.242356 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f9fc97fd-7b30-4f40-a755-ca474be7c8b4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:18.259632 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f9fc97fd-7b30-4f40-a755-ca474be7c8b4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:18.264348 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f9fc97fd-7b30-4f40-a755-ca474be7c8b4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:18.267774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f9fc97fd-7b30-4f40-a755-ca474be7c8b4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:18.268153 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f9fc97fd-7b30-4f40-a755-ca474be7c8b4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:18.707620 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-f9fc97fd-7b30-4f40-a755-ca474be7c8b4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lazy-loading 'services' on Instance uuid e7771166-9bbf-41d0-b3ca-b4515a46a67c {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:41:18.889703 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f9fc97fd-7b30-4f40-a755-ca474be7c8b4 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c/os-volume_attachments/e368e19c-e899-4393-af70-1a30817c24d2" status: 202 len: 0 microversion: 2.1 time: 0.676731 Jun 16 14:41:18.891293 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 384/801] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jun 16 14:41:18 2022] DELETE /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c/os-volume_attachments/e368e19c-e899-4393-af70-1a30817c24d2 => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:41:18.924749 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-324a6cd5-98db-40f1-8f5c-6982ae231946 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:18.927083 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-324a6cd5-98db-40f1-8f5c-6982ae231946 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:18.953085 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-324a6cd5-98db-40f1-8f5c-6982ae231946 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:18.956090 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-324a6cd5-98db-40f1-8f5c-6982ae231946 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:18.958183 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-324a6cd5-98db-40f1-8f5c-6982ae231946 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:18.959649 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-324a6cd5-98db-40f1-8f5c-6982ae231946 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:19.216718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-324a6cd5-98db-40f1-8f5c-6982ae231946 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:19.225120 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-324a6cd5-98db-40f1-8f5c-6982ae231946 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1476 microversion: 2.1 time: 0.332196 Jun 16 14:41:19.225723 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 385/802] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:18 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1476 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:19.231524 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0b167418-c99b-4c87-b4a9-e1453450ba9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:19.232505 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0b167418-c99b-4c87-b4a9-e1453450ba9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:19.241590 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b167418-c99b-4c87-b4a9-e1453450ba9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:19.242342 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b167418-c99b-4c87-b4a9-e1453450ba9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:19.243449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b167418-c99b-4c87-b4a9-e1453450ba9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:19.244397 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b167418-c99b-4c87-b4a9-e1453450ba9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:19.428125 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0b167418-c99b-4c87-b4a9-e1453450ba9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:19.439133 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0b167418-c99b-4c87-b4a9-e1453450ba9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:19.441090 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0b167418-c99b-4c87-b4a9-e1453450ba9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:19.442314 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0b167418-c99b-4c87-b4a9-e1453450ba9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1567 microversion: 2.25 time: 0.215396 Jun 16 14:41:19.454417 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 386/803] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:19 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:19.554491 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:41:19.555090 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:41:19.555428 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:41:19.557523 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:41:19.557974 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:41:19.580278 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:19.580748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:19.581598 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:19.582049 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:19.608829 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:19.634906 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Getting quotas for project b50858433c774049b7c3fe4a4f98e948. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:41:19.672397 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Getting quotas for user 23594325f9174f3a80dd744eaaaba379 and project b50858433c774049b7c3fe4a4f98e948. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:41:19.791206 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:41:19.813154 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:41:20.062719 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ffe3b106-c92d-4704-9a32-397240de9492 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.467284 Jun 16 14:41:20.071187 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 418/804] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:41:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 14:41:20.080303 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ded0c5b8-0d0a-4530-b790-fd7da26e9be8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:20.081292 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ded0c5b8-0d0a-4530-b790-fd7da26e9be8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:20.258531 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8498554e-6d80-42c5-ae3f-6e63365e17e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:20.270999 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8498554e-6d80-42c5-ae3f-6e63365e17e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:20.282219 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8498554e-6d80-42c5-ae3f-6e63365e17e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:20.282219 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8498554e-6d80-42c5-ae3f-6e63365e17e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:20.282219 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8498554e-6d80-42c5-ae3f-6e63365e17e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:20.282702 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ded0c5b8-0d0a-4530-b790-fd7da26e9be8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:20.283413 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8498554e-6d80-42c5-ae3f-6e63365e17e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:20.292495 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ded0c5b8-0d0a-4530-b790-fd7da26e9be8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1213 microversion: 2.1 time: 0.221071 Jun 16 14:41:20.294317 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 387/805] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:20 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1213 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:20.476370 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-12a2ab59-6eed-46de-a618-6796e0b4e4ef tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:20.477378 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-12a2ab59-6eed-46de-a618-6796e0b4e4ef tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:20.488818 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-12a2ab59-6eed-46de-a618-6796e0b4e4ef tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:20.491049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-12a2ab59-6eed-46de-a618-6796e0b4e4ef tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:20.495242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-12a2ab59-6eed-46de-a618-6796e0b4e4ef tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:20.498828 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-12a2ab59-6eed-46de-a618-6796e0b4e4ef tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:21.130107 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8498554e-6d80-42c5-ae3f-6e63365e17e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:21.156776 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8498554e-6d80-42c5-ae3f-6e63365e17e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1476 microversion: 2.1 time: 0.906776 Jun 16 14:41:21.166914 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 419/806] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:20 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1476 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:21.378053 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-12a2ab59-6eed-46de-a618-6796e0b4e4ef tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:21.447311 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-12a2ab59-6eed-46de-a618-6796e0b4e4ef tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:21.466400 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-12a2ab59-6eed-46de-a618-6796e0b4e4ef tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:21.469144 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-12a2ab59-6eed-46de-a618-6796e0b4e4ef tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1567 microversion: 2.25 time: 0.998148 Jun 16 14:41:21.482537 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 388/807] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:20 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1567 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:41:21.505394 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7f87bf93-9fd0-41ba-90d4-ee0dbd1c7ed5 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:21.513738 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7f87bf93-9fd0-41ba-90d4-ee0dbd1c7ed5 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:21.551254 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f87bf93-9fd0-41ba-90d4-ee0dbd1c7ed5 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:21.560871 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f87bf93-9fd0-41ba-90d4-ee0dbd1c7ed5 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:21.564412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f87bf93-9fd0-41ba-90d4-ee0dbd1c7ed5 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:21.570070 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f87bf93-9fd0-41ba-90d4-ee0dbd1c7ed5 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:21.727957 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7246fb99-145e-42b3-91dc-f71853236c39 tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Calling method '.version_select at 0x7fdf0c5c59d0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:21.770102 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-7246fb99-145e-42b3-91dc-f71853236c39 tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] HTTP exception thrown: Image not found. Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7246fb99-145e-42b3-91dc-f71853236c39 tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Request method failure captured: Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/images/6a3ea9df-3066-425a-a1c3-6770bf674685/metadata/os_distro HTTP/1.1 Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0EQHcod5R5xo153-7GoZAMb3o6b5kh3yOkO-6viT9xwLrHSz1V-DIXOov_6dUIYnYH3QUbV5DGzDMihnNrKxpyyvuo6v37yPuz1aPXXA3wY8MpXbr7dpxgaCq5uA5wH7Lma89CVHRbczmc77jqlrosynC6L4dwmM27wsvpY6OH17h8 Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 4eab7eb7470949da9b9be72678569e6d Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:41:21.803859 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:41:21.806810 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4eab7eb7470949da9b9be72678569e6d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4eab7eb7470949da9b9be72678569e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4eab7eb7470949da9b9be72678569e6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4eab7eb7470949da9b9be72678569e6d"}]}] Jun 16 14:41:21.806810 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:21.806810 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 4eab7eb7470949da9b9be72678569e6d Jun 16 14:41:21.806810 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:21.806810 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesMetadataNegativeTestJSON-2118577394-project Jun 16 14:41:21.806810 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:21.806810 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:21.806810 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: bbbbe6bb1a804130a0a94a8a425e0da7 Jun 16 14:41:21.806810 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394-project Jun 16 14:41:21.806810 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:41:21.806810 n-d-836830-4 devstack@n-api.service[125863]: exception: Image not found. Jun 16 14:41:21.806810 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'image_id': '6a3ea9df-3066-425a-a1c3-6770bf674685', 'id': 'os_distro'} Jun 16 14:41:21.806810 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:41:21.811480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6a3ea9df-3066-425a-a1c3-6770bf674685 Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:41:21.813979 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6a3ea9df-3066-425a-a1c3-6770bf674685 could not be found. Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:41:21.820824 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:41:21.826777 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:21.834151 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7f87bf93-9fd0-41ba-90d4-ee0dbd1c7ed5 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:21.834151 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7f87bf93-9fd0-41ba-90d4-ee0dbd1c7ed5 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1209 microversion: 2.1 time: 0.342137 Jun 16 14:41:21.834151 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 389/808] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:21 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1209 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:21.834628 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-881bc3fc-8828-4498-91ca-b45b349f8e45 req-ad52dd26-afff-44af-8d84-10588e373e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e428ca7a-f7f8-4dff-a272-52fb03083fd2", "name": "network-vif-unplugged", "status": "completed", "tag": "e583603f-657e-4f58-aa10-f2482dfad9de"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:21.834829 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7246fb99-145e-42b3-91dc-f71853236c39 tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Returning 404 to user: Image not found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:21.854262 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7246fb99-145e-42b3-91dc-f71853236c39 tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] 10.222.0.57 "DELETE /compute/v2.1/images/6a3ea9df-3066-425a-a1c3-6770bf674685/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.679694 Jun 16 14:41:21.856977 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 420/809] 10.222.0.57 () {58 vars in 1292 bytes} [Thu Jun 16 14:41:21 2022] DELETE /compute/v2.1/images/6a3ea9df-3066-425a-a1c3-6770bf674685/metadata/os_distro => generated 62 bytes in 689 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:41:21.886194 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-881bc3fc-8828-4498-91ca-b45b349f8e45 req-ad52dd26-afff-44af-8d84-10588e373e80 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:21.887421 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-881bc3fc-8828-4498-91ca-b45b349f8e45 req-ad52dd26-afff-44af-8d84-10588e373e80 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:21.891536 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b7d46edb-e28a-4fab-a4da-1efbe188eecb tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Calling method '.version_select at 0x7fdf0c5c59d0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:21.957666 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-b7d46edb-e28a-4fab-a4da-1efbe188eecb tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] HTTP exception thrown: Image not found. Jun 16 14:41:21.958145 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-881bc3fc-8828-4498-91ca-b45b349f8e45 req-ad52dd26-afff-44af-8d84-10588e373e80 service nova] Creating event network-vif-unplugged:e583603f-657e-4f58-aa10-f2482dfad9de for instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 on n-h2-836830-4 Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b7d46edb-e28a-4fab-a4da-1efbe188eecb tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Request method failure captured: Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/images/fbf25e37-70f2-4739-862f-3228c1a75b12/metadata/os_version HTTP/1.1 Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0EQHcod5R5xo153-7GoZAMb3o6b5kh3yOkO-6viT9xwLrHSz1V-DIXOov_6dUIYnYH3QUbV5DGzDMihnNrKxpyyvuo6v37yPuz1aPXXA3wY8MpXbr7dpxgaCq5uA5wH7Lma89CVHRbczmc77jqlrosynC6L4dwmM27wsvpY6OH17h8 Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 4eab7eb7470949da9b9be72678569e6d Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:41:21.959858 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:41:21.962772 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4eab7eb7470949da9b9be72678569e6d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4eab7eb7470949da9b9be72678569e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4eab7eb7470949da9b9be72678569e6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4eab7eb7470949da9b9be72678569e6d"}]}] Jun 16 14:41:21.962772 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:21.962772 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 4eab7eb7470949da9b9be72678569e6d Jun 16 14:41:21.962772 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:21.962772 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesMetadataNegativeTestJSON-2118577394-project Jun 16 14:41:21.962772 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:21.962772 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:21.962772 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: bbbbe6bb1a804130a0a94a8a425e0da7 Jun 16 14:41:21.962772 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394-project Jun 16 14:41:21.962772 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:41:21.962772 n-d-836830-4 devstack@n-api.service[125863]: exception: Image not found. Jun 16 14:41:21.962772 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'image_id': 'fbf25e37-70f2-4739-862f-3228c1a75b12', 'id': 'os_version'} Jun 16 14:41:21.962772 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:41:21.965132 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fbf25e37-70f2-4739-862f-3228c1a75b12 Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:41:21.967765 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fbf25e37-70f2-4739-862f-3228c1a75b12 could not be found. Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:41:21.970171 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:21.974851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b7d46edb-e28a-4fab-a4da-1efbe188eecb tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Returning 404 to user: Image not found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:21.977291 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b7d46edb-e28a-4fab-a4da-1efbe188eecb tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] 10.222.0.57 "GET /compute/v2.1/images/fbf25e37-70f2-4739-862f-3228c1a75b12/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.094587 Jun 16 14:41:21.977291 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 421/810] 10.222.0.57 () {58 vars in 1292 bytes} [Thu Jun 16 14:41:21 2022] GET /compute/v2.1/images/fbf25e37-70f2-4739-862f-3228c1a75b12/metadata/os_version => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:41:21.977291 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c54ce744-38d5-4e52-be05-26b35b46699e tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Calling method '.version_select at 0x7fdf0c25a820>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:22.032728 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [req-881bc3fc-8828-4498-91ca-b45b349f8e45 req-ad52dd26-afff-44af-8d84-10588e373e80 service nova] Instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:41:22.058501 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-881bc3fc-8828-4498-91ca-b45b349f8e45 req-ad52dd26-afff-44af-8d84-10588e373e80 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.231365 Jun 16 14:41:22.067646 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 390/811] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:22.076555 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-c54ce744-38d5-4e52-be05-26b35b46699e tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] HTTP exception thrown: Image not found. Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c54ce744-38d5-4e52-be05-26b35b46699e tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Request method failure captured: Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/images/274342f6-88be-4bde-8d40-30140090e1b9/metadata HTTP/1.1 Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0EQHcod5R5xo153-7GoZAMb3o6b5kh3yOkO-6viT9xwLrHSz1V-DIXOov_6dUIYnYH3QUbV5DGzDMihnNrKxpyyvuo6v37yPuz1aPXXA3wY8MpXbr7dpxgaCq5uA5wH7Lma89CVHRbczmc77jqlrosynC6L4dwmM27wsvpY6OH17h8 Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 4eab7eb7470949da9b9be72678569e6d Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:41:22.079601 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:41:22.081119 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4eab7eb7470949da9b9be72678569e6d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4eab7eb7470949da9b9be72678569e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4eab7eb7470949da9b9be72678569e6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4eab7eb7470949da9b9be72678569e6d"}]}] Jun 16 14:41:22.081119 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:22.081119 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 4eab7eb7470949da9b9be72678569e6d Jun 16 14:41:22.081119 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:22.081119 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesMetadataNegativeTestJSON-2118577394-project Jun 16 14:41:22.081119 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:22.081119 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:22.081119 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: bbbbe6bb1a804130a0a94a8a425e0da7 Jun 16 14:41:22.081119 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394-project Jun 16 14:41:22.081119 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:41:22.081119 n-d-836830-4 devstack@n-api.service[125863]: exception: Image not found. Jun 16 14:41:22.081119 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'image_id': '274342f6-88be-4bde-8d40-30140090e1b9'} Jun 16 14:41:22.081119 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:41:22.082113 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 274342f6-88be-4bde-8d40-30140090e1b9 Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:41:22.083374 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 274342f6-88be-4bde-8d40-30140090e1b9 could not be found. Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:41:22.084700 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:41:22.085986 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.090026 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c54ce744-38d5-4e52-be05-26b35b46699e tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Returning 404 to user: Image not found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:22.091863 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c54ce744-38d5-4e52-be05-26b35b46699e tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] 10.222.0.57 "GET /compute/v2.1/images/274342f6-88be-4bde-8d40-30140090e1b9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.121639 Jun 16 14:41:22.092696 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 422/812] 10.222.0.57 () {58 vars in 1259 bytes} [Thu Jun 16 14:41:21 2022] GET /compute/v2.1/images/274342f6-88be-4bde-8d40-30140090e1b9/metadata => generated 62 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:41:22.107558 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-24a6b8e8-9bec-4dd2-aa28-18a36fe8965d tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Action: 'update_all', calling method: .version_select at 0x7fdf0c4e6160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:22.152364 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-24a6b8e8-9bec-4dd2-aa28-18a36fe8965d tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] HTTP exception thrown: Image not found. Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-24a6b8e8-9bec-4dd2-aa28-18a36fe8965d tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Request method failure captured: Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: request: PUT /compute/v2.1/images/a672b3da-656e-4b82-9f5e-489e234ba6ba/metadata HTTP/1.1 Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 57 Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0EQHcod5R5xo153-7GoZAMb3o6b5kh3yOkO-6viT9xwLrHSz1V-DIXOov_6dUIYnYH3QUbV5DGzDMihnNrKxpyyvuo6v37yPuz1aPXXA3wY8MpXbr7dpxgaCq5uA5wH7Lma89CVHRbczmc77jqlrosynC6L4dwmM27wsvpY6OH17h8 Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 4eab7eb7470949da9b9be72678569e6d Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:41:22.158620 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:41:22.160120 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4eab7eb7470949da9b9be72678569e6d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4eab7eb7470949da9b9be72678569e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4eab7eb7470949da9b9be72678569e6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4eab7eb7470949da9b9be72678569e6d"}]}] Jun 16 14:41:22.160120 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:22.160120 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 4eab7eb7470949da9b9be72678569e6d Jun 16 14:41:22.160120 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:22.160120 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesMetadataNegativeTestJSON-2118577394-project Jun 16 14:41:22.160120 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:41:22.160120 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:41:22.160120 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: bbbbe6bb1a804130a0a94a8a425e0da7 Jun 16 14:41:22.160120 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394-project Jun 16 14:41:22.160120 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:41:22.160120 n-d-836830-4 devstack@n-api.service[125862]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 16 14:41:22.160120 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:41:22.160120 n-d-836830-4 devstack@n-api.service[125862]: exception: Image not found. Jun 16 14:41:22.160120 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'image_id': 'a672b3da-656e-4b82-9f5e-489e234ba6ba', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:41:22.161004 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a672b3da-656e-4b82-9f5e-489e234ba6ba Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:41:22.162104 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a672b3da-656e-4b82-9f5e-489e234ba6ba could not be found. Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:22.163927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:41:22.165232 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.171237 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-24a6b8e8-9bec-4dd2-aa28-18a36fe8965d tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Returning 404 to user: Image not found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:22.175892 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-24a6b8e8-9bec-4dd2-aa28-18a36fe8965d tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] 10.222.0.57 "PUT /compute/v2.1/images/a672b3da-656e-4b82-9f5e-489e234ba6ba/metadata" status: 404 len: 62 microversion: 2.1 time: 0.075578 Jun 16 14:41:22.176787 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 391/813] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 16 14:41:22 2022] PUT /compute/v2.1/images/a672b3da-656e-4b82-9f5e-489e234ba6ba/metadata => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:41:22.186031 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8de8ed79-75e2-4ec8-8216-184463ecfa43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:22.187830 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8de8ed79-75e2-4ec8-8216-184463ecfa43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:22.189913 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6bb86082-b953-4823-adac-dc6ee4e807c1 tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Action: 'update', calling method: .version_select at 0x7fdf0c38e310>, body: {"meta": {"os_distro": "alt"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:22.206285 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8de8ed79-75e2-4ec8-8216-184463ecfa43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:22.207332 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8de8ed79-75e2-4ec8-8216-184463ecfa43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:22.209442 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8de8ed79-75e2-4ec8-8216-184463ecfa43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:22.210668 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8de8ed79-75e2-4ec8-8216-184463ecfa43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:22.227439 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-6bb86082-b953-4823-adac-dc6ee4e807c1 tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] HTTP exception thrown: Image not found. Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6bb86082-b953-4823-adac-dc6ee4e807c1 tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Request method failure captured: Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: request: PUT /compute/v2.1/images/b5ce099e-d946-43cd-bacf-2ce490b76175/metadata/os_distro HTTP/1.1 Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 30 Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0EQHcod5R5xo153-7GoZAMb3o6b5kh3yOkO-6viT9xwLrHSz1V-DIXOov_6dUIYnYH3QUbV5DGzDMihnNrKxpyyvuo6v37yPuz1aPXXA3wY8MpXbr7dpxgaCq5uA5wH7Lma89CVHRbczmc77jqlrosynC6L4dwmM27wsvpY6OH17h8 Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 4eab7eb7470949da9b9be72678569e6d Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:41:22.241054 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:41:22.243304 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4eab7eb7470949da9b9be72678569e6d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4eab7eb7470949da9b9be72678569e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4eab7eb7470949da9b9be72678569e6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4eab7eb7470949da9b9be72678569e6d"}]}] Jun 16 14:41:22.243304 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:22.243304 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 4eab7eb7470949da9b9be72678569e6d Jun 16 14:41:22.243304 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:22.243304 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesMetadataNegativeTestJSON-2118577394-project Jun 16 14:41:22.243304 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:41:22.243304 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:41:22.243304 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: bbbbe6bb1a804130a0a94a8a425e0da7 Jun 16 14:41:22.243304 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394-project Jun 16 14:41:22.243304 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:41:22.243304 n-d-836830-4 devstack@n-api.service[125862]: {"meta": {"os_distro": "alt"}} Jun 16 14:41:22.243304 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:41:22.243304 n-d-836830-4 devstack@n-api.service[125862]: exception: Image not found. Jun 16 14:41:22.243304 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'image_id': 'b5ce099e-d946-43cd-bacf-2ce490b76175', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:41:22.244190 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b5ce099e-d946-43cd-bacf-2ce490b76175 Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:41:22.245400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b5ce099e-d946-43cd-bacf-2ce490b76175 could not be found. Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:22.247037 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:41:22.248484 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.258153 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6bb86082-b953-4823-adac-dc6ee4e807c1 tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Returning 404 to user: Image not found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:22.259419 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6bb86082-b953-4823-adac-dc6ee4e807c1 tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] 10.222.0.57 "PUT /compute/v2.1/images/b5ce099e-d946-43cd-bacf-2ce490b76175/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.074813 Jun 16 14:41:22.260267 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 392/814] 10.222.0.57 () {60 vars in 1309 bytes} [Thu Jun 16 14:41:22 2022] PUT /compute/v2.1/images/b5ce099e-d946-43cd-bacf-2ce490b76175/metadata/os_distro => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:41:22.280135 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7c6d2915-dcb5-47e8-93e3-878222265c75 tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Action: 'create', calling method: .version_select at 0x7fdf0c943940>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:22.371067 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-7c6d2915-dcb5-47e8-93e3-878222265c75 tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] HTTP exception thrown: Image not found. Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7c6d2915-dcb5-47e8-93e3-878222265c75 tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Request method failure captured: Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/images/9390e6fa-3350-4865-a78e-d097b7290e99/metadata HTTP/1.1 Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 57 Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0EQHcod5R5xo153-7GoZAMb3o6b5kh3yOkO-6viT9xwLrHSz1V-DIXOov_6dUIYnYH3QUbV5DGzDMihnNrKxpyyvuo6v37yPuz1aPXXA3wY8MpXbr7dpxgaCq5uA5wH7Lma89CVHRbczmc77jqlrosynC6L4dwmM27wsvpY6OH17h8 Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 4eab7eb7470949da9b9be72678569e6d Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:41:22.373520 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:41:22.375005 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4eab7eb7470949da9b9be72678569e6d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4eab7eb7470949da9b9be72678569e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4eab7eb7470949da9b9be72678569e6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4eab7eb7470949da9b9be72678569e6d"}]}] Jun 16 14:41:22.375005 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:22.375005 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 4eab7eb7470949da9b9be72678569e6d Jun 16 14:41:22.375005 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394 Jun 16 14:41:22.375005 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesMetadataNegativeTestJSON-2118577394-project Jun 16 14:41:22.375005 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:41:22.375005 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:41:22.375005 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: bbbbe6bb1a804130a0a94a8a425e0da7 Jun 16 14:41:22.375005 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2118577394-project Jun 16 14:41:22.375005 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:41:22.375005 n-d-836830-4 devstack@n-api.service[125862]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 16 14:41:22.375005 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:41:22.375005 n-d-836830-4 devstack@n-api.service[125862]: exception: Image not found. Jun 16 14:41:22.375005 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'image_id': '9390e6fa-3350-4865-a78e-d097b7290e99', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:41:22.375922 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9390e6fa-3350-4865-a78e-d097b7290e99 Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:41:22.377078 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9390e6fa-3350-4865-a78e-d097b7290e99 could not be found. Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:22.378777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:41:22.379945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:41:22.383616 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7c6d2915-dcb5-47e8-93e3-878222265c75 tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] Returning 404 to user: Image not found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:22.385154 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7c6d2915-dcb5-47e8-93e3-878222265c75 tempest-ImagesMetadataNegativeTestJSON-2118577394 tempest-ImagesMetadataNegativeTestJSON-2118577394-project] 10.222.0.57 "POST /compute/v2.1/images/9390e6fa-3350-4865-a78e-d097b7290e99/metadata" status: 404 len: 62 microversion: 2.1 time: 0.113802 Jun 16 14:41:22.387343 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 393/815] 10.222.0.57 () {60 vars in 1280 bytes} [Thu Jun 16 14:41:22 2022] POST /compute/v2.1/images/9390e6fa-3350-4865-a78e-d097b7290e99/metadata => generated 62 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 14:41:22.504389 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-eb1b7b51-6d14-4399-9ea7-ed7ff0143eaf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:22.506514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-eb1b7b51-6d14-4399-9ea7-ed7ff0143eaf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:22.780782 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb1b7b51-6d14-4399-9ea7-ed7ff0143eaf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:22.782304 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb1b7b51-6d14-4399-9ea7-ed7ff0143eaf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:22.807105 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb1b7b51-6d14-4399-9ea7-ed7ff0143eaf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:22.809674 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb1b7b51-6d14-4399-9ea7-ed7ff0143eaf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:23.319512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8de8ed79-75e2-4ec8-8216-184463ecfa43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:23.332977 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8de8ed79-75e2-4ec8-8216-184463ecfa43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1476 microversion: 2.1 time: 1.160131 Jun 16 14:41:23.333631 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 423/816] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:22 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1476 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:41:23.346572 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-42af1f01-8975-47eb-afb0-74ab8aca48a4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:23.346572 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-42af1f01-8975-47eb-afb0-74ab8aca48a4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:23.361196 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-42af1f01-8975-47eb-afb0-74ab8aca48a4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:23.361721 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-42af1f01-8975-47eb-afb0-74ab8aca48a4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:23.362655 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-42af1f01-8975-47eb-afb0-74ab8aca48a4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:23.363106 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-42af1f01-8975-47eb-afb0-74ab8aca48a4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:23.615657 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-eb1b7b51-6d14-4399-9ea7-ed7ff0143eaf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:23.626147 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-eb1b7b51-6d14-4399-9ea7-ed7ff0143eaf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:23.634585 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-42af1f01-8975-47eb-afb0-74ab8aca48a4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:23.641028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-eb1b7b51-6d14-4399-9ea7-ed7ff0143eaf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:23.642572 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-eb1b7b51-6d14-4399-9ea7-ed7ff0143eaf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1567 microversion: 2.25 time: 1.142250 Jun 16 14:41:23.643299 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 394/817] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:22 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1567 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:41:23.655082 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-42af1f01-8975-47eb-afb0-74ab8aca48a4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1271 microversion: 2.1 time: 0.319990 Jun 16 14:41:23.657138 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 424/818] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:23 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1271 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:24.115767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bf79bfe9-9616-481e-8074-c914dad6899c tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:24.116437 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bf79bfe9-9616-481e-8074-c914dad6899c tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:24.128370 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bf79bfe9-9616-481e-8074-c914dad6899c tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:24.129196 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bf79bfe9-9616-481e-8074-c914dad6899c tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:24.145496 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bf79bfe9-9616-481e-8074-c914dad6899c tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:24.147283 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bf79bfe9-9616-481e-8074-c914dad6899c tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:24.267071 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-0ad24981-a604-49d4-90da-14b11889e286 req-6125538e-1a7c-495c-af81-e48125af4167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e428ca7a-f7f8-4dff-a272-52fb03083fd2", "tag": "e583603f-657e-4f58-aa10-f2482dfad9de"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:24.284599 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-0ad24981-a604-49d4-90da-14b11889e286 req-6125538e-1a7c-495c-af81-e48125af4167 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:24.295225 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-0ad24981-a604-49d4-90da-14b11889e286 req-6125538e-1a7c-495c-af81-e48125af4167 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:24.321850 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-0ad24981-a604-49d4-90da-14b11889e286 req-6125538e-1a7c-495c-af81-e48125af4167 service nova] Creating event network-changed:e583603f-657e-4f58-aa10-f2482dfad9de for instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 on n-h2-836830-4 Jun 16 14:41:24.342952 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [req-0ad24981-a604-49d4-90da-14b11889e286 req-6125538e-1a7c-495c-af81-e48125af4167 service nova] Instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:41:24.369173 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-0ad24981-a604-49d4-90da-14b11889e286 req-6125538e-1a7c-495c-af81-e48125af4167 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105494 Jun 16 14:41:24.370782 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 425/819] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:41:24.384058 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a18232d7-f72b-454c-a9dc-f2716477fe64 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:24.386266 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a18232d7-f72b-454c-a9dc-f2716477fe64 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:24.406907 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a18232d7-f72b-454c-a9dc-f2716477fe64 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:24.407741 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a18232d7-f72b-454c-a9dc-f2716477fe64 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:24.408822 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a18232d7-f72b-454c-a9dc-f2716477fe64 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:24.409542 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a18232d7-f72b-454c-a9dc-f2716477fe64 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:25.676213 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bf79bfe9-9616-481e-8074-c914dad6899c tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1812 microversion: 2.1 time: 1.565541 Jun 16 14:41:25.698515 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 395/820] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:24 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1812 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:41:25.716964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bc7940d1-8161-489a-9f8a-b068f0f0c73f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:25.719634 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bc7940d1-8161-489a-9f8a-b068f0f0c73f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:25.738180 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bc7940d1-8161-489a-9f8a-b068f0f0c73f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:25.739548 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bc7940d1-8161-489a-9f8a-b068f0f0c73f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:25.742686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bc7940d1-8161-489a-9f8a-b068f0f0c73f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:25.750560 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bc7940d1-8161-489a-9f8a-b068f0f0c73f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:25.932835 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bc7940d1-8161-489a-9f8a-b068f0f0c73f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:25.954170 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bc7940d1-8161-489a-9f8a-b068f0f0c73f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1271 microversion: 2.1 time: 0.258971 Jun 16 14:41:25.970979 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 396/821] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:25 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1271 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:25.982562 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-10dcd8f3-bb39-4aab-9fdf-379a2c815970 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:25.984327 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-10dcd8f3-bb39-4aab-9fdf-379a2c815970 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:25.997126 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10dcd8f3-bb39-4aab-9fdf-379a2c815970 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:25.998562 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10dcd8f3-bb39-4aab-9fdf-379a2c815970 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:26.000414 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10dcd8f3-bb39-4aab-9fdf-379a2c815970 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:26.001583 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10dcd8f3-bb39-4aab-9fdf-379a2c815970 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:26.055933 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a18232d7-f72b-454c-a9dc-f2716477fe64 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:26.068676 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a18232d7-f72b-454c-a9dc-f2716477fe64 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1476 microversion: 2.1 time: 1.688006 Jun 16 14:41:26.069650 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 426/822] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:24 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1476 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:26.088953 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d2a7ad7d-808e-4c37-9a99-0ad8bf8c1b42 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:26.096017 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:41:26.096017 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:41:26.099020 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d2a7ad7d-808e-4c37-9a99-0ad8bf8c1b42 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:26.105171 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d2a7ad7d-808e-4c37-9a99-0ad8bf8c1b42 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:26.113682 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d2a7ad7d-808e-4c37-9a99-0ad8bf8c1b42 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:26.114773 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d2a7ad7d-808e-4c37-9a99-0ad8bf8c1b42 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:26.240707 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d2a7ad7d-808e-4c37-9a99-0ad8bf8c1b42 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.165497 Jun 16 14:41:26.242173 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 427/823] 10.222.0.57 () {58 vars in 1175 bytes} [Thu Jun 16 14:41:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:26.628454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-10dcd8f3-bb39-4aab-9fdf-379a2c815970 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:26.671504 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-10dcd8f3-bb39-4aab-9fdf-379a2c815970 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:26.674931 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-10dcd8f3-bb39-4aab-9fdf-379a2c815970 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:26.678182 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-10dcd8f3-bb39-4aab-9fdf-379a2c815970 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1567 microversion: 2.25 time: 0.705026 Jun 16 14:41:26.679603 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 397/824] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:25 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1567 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:26.995642 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-97505d6a-4d51-4743-b80d-9d5874a6b3ad tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:27.001458 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-97505d6a-4d51-4743-b80d-9d5874a6b3ad tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:27.004602 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-b9cc2fe8-5f05-4202-b656-15f22fda90f1 req-ed61765a-8b3a-4d06-a4d5-93a05d96aa30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7db7635-8f84-4337-b9ba-d84b8c36e787", "name": "network-vif-unplugged", "status": "completed", "tag": "b7334014-51f5-4bc4-84ad-f055776c3b7e"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:27.047673 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97505d6a-4d51-4743-b80d-9d5874a6b3ad tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:27.053144 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97505d6a-4d51-4743-b80d-9d5874a6b3ad tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:27.057821 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-b9cc2fe8-5f05-4202-b656-15f22fda90f1 req-ed61765a-8b3a-4d06-a4d5-93a05d96aa30 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:27.058734 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-b9cc2fe8-5f05-4202-b656-15f22fda90f1 req-ed61765a-8b3a-4d06-a4d5-93a05d96aa30 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:27.060827 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97505d6a-4d51-4743-b80d-9d5874a6b3ad tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:27.065460 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97505d6a-4d51-4743-b80d-9d5874a6b3ad tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:27.087470 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-b9cc2fe8-5f05-4202-b656-15f22fda90f1 req-ed61765a-8b3a-4d06-a4d5-93a05d96aa30 service nova] Creating event network-vif-unplugged:b7334014-51f5-4bc4-84ad-f055776c3b7e for instance b7db7635-8f84-4337-b9ba-d84b8c36e787 on n-h2-836830-4 Jun 16 14:41:27.098037 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-b9cc2fe8-5f05-4202-b656-15f22fda90f1 req-ed61765a-8b3a-4d06-a4d5-93a05d96aa30 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109388 Jun 16 14:41:27.100809 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 398/825] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:27.113062 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-77531e45-2d76-4fda-97db-2c3eed7ed511 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:27.123914 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-77531e45-2d76-4fda-97db-2c3eed7ed511 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:27.149996 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-77531e45-2d76-4fda-97db-2c3eed7ed511 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:27.157848 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-77531e45-2d76-4fda-97db-2c3eed7ed511 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:27.159979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-77531e45-2d76-4fda-97db-2c3eed7ed511 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:27.167282 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-77531e45-2d76-4fda-97db-2c3eed7ed511 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:27.188406 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:27.267392 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-97505d6a-4d51-4743-b80d-9d5874a6b3ad tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:27.293827 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-97505d6a-4d51-4743-b80d-9d5874a6b3ad tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1271 microversion: 2.1 time: 0.311409 Jun 16 14:41:27.294826 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 428/826] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:26 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1271 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:27.699133 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e6462741-d509-450f-a50b-fc9861f1b2c3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:27.699915 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e6462741-d509-450f-a50b-fc9861f1b2c3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:27.713364 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e6462741-d509-450f-a50b-fc9861f1b2c3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:27.714905 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e6462741-d509-450f-a50b-fc9861f1b2c3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:27.720053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e6462741-d509-450f-a50b-fc9861f1b2c3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:27.721055 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e6462741-d509-450f-a50b-fc9861f1b2c3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:27.828987 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-77531e45-2d76-4fda-97db-2c3eed7ed511 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:27.843011 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-77531e45-2d76-4fda-97db-2c3eed7ed511 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1476 microversion: 2.1 time: 0.734562 Jun 16 14:41:27.846993 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 399/827] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:27 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1476 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:27.975690 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-3e80f9e0-7953-478f-ae96-cfb360d71bca req-b33bf021-2615-4350-b2f8-b4f3bdbf487a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f04e1cd2-656b-4de4-a784-ad2239f926bb", "tag": "b1a39f33-a168-43db-ac7a-31811d74465c"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:28.020428 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3e80f9e0-7953-478f-ae96-cfb360d71bca req-b33bf021-2615-4350-b2f8-b4f3bdbf487a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:28.030422 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3e80f9e0-7953-478f-ae96-cfb360d71bca req-b33bf021-2615-4350-b2f8-b4f3bdbf487a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:28.083523 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-3e80f9e0-7953-478f-ae96-cfb360d71bca req-b33bf021-2615-4350-b2f8-b4f3bdbf487a service nova] Creating event network-changed:b1a39f33-a168-43db-ac7a-31811d74465c for instance f04e1cd2-656b-4de4-a784-ad2239f926bb on n-h1-836830-4 Jun 16 14:41:28.119532 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-3e80f9e0-7953-478f-ae96-cfb360d71bca req-b33bf021-2615-4350-b2f8-b4f3bdbf487a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143194 Jun 16 14:41:28.121549 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 400/828] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:28.333156 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a73f7d63-d8ac-4ccf-a0f0-09ad8720cc32 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:28.335716 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a73f7d63-d8ac-4ccf-a0f0-09ad8720cc32 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:28.351774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a73f7d63-d8ac-4ccf-a0f0-09ad8720cc32 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:28.353063 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a73f7d63-d8ac-4ccf-a0f0-09ad8720cc32 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:28.373720 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a73f7d63-d8ac-4ccf-a0f0-09ad8720cc32 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:28.374957 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a73f7d63-d8ac-4ccf-a0f0-09ad8720cc32 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:28.596835 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a73f7d63-d8ac-4ccf-a0f0-09ad8720cc32 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:28.612599 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a73f7d63-d8ac-4ccf-a0f0-09ad8720cc32 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1271 microversion: 2.1 time: 0.292113 Jun 16 14:41:28.617441 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 401/829] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:28 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1271 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:28.866826 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d6b53bb7-272e-4714-b9c5-98b58dfa20b0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:28.867561 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d6b53bb7-272e-4714-b9c5-98b58dfa20b0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:28.887608 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d6b53bb7-272e-4714-b9c5-98b58dfa20b0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:28.891978 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d6b53bb7-272e-4714-b9c5-98b58dfa20b0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:28.897086 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d6b53bb7-272e-4714-b9c5-98b58dfa20b0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:28.897853 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d6b53bb7-272e-4714-b9c5-98b58dfa20b0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:29.462783 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e6462741-d509-450f-a50b-fc9861f1b2c3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:29.477358 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d6b53bb7-272e-4714-b9c5-98b58dfa20b0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:29.491237 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e6462741-d509-450f-a50b-fc9861f1b2c3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:29.492040 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d6b53bb7-272e-4714-b9c5-98b58dfa20b0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1476 microversion: 2.1 time: 0.630109 Jun 16 14:41:29.493773 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 402/830] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:28 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1476 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:29.502856 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e6462741-d509-450f-a50b-fc9861f1b2c3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:29.505716 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e6462741-d509-450f-a50b-fc9861f1b2c3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1567 microversion: 2.25 time: 1.811413 Jun 16 14:41:29.506905 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 429/831] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:27 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1567 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:29.537602 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-98741d2c-3742-4ee0-a42a-11f31059cfe8 req-122f5f4a-a5c8-45aa-b0eb-81836f790e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7db7635-8f84-4337-b9ba-d84b8c36e787", "tag": "b7334014-51f5-4bc4-84ad-f055776c3b7e"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:29.593889 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-98741d2c-3742-4ee0-a42a-11f31059cfe8 req-122f5f4a-a5c8-45aa-b0eb-81836f790e21 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:29.594508 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-98741d2c-3742-4ee0-a42a-11f31059cfe8 req-122f5f4a-a5c8-45aa-b0eb-81836f790e21 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:29.641659 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-98741d2c-3742-4ee0-a42a-11f31059cfe8 req-122f5f4a-a5c8-45aa-b0eb-81836f790e21 service nova] Creating event network-changed:b7334014-51f5-4bc4-84ad-f055776c3b7e for instance b7db7635-8f84-4337-b9ba-d84b8c36e787 on n-h2-836830-4 Jun 16 14:41:29.667803 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-98741d2c-3742-4ee0-a42a-11f31059cfe8 req-122f5f4a-a5c8-45aa-b0eb-81836f790e21 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159118 Jun 16 14:41:29.668588 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 430/832] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:29.700742 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4bd48991-b2c2-47f5-9f45-284f82e98cd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:29.701702 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4bd48991-b2c2-47f5-9f45-284f82e98cd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:29.749913 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=6 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:29.765660 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4bd48991-b2c2-47f5-9f45-284f82e98cd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:29.772073 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4bd48991-b2c2-47f5-9f45-284f82e98cd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:29.776954 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4bd48991-b2c2-47f5-9f45-284f82e98cd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:29.777477 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4bd48991-b2c2-47f5-9f45-284f82e98cd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:30.099298 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-404a8820-7e48-4dac-947b-4b0f4bbb8cc0 tempest-AbsoluteLimitsTestJSON-1336742705 tempest-AbsoluteLimitsTestJSON-1336742705-project] Calling method '.version_select at 0x7fdf0c5f19d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:30.143673 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-404a8820-7e48-4dac-947b-4b0f4bbb8cc0 tempest-AbsoluteLimitsTestJSON-1336742705 tempest-AbsoluteLimitsTestJSON-1336742705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:30.147796 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-404a8820-7e48-4dac-947b-4b0f4bbb8cc0 tempest-AbsoluteLimitsTestJSON-1336742705 tempest-AbsoluteLimitsTestJSON-1336742705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:30.154842 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-404a8820-7e48-4dac-947b-4b0f4bbb8cc0 tempest-AbsoluteLimitsTestJSON-1336742705 tempest-AbsoluteLimitsTestJSON-1336742705-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:30.155496 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-404a8820-7e48-4dac-947b-4b0f4bbb8cc0 tempest-AbsoluteLimitsTestJSON-1336742705 tempest-AbsoluteLimitsTestJSON-1336742705-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:30.169817 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:30.188973 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-404a8820-7e48-4dac-947b-4b0f4bbb8cc0 tempest-AbsoluteLimitsTestJSON-1336742705 tempest-AbsoluteLimitsTestJSON-1336742705-project] 10.222.0.57 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.694016 Jun 16 14:41:30.189666 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 403/833] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jun 16 14:41:29 2022] GET /compute/v2.1/limits => generated 511 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:30.206072 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-affbbf97-b3b0-4c47-aea2-85de08459177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e5a7d9e-f40c-44c1-b05d-7e2a62ba5ab7", "device": "/dev/xvdb"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:30.208468 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-affbbf97-b3b0-4c47-aea2-85de08459177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:30.217959 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-affbbf97-b3b0-4c47-aea2-85de08459177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:30.219178 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-affbbf97-b3b0-4c47-aea2-85de08459177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:30.220603 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-affbbf97-b3b0-4c47-aea2-85de08459177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:30.221508 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-affbbf97-b3b0-4c47-aea2-85de08459177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:30.540372 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4bd48991-b2c2-47f5-9f45-284f82e98cd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:30.591945 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4bd48991-b2c2-47f5-9f45-284f82e98cd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1313 microversion: 2.1 time: 0.910921 Jun 16 14:41:30.607834 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 431/834] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:29 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1313 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:30.623150 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-30222d1f-79e6-43d6-9b28-c92e51fc88a7 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:30.625262 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-30222d1f-79e6-43d6-9b28-c92e51fc88a7 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:30.647999 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-30222d1f-79e6-43d6-9b28-c92e51fc88a7 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:30.651060 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-30222d1f-79e6-43d6-9b28-c92e51fc88a7 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:30.654437 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-30222d1f-79e6-43d6-9b28-c92e51fc88a7 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:30.655581 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-30222d1f-79e6-43d6-9b28-c92e51fc88a7 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:30.728510 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-30222d1f-79e6-43d6-9b28-c92e51fc88a7 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115939 Jun 16 14:41:30.735826 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 432/835] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:41:30 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:41:30.754616 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5ad9b165-ba31-425a-9595-84d995bb41e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:30.755694 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5ad9b165-ba31-425a-9595-84d995bb41e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:30.775413 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5ad9b165-ba31-425a-9595-84d995bb41e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:30.776226 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5ad9b165-ba31-425a-9595-84d995bb41e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:30.777697 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5ad9b165-ba31-425a-9595-84d995bb41e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:30.778533 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5ad9b165-ba31-425a-9595-84d995bb41e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:31.137460 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5ad9b165-ba31-425a-9595-84d995bb41e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:31.153951 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5ad9b165-ba31-425a-9595-84d995bb41e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1474 microversion: 2.1 time: 0.411617 Jun 16 14:41:31.154957 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 433/836] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:30 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1474 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:31.170135 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7ae740a1-598b-491d-a68d-10c1bbaae509 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:31.171245 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7ae740a1-598b-491d-a68d-10c1bbaae509 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:31.177805 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ae740a1-598b-491d-a68d-10c1bbaae509 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:31.178258 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ae740a1-598b-491d-a68d-10c1bbaae509 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:31.179092 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ae740a1-598b-491d-a68d-10c1bbaae509 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:31.179597 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ae740a1-598b-491d-a68d-10c1bbaae509 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:32.014920 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7ae740a1-598b-491d-a68d-10c1bbaae509 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:32.043389 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7ae740a1-598b-491d-a68d-10c1bbaae509 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:32.045721 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7ae740a1-598b-491d-a68d-10c1bbaae509 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:32.047259 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7ae740a1-598b-491d-a68d-10c1bbaae509 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1567 microversion: 2.25 time: 0.881453 Jun 16 14:41:32.048404 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 434/837] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:31 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1567 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:32.066340 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-367ba725-d589-48ea-8801-b26f597bae98 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:32.068723 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-367ba725-d589-48ea-8801-b26f597bae98 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:32.081398 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-367ba725-d589-48ea-8801-b26f597bae98 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:32.082270 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-367ba725-d589-48ea-8801-b26f597bae98 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:32.084180 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-367ba725-d589-48ea-8801-b26f597bae98 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:32.084952 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-367ba725-d589-48ea-8801-b26f597bae98 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:32.138457 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-367ba725-d589-48ea-8801-b26f597bae98 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088368 Jun 16 14:41:32.140114 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 435/838] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:41:32 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:41:32.148371 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bb1ad457-f7f0-4f0c-baf9-01fbecb7fb10 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:32.149165 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bb1ad457-f7f0-4f0c-baf9-01fbecb7fb10 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:32.158443 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb1ad457-f7f0-4f0c-baf9-01fbecb7fb10 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:32.158921 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb1ad457-f7f0-4f0c-baf9-01fbecb7fb10 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:32.161970 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb1ad457-f7f0-4f0c-baf9-01fbecb7fb10 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:32.162464 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb1ad457-f7f0-4f0c-baf9-01fbecb7fb10 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:32.405163 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-affbbf97-b3b0-4c47-aea2-85de08459177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "POST /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.206800 Jun 16 14:41:32.410902 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 404/839] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 16 14:41:30 2022] POST /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments => generated 194 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:32.451729 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-63f6eef4-e29d-46ce-b938-b91e695d6be9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:32.452342 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-63f6eef4-e29d-46ce-b938-b91e695d6be9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:32.465630 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-63f6eef4-e29d-46ce-b938-b91e695d6be9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:32.466116 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-63f6eef4-e29d-46ce-b938-b91e695d6be9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:32.467065 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-63f6eef4-e29d-46ce-b938-b91e695d6be9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:32.467706 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-63f6eef4-e29d-46ce-b938-b91e695d6be9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:32.823344 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-63f6eef4-e29d-46ce-b938-b91e695d6be9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:32.840419 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-63f6eef4-e29d-46ce-b938-b91e695d6be9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1471 microversion: 2.1 time: 0.430438 Jun 16 14:41:32.843605 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 405/840] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:32 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1471 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:32.873551 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-432d036c-c05a-42a5-a328-0406c1a9561c tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:32.881798 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-432d036c-c05a-42a5-a328-0406c1a9561c tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:32.915114 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-432d036c-c05a-42a5-a328-0406c1a9561c tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:32.916378 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-432d036c-c05a-42a5-a328-0406c1a9561c tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:32.918292 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-432d036c-c05a-42a5-a328-0406c1a9561c tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:32.919421 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-432d036c-c05a-42a5-a328-0406c1a9561c tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:33.013416 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-432d036c-c05a-42a5-a328-0406c1a9561c tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:41:33.212201 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-432d036c-c05a-42a5-a328-0406c1a9561c tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 204 len: 0 microversion: 2.1 time: 0.366249 Jun 16 14:41:33.213641 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 406/841] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:41:32 2022] DELETE /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:33.229285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6f26b519-d736-4ebc-a79e-0283b36ad242 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:33.231111 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6f26b519-d736-4ebc-a79e-0283b36ad242 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:33.245080 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f26b519-d736-4ebc-a79e-0283b36ad242 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:33.246886 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f26b519-d736-4ebc-a79e-0283b36ad242 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:33.249177 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f26b519-d736-4ebc-a79e-0283b36ad242 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:33.250855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f26b519-d736-4ebc-a79e-0283b36ad242 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:33.351678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bb1ad457-f7f0-4f0c-baf9-01fbecb7fb10 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:33.370827 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bb1ad457-f7f0-4f0c-baf9-01fbecb7fb10 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1313 microversion: 2.1 time: 1.228311 Jun 16 14:41:33.372351 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6f26b519-d736-4ebc-a79e-0283b36ad242 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "POST /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2/action" status: 204 len: 0 microversion: 2.1 time: 0.155909 Jun 16 14:41:33.373341 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 407/842] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:41:33 2022] POST /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2/action => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:41:33.389650 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 436/843] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:32 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1313 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:33.401455 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0b0036c7-6e44-4879-80f3-72cabce1fd9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:33.402730 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0b0036c7-6e44-4879-80f3-72cabce1fd9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:33.418918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b0036c7-6e44-4879-80f3-72cabce1fd9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:33.420291 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b0036c7-6e44-4879-80f3-72cabce1fd9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:33.420291 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b0036c7-6e44-4879-80f3-72cabce1fd9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:33.420746 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b0036c7-6e44-4879-80f3-72cabce1fd9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:33.430885 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f1721043-ad0f-49f1-9163-dd9ff25f681b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:33.433578 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f1721043-ad0f-49f1-9163-dd9ff25f681b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:33.493601 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f1721043-ad0f-49f1-9163-dd9ff25f681b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:33.494600 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f1721043-ad0f-49f1-9163-dd9ff25f681b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:33.496018 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f1721043-ad0f-49f1-9163-dd9ff25f681b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:33.509233 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f1721043-ad0f-49f1-9163-dd9ff25f681b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:34.594981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0b0036c7-6e44-4879-80f3-72cabce1fd9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:34.605284 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0b0036c7-6e44-4879-80f3-72cabce1fd9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:34.606943 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0b0036c7-6e44-4879-80f3-72cabce1fd9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:34.608404 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0b0036c7-6e44-4879-80f3-72cabce1fd9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1567 microversion: 2.25 time: 1.232856 Jun 16 14:41:34.608994 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 408/844] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:33 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1567 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:34.622964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-95980891-69ce-4897-8539-4b1d82c7d4e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:34.623589 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-95980891-69ce-4897-8539-4b1d82c7d4e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:34.645430 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-95980891-69ce-4897-8539-4b1d82c7d4e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:34.645982 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-95980891-69ce-4897-8539-4b1d82c7d4e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:34.647427 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-95980891-69ce-4897-8539-4b1d82c7d4e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:34.648657 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-95980891-69ce-4897-8539-4b1d82c7d4e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:34.999689 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f1721043-ad0f-49f1-9163-dd9ff25f681b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:35.013712 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f1721043-ad0f-49f1-9163-dd9ff25f681b tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1681 microversion: 2.1 time: 1.620984 Jun 16 14:41:35.014332 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 437/845] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:33 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1681 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:35.040903 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2484c6ab-a275-4d44-bfea-81f7f6ceb230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:35.041616 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2484c6ab-a275-4d44-bfea-81f7f6ceb230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:35.056647 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2484c6ab-a275-4d44-bfea-81f7f6ceb230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:35.057831 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2484c6ab-a275-4d44-bfea-81f7f6ceb230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:35.059017 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2484c6ab-a275-4d44-bfea-81f7f6ceb230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:35.059639 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2484c6ab-a275-4d44-bfea-81f7f6ceb230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:35.185681 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-95980891-69ce-4897-8539-4b1d82c7d4e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:35.217191 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-95980891-69ce-4897-8539-4b1d82c7d4e3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1471 microversion: 2.1 time: 0.601511 Jun 16 14:41:35.222004 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 409/846] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:34 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1471 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:35.629220 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2ee3cda6-6bc4-4139-9f72-25a7a6d6cbc7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:35.630463 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2ee3cda6-6bc4-4139-9f72-25a7a6d6cbc7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:35.643701 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2ee3cda6-6bc4-4139-9f72-25a7a6d6cbc7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:35.648046 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2ee3cda6-6bc4-4139-9f72-25a7a6d6cbc7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:35.649633 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2ee3cda6-6bc4-4139-9f72-25a7a6d6cbc7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:35.655954 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2ee3cda6-6bc4-4139-9f72-25a7a6d6cbc7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:35.836175 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2484c6ab-a275-4d44-bfea-81f7f6ceb230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:35.870819 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2484c6ab-a275-4d44-bfea-81f7f6ceb230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1313 microversion: 2.1 time: 0.835112 Jun 16 14:41:35.876275 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 438/847] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:35 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1313 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:36.035565 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-81763c75-41eb-4738-be72-34c2227a2f73 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:36.038956 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-81763c75-41eb-4738-be72-34c2227a2f73 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:36.052895 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81763c75-41eb-4738-be72-34c2227a2f73 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:36.053431 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81763c75-41eb-4738-be72-34c2227a2f73 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:36.059701 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81763c75-41eb-4738-be72-34c2227a2f73 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:36.060379 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81763c75-41eb-4738-be72-34c2227a2f73 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:36.155652 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=4 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:36.258694 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2ee3cda6-6bc4-4139-9f72-25a7a6d6cbc7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:36.299349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2ee3cda6-6bc4-4139-9f72-25a7a6d6cbc7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:36.306591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2ee3cda6-6bc4-4139-9f72-25a7a6d6cbc7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:36.308296 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2ee3cda6-6bc4-4139-9f72-25a7a6d6cbc7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1567 microversion: 2.25 time: 0.683516 Jun 16 14:41:36.322692 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 410/848] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:35 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1567 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:41:36.329024 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-d66c5d47-f26a-418b-9c36-7ff3b8ba0062 req-dfec5043-8e4a-48b1-817e-3d5c7be40fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e428ca7a-f7f8-4dff-a272-52fb03083fd2", "name": "network-vif-plugged", "status": "completed", "tag": "e583603f-657e-4f58-aa10-f2482dfad9de"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:36.352083 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-d66c5d47-f26a-418b-9c36-7ff3b8ba0062 req-dfec5043-8e4a-48b1-817e-3d5c7be40fdf service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:36.352970 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-d66c5d47-f26a-418b-9c36-7ff3b8ba0062 req-dfec5043-8e4a-48b1-817e-3d5c7be40fdf service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:36.387025 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-d66c5d47-f26a-418b-9c36-7ff3b8ba0062 req-dfec5043-8e4a-48b1-817e-3d5c7be40fdf service nova] Creating event network-vif-plugged:e583603f-657e-4f58-aa10-f2482dfad9de for instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 on n-h2-836830-4 Jun 16 14:41:36.414937 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [req-d66c5d47-f26a-418b-9c36-7ff3b8ba0062 req-dfec5043-8e4a-48b1-817e-3d5c7be40fdf service nova] Instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:41:36.446070 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-d66c5d47-f26a-418b-9c36-7ff3b8ba0062 req-dfec5043-8e4a-48b1-817e-3d5c7be40fdf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120034 Jun 16 14:41:36.448813 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 411/849] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:36.456192 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5ae4aef6-9d98-4878-ad3e-06f7952efeac tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:36.457486 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5ae4aef6-9d98-4878-ad3e-06f7952efeac tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:36.470858 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5ae4aef6-9d98-4878-ad3e-06f7952efeac tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:36.472995 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5ae4aef6-9d98-4878-ad3e-06f7952efeac tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:36.476071 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5ae4aef6-9d98-4878-ad3e-06f7952efeac tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:36.479895 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5ae4aef6-9d98-4878-ad3e-06f7952efeac tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:37.350417 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-81763c75-41eb-4738-be72-34c2227a2f73 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:37.397666 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-81763c75-41eb-4738-be72-34c2227a2f73 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1681 microversion: 2.1 time: 1.369021 Jun 16 14:41:37.404287 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 439/850] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:36 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1681 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:41:37.418947 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-bf3e9030-146c-47dd-b22d-90acf9feb4d7 req-ba0e9c74-3520-4d9a-b95b-51ba1b8c359f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8ac858-0bec-476e-8bd5-0234b252a67f", "tag": "54c6b864-0c09-49b6-96ef-b067ca450425"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:37.429910 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-bf3e9030-146c-47dd-b22d-90acf9feb4d7 req-ba0e9c74-3520-4d9a-b95b-51ba1b8c359f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:37.430700 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-bf3e9030-146c-47dd-b22d-90acf9feb4d7 req-ba0e9c74-3520-4d9a-b95b-51ba1b8c359f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:37.442275 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:37.446202 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-bf3e9030-146c-47dd-b22d-90acf9feb4d7 req-ba0e9c74-3520-4d9a-b95b-51ba1b8c359f service nova] Creating event network-changed:54c6b864-0c09-49b6-96ef-b067ca450425 for instance 4b8ac858-0bec-476e-8bd5-0234b252a67f on n-h2-836830-4 Jun 16 14:41:37.452767 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-bf3e9030-146c-47dd-b22d-90acf9feb4d7 req-ba0e9c74-3520-4d9a-b95b-51ba1b8c359f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037462 Jun 16 14:41:37.454028 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 440/851] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:37.460643 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-da490687-bfa1-4e29-92f4-c6efe0160a79 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:37.462531 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-da490687-bfa1-4e29-92f4-c6efe0160a79 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:37.475005 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-da490687-bfa1-4e29-92f4-c6efe0160a79 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:37.475820 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-da490687-bfa1-4e29-92f4-c6efe0160a79 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:37.476769 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-da490687-bfa1-4e29-92f4-c6efe0160a79 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:37.477296 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-da490687-bfa1-4e29-92f4-c6efe0160a79 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:37.526902 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5ae4aef6-9d98-4878-ad3e-06f7952efeac tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:37.553249 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5ae4aef6-9d98-4878-ad3e-06f7952efeac tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1471 microversion: 2.1 time: 1.101736 Jun 16 14:41:37.560598 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 412/852] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:36 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1471 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:37.601488 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fb45e614-27ff-4657-839f-65e3e387b330 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:37.602618 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fb45e614-27ff-4657-839f-65e3e387b330 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:37.616300 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb45e614-27ff-4657-839f-65e3e387b330 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:37.616816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb45e614-27ff-4657-839f-65e3e387b330 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:37.618036 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb45e614-27ff-4657-839f-65e3e387b330 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:37.618765 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb45e614-27ff-4657-839f-65e3e387b330 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:38.128018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fb45e614-27ff-4657-839f-65e3e387b330 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:38.169097 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fb45e614-27ff-4657-839f-65e3e387b330 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:38.172877 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fb45e614-27ff-4657-839f-65e3e387b330 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:38.176292 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fb45e614-27ff-4657-839f-65e3e387b330 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1567 microversion: 2.25 time: 0.598762 Jun 16 14:41:38.177914 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 413/853] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:37 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1567 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:38.291620 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-da490687-bfa1-4e29-92f4-c6efe0160a79 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:38.311439 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-da490687-bfa1-4e29-92f4-c6efe0160a79 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1313 microversion: 2.1 time: 0.851463 Jun 16 14:41:38.311439 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 441/854] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:37 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1313 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:38.427318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7139484c-8f89-45cb-8bd6-37b0ac04dd1d tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:38.428445 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7139484c-8f89-45cb-8bd6-37b0ac04dd1d tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:38.465568 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7139484c-8f89-45cb-8bd6-37b0ac04dd1d tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:38.466786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7139484c-8f89-45cb-8bd6-37b0ac04dd1d tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:38.468401 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7139484c-8f89-45cb-8bd6-37b0ac04dd1d tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:38.469335 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7139484c-8f89-45cb-8bd6-37b0ac04dd1d tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:38.558226 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-2e859232-81d6-4211-b72e-492660393193 req-93dda774-ba16-4011-8f17-975dfbdd36bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04e1cd2-656b-4de4-a784-ad2239f926bb", "name": "network-vif-plugged", "status": "completed", "tag": "b1a39f33-a168-43db-ac7a-31811d74465c"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:38.571545 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-2e859232-81d6-4211-b72e-492660393193 req-93dda774-ba16-4011-8f17-975dfbdd36bc service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:38.585950 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-2e859232-81d6-4211-b72e-492660393193 req-93dda774-ba16-4011-8f17-975dfbdd36bc service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:38.629034 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-2e859232-81d6-4211-b72e-492660393193 req-93dda774-ba16-4011-8f17-975dfbdd36bc service nova] Creating event network-vif-plugged:b1a39f33-a168-43db-ac7a-31811d74465c for instance f04e1cd2-656b-4de4-a784-ad2239f926bb on n-h1-836830-4 Jun 16 14:41:38.648942 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-2e859232-81d6-4211-b72e-492660393193 req-93dda774-ba16-4011-8f17-975dfbdd36bc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095524 Jun 16 14:41:38.649800 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 442/855] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 16 14:41:38.664105 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-aecbf6a6-eebd-4a02-bc62-71d564b4f043 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:38.664835 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-aecbf6a6-eebd-4a02-bc62-71d564b4f043 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:38.707086 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aecbf6a6-eebd-4a02-bc62-71d564b4f043 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:38.711067 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aecbf6a6-eebd-4a02-bc62-71d564b4f043 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:38.712123 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aecbf6a6-eebd-4a02-bc62-71d564b4f043 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:38.712772 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aecbf6a6-eebd-4a02-bc62-71d564b4f043 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:39.076446 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7139484c-8f89-45cb-8bd6-37b0ac04dd1d tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:39.105139 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7139484c-8f89-45cb-8bd6-37b0ac04dd1d tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1613 microversion: 2.1 time: 0.678984 Jun 16 14:41:39.105823 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 414/856] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:38 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1613 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:39.198011 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e6d694bf-5568-423f-9147-30b770bb0919 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:39.199146 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e6d694bf-5568-423f-9147-30b770bb0919 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:39.217765 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6d694bf-5568-423f-9147-30b770bb0919 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:39.218283 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6d694bf-5568-423f-9147-30b770bb0919 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:39.222007 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6d694bf-5568-423f-9147-30b770bb0919 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:39.222514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6d694bf-5568-423f-9147-30b770bb0919 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:39.702536 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-aecbf6a6-eebd-4a02-bc62-71d564b4f043 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:39.729140 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-aecbf6a6-eebd-4a02-bc62-71d564b4f043 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1463 microversion: 2.1 time: 1.069881 Jun 16 14:41:39.730489 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 443/857] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:38 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1463 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:39.753427 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7a9ce6de-245d-47b6-8183-5d9cd1c4c6c3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:39.755650 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7a9ce6de-245d-47b6-8183-5d9cd1c4c6c3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:39.775936 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a9ce6de-245d-47b6-8183-5d9cd1c4c6c3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:39.780990 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a9ce6de-245d-47b6-8183-5d9cd1c4c6c3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:39.783231 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a9ce6de-245d-47b6-8183-5d9cd1c4c6c3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:39.786341 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a9ce6de-245d-47b6-8183-5d9cd1c4c6c3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:40.142645 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=10 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:40.169207 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:40.196287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e6d694bf-5568-423f-9147-30b770bb0919 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:40.256875 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e6d694bf-5568-423f-9147-30b770bb0919 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:40.327131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e6d694bf-5568-423f-9147-30b770bb0919 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:40.331187 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e6d694bf-5568-423f-9147-30b770bb0919 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1567 microversion: 2.25 time: 1.138427 Jun 16 14:41:40.333706 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 415/858] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:39 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1567 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:41:40.364234 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-1e0aad69-9f5d-48f8-811c-e9e1f83f6b20 req-fa85c91d-6a69-46ac-aeab-6c36f2796054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7db7635-8f84-4337-b9ba-d84b8c36e787", "name": "network-vif-unplugged", "status": "completed", "tag": "b7334014-51f5-4bc4-84ad-f055776c3b7e"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:40.397082 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-1e0aad69-9f5d-48f8-811c-e9e1f83f6b20 req-fa85c91d-6a69-46ac-aeab-6c36f2796054 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:40.400979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-1e0aad69-9f5d-48f8-811c-e9e1f83f6b20 req-fa85c91d-6a69-46ac-aeab-6c36f2796054 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:40.448579 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-1e0aad69-9f5d-48f8-811c-e9e1f83f6b20 req-fa85c91d-6a69-46ac-aeab-6c36f2796054 service nova] Creating event network-vif-unplugged:b7334014-51f5-4bc4-84ad-f055776c3b7e for instance b7db7635-8f84-4337-b9ba-d84b8c36e787 on n-h2-836830-4 Jun 16 14:41:40.480201 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-1e0aad69-9f5d-48f8-811c-e9e1f83f6b20 req-fa85c91d-6a69-46ac-aeab-6c36f2796054 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143260 Jun 16 14:41:40.482842 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 416/859] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:40.497463 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3ff8b284-426d-44b2-affa-13bb778e1955 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:40.498737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3ff8b284-426d-44b2-affa-13bb778e1955 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:40.515763 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3ff8b284-426d-44b2-affa-13bb778e1955 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:40.518045 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3ff8b284-426d-44b2-affa-13bb778e1955 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:40.520759 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3ff8b284-426d-44b2-affa-13bb778e1955 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:40.521987 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3ff8b284-426d-44b2-affa-13bb778e1955 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:40.541514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:40.853844 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7a9ce6de-245d-47b6-8183-5d9cd1c4c6c3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:40.868563 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7a9ce6de-245d-47b6-8183-5d9cd1c4c6c3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1313 microversion: 2.1 time: 1.130352 Jun 16 14:41:40.875443 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 444/860] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:39 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1313 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:40.894973 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ddf76151-8b68-4672-8a01-87e8aa0b01bb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:40.896236 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ddf76151-8b68-4672-8a01-87e8aa0b01bb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:40.911911 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:40.924780 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddf76151-8b68-4672-8a01-87e8aa0b01bb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:40.936016 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddf76151-8b68-4672-8a01-87e8aa0b01bb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:40.939636 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddf76151-8b68-4672-8a01-87e8aa0b01bb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:40.942099 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddf76151-8b68-4672-8a01-87e8aa0b01bb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:41.062522 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddf76151-8b68-4672-8a01-87e8aa0b01bb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:41.065924 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddf76151-8b68-4672-8a01-87e8aa0b01bb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:41.069571 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-ddf76151-8b68-4672-8a01-87e8aa0b01bb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lazy-loading 'fault' on Instance uuid e7771166-9bbf-41d0-b3ca-b4515a46a67c {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:41:41.206662 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ddf76151-8b68-4672-8a01-87e8aa0b01bb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848a67571a4e4eb5a21d5f4502b35cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c686fc6c846f444b9c3c8790028ad694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:41.221714 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ddf76151-8b68-4672-8a01-87e8aa0b01bb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 200 len: 1331 microversion: 2.1 time: 0.342033 Jun 16 14:41:41.224635 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 445/861] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:40 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 1331 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:41.239173 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-ad6b183d-e0b5-4067-aec7-9671b3baf362 req-4f70e3ef-05eb-45f6-b5ac-c13a6cc56562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7771166-9bbf-41d0-b3ca-b4515a46a67c", "name": "network-vif-deleted", "tag": "763165ed-fb52-4810-9706-7aa1d1b6f7f1"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:41.256673 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-ad6b183d-e0b5-4067-aec7-9671b3baf362 req-4f70e3ef-05eb-45f6-b5ac-c13a6cc56562 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:41.259841 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-ad6b183d-e0b5-4067-aec7-9671b3baf362 req-4f70e3ef-05eb-45f6-b5ac-c13a6cc56562 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:41.293359 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-ad6b183d-e0b5-4067-aec7-9671b3baf362 req-4f70e3ef-05eb-45f6-b5ac-c13a6cc56562 service nova] Creating event network-vif-deleted:763165ed-fb52-4810-9706-7aa1d1b6f7f1 for instance e7771166-9bbf-41d0-b3ca-b4515a46a67c on n-h2-836830-4 Jun 16 14:41:41.307001 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-ad6b183d-e0b5-4067-aec7-9671b3baf362 req-4f70e3ef-05eb-45f6-b5ac-c13a6cc56562 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080311 Jun 16 14:41:41.307996 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 446/862] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:41.368503 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7b807cf3-33e1-40f7-bb78-13b6fadb0b32 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:41.369643 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7b807cf3-33e1-40f7-bb78-13b6fadb0b32 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:41.382633 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7b807cf3-33e1-40f7-bb78-13b6fadb0b32 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:41.395286 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7b807cf3-33e1-40f7-bb78-13b6fadb0b32 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:41.396753 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7b807cf3-33e1-40f7-bb78-13b6fadb0b32 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:41.397513 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7b807cf3-33e1-40f7-bb78-13b6fadb0b32 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:41.511393 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3ff8b284-426d-44b2-affa-13bb778e1955 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1614 microversion: 2.1 time: 1.026011 Jun 16 14:41:41.513094 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 417/863] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:40 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1614 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:41.547852 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d59722de-37ef-4ab2-b3a4-f25597a04746 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Calling method '.version_select at 0x7fdf0c543790>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:41.551417 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d59722de-37ef-4ab2-b3a4-f25597a04746 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:41.558348 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d59722de-37ef-4ab2-b3a4-f25597a04746 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:41.589304 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d59722de-37ef-4ab2-b3a4-f25597a04746 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 1943 microversion: 2.1 time: 0.049456 Jun 16 14:41:41.598145 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 418/864] 10.222.0.57 () {58 vars in 1142 bytes} [Thu Jun 16 14:41:41 2022] GET /compute/v2.1/os-migrations => generated 1943 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:41:41.873938 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1228323349", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:41.955772 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] validate_networks() for None {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:41:42.117189 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7b807cf3-33e1-40f7-bb78-13b6fadb0b32 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:42.136697 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7b807cf3-33e1-40f7-bb78-13b6fadb0b32 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:42.143880 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7b807cf3-33e1-40f7-bb78-13b6fadb0b32 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:42.148015 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7b807cf3-33e1-40f7-bb78-13b6fadb0b32 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1567 microversion: 2.25 time: 0.782413 Jun 16 14:41:42.149813 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 447/865] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:41 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1567 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:42.180926 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e176543d-579e-4c38-8df4-284d3a8a0117 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:42.185374 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e176543d-579e-4c38-8df4-284d3a8a0117 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:42.205378 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e176543d-579e-4c38-8df4-284d3a8a0117 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:42.209036 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e176543d-579e-4c38-8df4-284d3a8a0117 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:42.210282 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e176543d-579e-4c38-8df4-284d3a8a0117 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:42.214563 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e176543d-579e-4c38-8df4-284d3a8a0117 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:43.007923 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e176543d-579e-4c38-8df4-284d3a8a0117 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:43.021675 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e176543d-579e-4c38-8df4-284d3a8a0117 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1313 microversion: 2.1 time: 0.869746 Jun 16 14:41:43.025804 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 448/866] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:42 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1313 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:43.042597 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-92d9e801-d795-4b39-83f1-97ad323ff140 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:43.043237 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-92d9e801-d795-4b39-83f1-97ad323ff140 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:43.075065 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-92d9e801-d795-4b39-83f1-97ad323ff140 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:43.079872 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-92d9e801-d795-4b39-83f1-97ad323ff140 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:43.081168 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-92d9e801-d795-4b39-83f1-97ad323ff140 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:43.085606 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-92d9e801-d795-4b39-83f1-97ad323ff140 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:43.147792 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-92d9e801-d795-4b39-83f1-97ad323ff140 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] HTTP exception thrown: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-92d9e801-d795-4b39-83f1-97ad323ff140 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Request method failure captured: Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c HTTP/1.1 Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0A-bcugIvDatzXWCfCLXGx29JiNmsWRIBV9Ya1siGKaOwewPCJtQVCpp3Xtl43tvLfTWHMPDJb5cg7VcmbdTMBnTyA-vM67JrEFI1JZZslibtjTnkGBFcVMMzfk_u61UgPna4uIVHjMip08-O3dhwSBrRNI3ND2nw-4E2y-BbSbCtU Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: c686fc6c846f444b9c3c8790028ad694 Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2057017494 Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:41:43.149528 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:41:43.152531 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c686fc6c846f444b9c3c8790028ad694", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c686fc6c846f444b9c3c8790028ad694"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c686fc6c846f444b9c3c8790028ad694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c686fc6c846f444b9c3c8790028ad694"}]}] Jun 16 14:41:43.152531 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2057017494 Jun 16 14:41:43.152531 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: c686fc6c846f444b9c3c8790028ad694 Jun 16 14:41:43.152531 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2057017494 Jun 16 14:41:43.152531 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-AttachSCSIVolumeTestJSON-2057017494-project Jun 16 14:41:43.152531 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:43.152531 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:43.152531 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 848a67571a4e4eb5a21d5f4502b35cb4 Jun 16 14:41:43.152531 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2057017494-project Jun 16 14:41:43.152531 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:41:43.152531 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. Jun 16 14:41:43.152531 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'e7771166-9bbf-41d0-b3ca-b4515a46a67c'} Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:43.154517 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. Jun 16 14:41:43.157327 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:43.160476 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-92d9e801-d795-4b39-83f1-97ad323ff140 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Returning 404 to user: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:43.160476 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-92d9e801-d795-4b39-83f1-97ad323ff140 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 404 len: 111 microversion: 2.1 time: 0.128960 Jun 16 14:41:43.164031 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 449/867] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:43 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:41:43.176490 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-566a357e-23f4-44bc-ba24-cc5b94465833 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '.version_select at 0x7fdf0c1e8b80>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:43.232034 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-566a357e-23f4-44bc-ba24-cc5b94465833 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-537177185" status: 202 len: 0 microversion: 2.1 time: 0.066606 Jun 16 14:41:43.236955 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 450/868] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jun 16 14:41:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-537177185 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:41:43.252607 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fb6a35ed-f054-452d-88fa-1c317387b0a7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:43.254153 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fb6a35ed-f054-452d-88fa-1c317387b0a7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:43.275777 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fb6a35ed-f054-452d-88fa-1c317387b0a7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:43.278053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fb6a35ed-f054-452d-88fa-1c317387b0a7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:43.279760 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fb6a35ed-f054-452d-88fa-1c317387b0a7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:43.283220 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fb6a35ed-f054-452d-88fa-1c317387b0a7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:43.985906 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:41:43.986678 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:41:43.986871 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:41:43.987794 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:41:43.988942 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:41:44.006110 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fb6a35ed-f054-452d-88fa-1c317387b0a7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:44.011975 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:44.012447 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:44.013294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:44.013743 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:44.023549 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fb6a35ed-f054-452d-88fa-1c317387b0a7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:44.032676 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fb6a35ed-f054-452d-88fa-1c317387b0a7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:44.032676 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fb6a35ed-f054-452d-88fa-1c317387b0a7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1567 microversion: 2.25 time: 0.791096 Jun 16 14:41:44.048297 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 451/869] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:43 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1567 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:44.060985 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-466ef47c-d48e-473e-8ccb-d866f8882412 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:44.060985 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-466ef47c-d48e-473e-8ccb-d866f8882412 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:44.070908 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-466ef47c-d48e-473e-8ccb-d866f8882412 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:44.071349 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-466ef47c-d48e-473e-8ccb-d866f8882412 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:44.072181 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-466ef47c-d48e-473e-8ccb-d866f8882412 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:44.072622 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-466ef47c-d48e-473e-8ccb-d866f8882412 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:44.073669 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Getting quotas for project 414e3b792647435daa2ecce22a2c6132. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:41:44.101544 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Getting quotas for user 65cde69f3b52448c8b08297b548bb377 and project 414e3b792647435daa2ecce22a2c6132. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:41:44.115067 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:44.188127 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:41:44.198141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:41:44.364543 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cf2edaa4-59f4-48a2-be09-751db5dcfdce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.490358 Jun 16 14:41:44.367102 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 419/870] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:41:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 14:41:44.383275 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-52d4bcce-2b6e-41d5-9d3d-60d2c00100c4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:44.385347 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-52d4bcce-2b6e-41d5-9d3d-60d2c00100c4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:44.624184 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-52d4bcce-2b6e-41d5-9d3d-60d2c00100c4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:44.643782 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-52d4bcce-2b6e-41d5-9d3d-60d2c00100c4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1213 microversion: 2.1 time: 0.269153 Jun 16 14:41:44.657079 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 420/871] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:44 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1213 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:44.723980 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-466ef47c-d48e-473e-8ccb-d866f8882412 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:44.735785 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-466ef47c-d48e-473e-8ccb-d866f8882412 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1313 microversion: 2.1 time: 0.697930 Jun 16 14:41:44.736213 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 452/872] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:44 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1313 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:45.071717 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ace0579e-81b9-41dd-a7a0-206cac177fce tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:45.074673 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ace0579e-81b9-41dd-a7a0-206cac177fce tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:45.095462 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ace0579e-81b9-41dd-a7a0-206cac177fce tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:45.097699 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ace0579e-81b9-41dd-a7a0-206cac177fce tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:45.101077 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ace0579e-81b9-41dd-a7a0-206cac177fce tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:45.102775 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ace0579e-81b9-41dd-a7a0-206cac177fce tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:45.725539 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-209110d0-207f-472e-accd-c56d64b9af4e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:45.730115 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-209110d0-207f-472e-accd-c56d64b9af4e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:46.058714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ace0579e-81b9-41dd-a7a0-206cac177fce tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:46.092928 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ace0579e-81b9-41dd-a7a0-206cac177fce tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:46.099601 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ace0579e-81b9-41dd-a7a0-206cac177fce tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:46.102707 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ace0579e-81b9-41dd-a7a0-206cac177fce tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1567 microversion: 2.25 time: 1.036526 Jun 16 14:41:46.104787 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 421/873] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:45 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1567 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:46.117996 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a4562f13-8bcc-4b58-a942-1ddb98a24e1e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:46.120280 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a4562f13-8bcc-4b58-a942-1ddb98a24e1e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:46.138207 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a4562f13-8bcc-4b58-a942-1ddb98a24e1e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:46.139389 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a4562f13-8bcc-4b58-a942-1ddb98a24e1e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:46.140982 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a4562f13-8bcc-4b58-a942-1ddb98a24e1e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:46.142047 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a4562f13-8bcc-4b58-a942-1ddb98a24e1e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:46.197503 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-209110d0-207f-472e-accd-c56d64b9af4e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:46.215405 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-209110d0-207f-472e-accd-c56d64b9af4e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1213 microversion: 2.1 time: 0.556584 Jun 16 14:41:46.218703 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 453/874] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:45 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1213 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:46.516806 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a4562f13-8bcc-4b58-a942-1ddb98a24e1e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:46.539528 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a4562f13-8bcc-4b58-a942-1ddb98a24e1e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1313 microversion: 2.1 time: 0.431781 Jun 16 14:41:46.543293 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 422/875] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:46 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:47.141542 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a9a1f7e4-bb3f-4e20-b2fd-7595b345b5b4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:47.143538 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a9a1f7e4-bb3f-4e20-b2fd-7595b345b5b4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:47.165329 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a9a1f7e4-bb3f-4e20-b2fd-7595b345b5b4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:47.166254 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a9a1f7e4-bb3f-4e20-b2fd-7595b345b5b4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:47.168588 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a9a1f7e4-bb3f-4e20-b2fd-7595b345b5b4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:47.169395 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a9a1f7e4-bb3f-4e20-b2fd-7595b345b5b4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:47.237206 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4a54a158-3eb9-4096-8bf4-8b7ff3ca06de tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:47.240319 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4a54a158-3eb9-4096-8bf4-8b7ff3ca06de tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:47.262616 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4a54a158-3eb9-4096-8bf4-8b7ff3ca06de tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:47.265672 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4a54a158-3eb9-4096-8bf4-8b7ff3ca06de tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:47.271433 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4a54a158-3eb9-4096-8bf4-8b7ff3ca06de tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:47.272349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4a54a158-3eb9-4096-8bf4-8b7ff3ca06de tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:47.506880 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-4a54a158-3eb9-4096-8bf4-8b7ff3ca06de tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:47.528715 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4a54a158-3eb9-4096-8bf4-8b7ff3ca06de tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1265 microversion: 2.1 time: 0.293983 Jun 16 14:41:47.549116 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 423/876] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:47 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1265 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:47.594485 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c7f6470a-b4df-48cd-8a24-25630dca498d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:47.615906 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c7f6470a-b4df-48cd-8a24-25630dca498d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:47.673352 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c7f6470a-b4df-48cd-8a24-25630dca498d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:47.674793 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c7f6470a-b4df-48cd-8a24-25630dca498d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:47.677599 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c7f6470a-b4df-48cd-8a24-25630dca498d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:47.678998 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c7f6470a-b4df-48cd-8a24-25630dca498d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:47.921729 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a9a1f7e4-bb3f-4e20-b2fd-7595b345b5b4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:47.949217 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a9a1f7e4-bb3f-4e20-b2fd-7595b345b5b4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:47.953896 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a9a1f7e4-bb3f-4e20-b2fd-7595b345b5b4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:47.960911 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a9a1f7e4-bb3f-4e20-b2fd-7595b345b5b4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1542 microversion: 2.25 time: 0.823378 Jun 16 14:41:47.961871 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 454/877] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:47 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1542 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:41:47.982432 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-90c6b36e-4791-4ca6-9bf6-3d592c8647d4 req-98cb903d-61ae-4878-8c56-c9bfc06929ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8ac858-0bec-476e-8bd5-0234b252a67f", "name": "network-vif-plugged", "status": "completed", "tag": "54c6b864-0c09-49b6-96ef-b067ca450425"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:48.014090 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-90c6b36e-4791-4ca6-9bf6-3d592c8647d4 req-98cb903d-61ae-4878-8c56-c9bfc06929ca service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:48.015060 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-90c6b36e-4791-4ca6-9bf6-3d592c8647d4 req-98cb903d-61ae-4878-8c56-c9bfc06929ca service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:48.042341 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-90c6b36e-4791-4ca6-9bf6-3d592c8647d4 req-98cb903d-61ae-4878-8c56-c9bfc06929ca service nova] Creating event network-vif-plugged:54c6b864-0c09-49b6-96ef-b067ca450425 for instance 4b8ac858-0bec-476e-8bd5-0234b252a67f on n-h2-836830-4 Jun 16 14:41:48.060430 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-90c6b36e-4791-4ca6-9bf6-3d592c8647d4 req-98cb903d-61ae-4878-8c56-c9bfc06929ca service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093274 Jun 16 14:41:48.063611 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 455/878] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:48.081220 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-40d3e95a-5cf5-4ff2-838c-0cfaba0882f3 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '.version_select at 0x7fdf0c336820>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:48.088030 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40d3e95a-5cf5-4ff2-838c-0cfaba0882f3 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:48.088768 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40d3e95a-5cf5-4ff2-838c-0cfaba0882f3 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:48.116102 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-40d3e95a-5cf5-4ff2-838c-0cfaba0882f3 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 2120 microversion: 2.25 time: 0.045841 Jun 16 14:41:48.131544 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 456/879] 10.222.0.57 () {60 vars in 1183 bytes} [Thu Jun 16 14:41:48 2022] GET /compute/v2.1/os-migrations => generated 2120 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:48.159618 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8772677b-d934-4ef2-bc5d-32fd5d11b3c5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:48.160614 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8772677b-d934-4ef2-bc5d-32fd5d11b3c5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:48.185528 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8772677b-d934-4ef2-bc5d-32fd5d11b3c5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:48.185528 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8772677b-d934-4ef2-bc5d-32fd5d11b3c5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:48.186805 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8772677b-d934-4ef2-bc5d-32fd5d11b3c5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:48.186805 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8772677b-d934-4ef2-bc5d-32fd5d11b3c5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:48.759494 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c7f6470a-b4df-48cd-8a24-25630dca498d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:48.817353 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c7f6470a-b4df-48cd-8a24-25630dca498d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1313 microversion: 2.1 time: 1.246950 Jun 16 14:41:48.825952 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 424/880] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:47 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1313 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:48.838639 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-8772677b-d934-4ef2-bc5d-32fd5d11b3c5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'services' on Instance uuid b7db7635-8f84-4337-b9ba-d84b8c36e787 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:41:48.840415 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-687dc177-c3e8-4760-9540-ace704f4d64d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:48.841305 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-687dc177-c3e8-4760-9540-ace704f4d64d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:48.852410 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-687dc177-c3e8-4760-9540-ace704f4d64d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:48.853158 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-687dc177-c3e8-4760-9540-ace704f4d64d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:48.854242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-687dc177-c3e8-4760-9540-ace704f4d64d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:48.856562 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-687dc177-c3e8-4760-9540-ace704f4d64d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:48.912589 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8772677b-d934-4ef2-bc5d-32fd5d11b3c5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 2035 microversion: 2.25 time: 0.778963 Jun 16 14:41:48.913644 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 457/881] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:48 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 2035 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:48.961782 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8fe7a62d-5b63-49af-bcff-f8de81fae81b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Action: 'create', calling method: .version_select at 0x7fdf0c2de700>, body: {"keypair": {"name": "tempest-keypair-420159285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIi98Fm1vZsLlxiQf/NEigwD8rrMYbW+Ey2TcnBwPRILmR1Lel0OlEtNC6P3rAh4uFoNtgrMtORXrhjCx1Uj7h6+FQatd8QMycFrDobCbbdg8sYCj3w5SUxp2blTQ90Wfg=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:48.992344 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-8fe7a62d-5b63-49af-bcff-f8de81fae81b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Getting quotas for project c04830ebf498422d9dddfbc009697728. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:41:49.005844 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-8fe7a62d-5b63-49af-bcff-f8de81fae81b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Getting quotas for user ab3aa4e887694a0e9a42bf6db6b01555 and project c04830ebf498422d9dddfbc009697728. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:41:49.073359 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8fe7a62d-5b63-49af-bcff-f8de81fae81b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.118601 Jun 16 14:41:49.085966 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 458/882] 10.222.0.57 () {62 vars in 1199 bytes} [Thu Jun 16 14:41:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 14:41:49.287897 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-687dc177-c3e8-4760-9540-ace704f4d64d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:49.301150 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-687dc177-c3e8-4760-9540-ace704f4d64d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1271 microversion: 2.1 time: 0.473486 Jun 16 14:41:49.302687 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 425/883] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:48 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1271 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:49.846305 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f03b1035-90df-4e3d-a154-885fd94b001f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:49.847183 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f03b1035-90df-4e3d-a154-885fd94b001f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:49.877927 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f03b1035-90df-4e3d-a154-885fd94b001f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:49.880104 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f03b1035-90df-4e3d-a154-885fd94b001f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:49.885138 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f03b1035-90df-4e3d-a154-885fd94b001f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:49.887921 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f03b1035-90df-4e3d-a154-885fd94b001f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:50.337959 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a5763dae-9afa-4ada-8fd6-7cd9585cda39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:50.345940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a5763dae-9afa-4ada-8fd6-7cd9585cda39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:50.379051 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5763dae-9afa-4ada-8fd6-7cd9585cda39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:50.380216 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5763dae-9afa-4ada-8fd6-7cd9585cda39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:50.381885 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5763dae-9afa-4ada-8fd6-7cd9585cda39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:50.382810 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5763dae-9afa-4ada-8fd6-7cd9585cda39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:51.076550 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a5763dae-9afa-4ada-8fd6-7cd9585cda39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:51.122168 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a5763dae-9afa-4ada-8fd6-7cd9585cda39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1313 microversion: 2.1 time: 0.793471 Jun 16 14:41:51.155084 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 426/884] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:50 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1313 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:51.224680 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f03b1035-90df-4e3d-a154-885fd94b001f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:51.262962 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f03b1035-90df-4e3d-a154-885fd94b001f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1313 microversion: 2.1 time: 1.423143 Jun 16 14:41:51.267538 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 459/885] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:49 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1313 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:52.156965 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c1fd7573-17d0-408e-859b-23f95e1af46f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:52.158091 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c1fd7573-17d0-408e-859b-23f95e1af46f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:52.193501 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c1fd7573-17d0-408e-859b-23f95e1af46f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:52.195549 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c1fd7573-17d0-408e-859b-23f95e1af46f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:52.195888 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c1fd7573-17d0-408e-859b-23f95e1af46f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:52.196854 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c1fd7573-17d0-408e-859b-23f95e1af46f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:52.300970 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f5f95a14-44ec-42ca-a14b-1f1437cb1a4f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:52.304507 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f5f95a14-44ec-42ca-a14b-1f1437cb1a4f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:52.347944 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f5f95a14-44ec-42ca-a14b-1f1437cb1a4f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:52.348764 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f5f95a14-44ec-42ca-a14b-1f1437cb1a4f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:52.365408 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f5f95a14-44ec-42ca-a14b-1f1437cb1a4f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:52.366484 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f5f95a14-44ec-42ca-a14b-1f1437cb1a4f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:52.835369 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c1fd7573-17d0-408e-859b-23f95e1af46f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:52.870200 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c1fd7573-17d0-408e-859b-23f95e1af46f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1313 microversion: 2.1 time: 0.717510 Jun 16 14:41:52.880747 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 427/886] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:52 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1313 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:52.923121 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f017573d-1ad9-4838-95c0-f1b6832a9617 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:52.924747 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f017573d-1ad9-4838-95c0-f1b6832a9617 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:52.965720 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f017573d-1ad9-4838-95c0-f1b6832a9617 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:52.967848 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f017573d-1ad9-4838-95c0-f1b6832a9617 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:52.970596 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f017573d-1ad9-4838-95c0-f1b6832a9617 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:52.971818 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f017573d-1ad9-4838-95c0-f1b6832a9617 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:53.069716 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f5f95a14-44ec-42ca-a14b-1f1437cb1a4f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:53.100771 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f5f95a14-44ec-42ca-a14b-1f1437cb1a4f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1462 microversion: 2.1 time: 0.811280 Jun 16 14:41:53.114111 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 460/887] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:52 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1462 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:53.149964 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ed5ababc-e1e5-4740-b0fc-2d51fe340005 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:53.153154 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ed5ababc-e1e5-4740-b0fc-2d51fe340005 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:53.175961 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ed5ababc-e1e5-4740-b0fc-2d51fe340005 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:53.181843 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ed5ababc-e1e5-4740-b0fc-2d51fe340005 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:53.184368 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ed5ababc-e1e5-4740-b0fc-2d51fe340005 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:53.185529 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ed5ababc-e1e5-4740-b0fc-2d51fe340005 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:53.605313 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ed5ababc-e1e5-4740-b0fc-2d51fe340005 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:53.619386 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ed5ababc-e1e5-4740-b0fc-2d51fe340005 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1461 microversion: 2.1 time: 0.473384 Jun 16 14:41:53.630814 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 461/888] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:53 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1461 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:53.824686 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f017573d-1ad9-4838-95c0-f1b6832a9617 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1858 microversion: 2.1 time: 0.941543 Jun 16 14:41:53.826150 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 428/889] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:52 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1858 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:53.860867 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-25b0b0ad-49d2-4dcd-ad88-d1bc76877781 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-4", "block_migration": true, "disk_over_commit": false}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:53.867329 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-25b0b0ad-49d2-4dcd-ad88-d1bc76877781 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:53.894758 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25b0b0ad-49d2-4dcd-ad88-d1bc76877781 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:53.895689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25b0b0ad-49d2-4dcd-ad88-d1bc76877781 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:53.897179 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25b0b0ad-49d2-4dcd-ad88-d1bc76877781 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:53.902657 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25b0b0ad-49d2-4dcd-ad88-d1bc76877781 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:54.013276 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-25b0b0ad-49d2-4dcd-ad88-d1bc76877781 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lazy-loading 'flavor' on Instance uuid e8cb64d6-b915-425c-aed2-442d3e2a1676 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:41:54.027416 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:54.058981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-25b0b0ad-49d2-4dcd-ad88-d1bc76877781 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Going to try to live migrate instance to n-h2-836830-4 {{(pid=125862) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 14:41:54.127326 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bfb22d55-c2d5-404f-84bd-936de451a63c tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-830146894", "id": 329793109, "os-flavor-access:is_public": "False"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:54.130922 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:41:54.130922 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:41:54.166102 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bfb22d55-c2d5-404f-84bd-936de451a63c tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.533983 Jun 16 14:41:54.175101 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 462/890] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:41:53 2022] POST /compute/v2.1/flavors => generated 435 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:54.413571 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cb1a9621-855b-4ddf-bb0a-b5f9d0026368 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'create', calling method: .version_select at 0x7fdf0c1e8d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1280787791", "description": "tempest-description-2067069509"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:54.641785 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=8 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:55.068809 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cb1a9621-855b-4ddf-bb0a-b5f9d0026368 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.891366 Jun 16 14:41:55.069981 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 463/891] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:41:54 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:55.082210 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-915891b1-1e1e-4b4b-a0e5-a199ba4ca5b1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:55.094705 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-915891b1-1e1e-4b4b-a0e5-a199ba4ca5b1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:55.132441 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-915891b1-1e1e-4b4b-a0e5-a199ba4ca5b1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:55.138429 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-915891b1-1e1e-4b4b-a0e5-a199ba4ca5b1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:55.142201 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-915891b1-1e1e-4b4b-a0e5-a199ba4ca5b1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:55.144367 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-915891b1-1e1e-4b4b-a0e5-a199ba4ca5b1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:55.511940 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-915891b1-1e1e-4b4b-a0e5-a199ba4ca5b1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:55.542297 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-915891b1-1e1e-4b4b-a0e5-a199ba4ca5b1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1313 microversion: 2.1 time: 0.470057 Jun 16 14:41:55.544913 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 464/892] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:55 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:55.590100 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-186208674", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f04e1cd2-656b-4de4-a784-ad2239f926bb"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:55.770927 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:41:56.501450 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:41:56.502841 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:41:56.503103 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:41:56.503652 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:41:56.506589 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:41:56.532195 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:56.535400 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:56.536786 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:56.537378 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:56.553544 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:56.595174 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Getting quotas for project b50858433c774049b7c3fe4a4f98e948. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:41:56.603987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Getting quotas for user 23594325f9174f3a80dd744eaaaba379 and project b50858433c774049b7c3fe4a4f98e948. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:41:56.641041 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:41:56.647004 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:41:56.769473 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-08221bc7-4af6-4ff5-b6dc-2e784546361f tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.190757 Jun 16 14:41:56.774195 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 465/893] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:41:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:41:56.782758 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-46fbcb2f-df28-481f-8144-80ee0345a295 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d66bec30617843b9a56fd924095481f5"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:56.784802 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:41:56.784802 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:41:57.097933 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-46fbcb2f-df28-481f-8144-80ee0345a295 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/329793109/action" status: 200 len: 96 microversion: 2.1 time: 0.321777 Jun 16 14:41:57.105168 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 466/894] 10.222.0.57 () {60 vars in 1196 bytes} [Thu Jun 16 14:41:56 2022] POST /compute/v2.1/flavors/329793109/action => generated 96 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:41:57.267128 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-9ab13a8c-996d-45d1-b8eb-0613fdef8498 req-8d265869-fed4-4e76-bd6e-4d9b7073f78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2e2338-dec8-4753-a740-584fb8e9c439", "tag": "91c43310-3cd5-422d-9c57-aa5e15664ff8"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:57.318045 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-9ab13a8c-996d-45d1-b8eb-0613fdef8498 req-8d265869-fed4-4e76-bd6e-4d9b7073f78e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:57.319891 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-9ab13a8c-996d-45d1-b8eb-0613fdef8498 req-8d265869-fed4-4e76-bd6e-4d9b7073f78e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:57.415281 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-9ab13a8c-996d-45d1-b8eb-0613fdef8498 req-8d265869-fed4-4e76-bd6e-4d9b7073f78e service nova] Creating event network-changed:91c43310-3cd5-422d-9c57-aa5e15664ff8 for instance 5b2e2338-dec8-4753-a740-584fb8e9c439 on n-h1-836830-4 Jun 16 14:41:57.448436 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-9ab13a8c-996d-45d1-b8eb-0613fdef8498 req-8d265869-fed4-4e76-bd6e-4d9b7073f78e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.338374 Jun 16 14:41:57.456641 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 467/895] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:57.469727 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-25b0b0ad-49d2-4dcd-ad88-d1bc76877781 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/action" status: 202 len: 0 microversion: 2.1 time: 3.630251 Jun 16 14:41:57.470929 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 429/896] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:41:53 2022] POST /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/action => generated 0 bytes in 3633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 14:41:57.477204 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1093957798", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "174724bb-1f38-4b2e-afaf-aad767c219ae"}], "security_groups": [{"name": "tempest-securitygroup--1658638377"}], "key_name": "tempest-keypair-420159285", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:57.483490 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bbca6964-9a2a-4dbb-a11e-6cc905722bbd tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'create', calling method: .version_select at 0x7fdf0c43f550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1664809860", "description": "tempest-description-937123124"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:57.746003 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] validate_networks() for [('174724bb-1f38-4b2e-afaf-aad767c219ae', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:41:57.792901 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bbca6964-9a2a-4dbb-a11e-6cc905722bbd tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.326414 Jun 16 14:41:57.798780 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 468/897] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:41:57 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:41:57.821563 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ea11e9e5-5e94-4e71-88e5-aeb7d1aed2db tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:57.827878 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ea11e9e5-5e94-4e71-88e5-aeb7d1aed2db tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:57.847351 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ea11e9e5-5e94-4e71-88e5-aeb7d1aed2db tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:57.848316 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ea11e9e5-5e94-4e71-88e5-aeb7d1aed2db tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:57.849802 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ea11e9e5-5e94-4e71-88e5-aeb7d1aed2db tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:57.850527 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ea11e9e5-5e94-4e71-88e5-aeb7d1aed2db tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:58.184607 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ea11e9e5-5e94-4e71-88e5-aeb7d1aed2db tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:58.203267 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ea11e9e5-5e94-4e71-88e5-aeb7d1aed2db tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1313 microversion: 2.1 time: 0.397307 Jun 16 14:41:58.215486 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 469/898] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:57 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:58.228751 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3de2454c-0716-415d-910a-33d0476438fe tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:58.229976 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3de2454c-0716-415d-910a-33d0476438fe tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:58.256353 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3de2454c-0716-415d-910a-33d0476438fe tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:58.277269 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3de2454c-0716-415d-910a-33d0476438fe tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:58.278229 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3de2454c-0716-415d-910a-33d0476438fe tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:58.278870 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3de2454c-0716-415d-910a-33d0476438fe tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:58.432291 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3de2454c-0716-415d-910a-33d0476438fe tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:58.447596 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3de2454c-0716-415d-910a-33d0476438fe tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1217 microversion: 2.1 time: 0.230117 Jun 16 14:41:58.448733 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 470/899] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:58 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1217 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:58.471661 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a581e350-8878-4c6f-803b-9bdfa0eccaa3 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d66bec30617843b9a56fd924095481f5"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:58.473430 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:41:58.473430 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:41:58.587677 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-a581e350-8878-4c6f-803b-9bdfa0eccaa3 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project d66bec30617843b9a56fd924095481f5 combination. Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a581e350-8878-4c6f-803b-9bdfa0eccaa3 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Request method failure captured: Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/flavors/329793109/action HTTP/1.1 Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 67 Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0EvU_IZTLU48L4_UFiDOampDJU4dr1jro8EJQJfVP1NlxDgIEd13bUXqSIkpknDxRWySHIQzeDSZ_K4ZfnkMxXUl0lRnauMdY5_FLUyDkFifs-Rj0M5kueBIMUsg6-t2nnvS1b4Qp89dILNneaEOohM8y6Xo22RDbdb5zyjgkLpJ0Q Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: fbdc21c52a3b4f85ad21ed617f7037d7 Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1840404452 Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:41:58.597145 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:41:58.600594 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fbdc21c52a3b4f85ad21ed617f7037d7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbdc21c52a3b4f85ad21ed617f7037d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbdc21c52a3b4f85ad21ed617f7037d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fbdc21c52a3b4f85ad21ed617f7037d7"}]}] Jun 16 14:41:58.600594 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1840404452 Jun 16 14:41:58.600594 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: fbdc21c52a3b4f85ad21ed617f7037d7 Jun 16 14:41:58.600594 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1840404452 Jun 16 14:41:58.600594 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin Jun 16 14:41:58.600594 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:58.600594 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:58.600594 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 4610bbfe9f9942dab59003c62bf11e42 Jun 16 14:41:58.600594 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin Jun 16 14:41:58.600594 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:41:58.600594 n-d-836830-4 devstack@n-api.service[125863]: {"addTenantAccess": {"tenant": "d66bec30617843b9a56fd924095481f5"}} Jun 16 14:41:58.600594 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: exception: Flavor access already exists for flavor 35 and project d66bec30617843b9a56fd924095481f5 combination. Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '329793109', 'body': {'addTenantAccess': {'tenant': 'd66bec30617843b9a56fd924095481f5'}}} Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result.read() Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:41:58.602312 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '35-d66bec30617843b9a56fd924095481f5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi project.save(context.session) Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi session.flush() Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 14:41:58.604921 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 14:41:58.608310 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:41:58.610695 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result.read() Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '35-d66bec30617843b9a56fd924095481f5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 16, 14, 41, 58, 575627), 'updated_at': None, 'flavor_id': 35, 'project_id': 'd66bec30617843b9a56fd924095481f5'}] Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:58.616660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 35 and project d66bec30617843b9a56fd924095481f5 combination. Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:58.619870 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 35 and project d66bec30617843b9a56fd924095481f5 combination. Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:58.624998 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:58.629706 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 35 and project d66bec30617843b9a56fd924095481f5 combination. Jun 16 14:41:58.629706 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:58.629706 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a581e350-8878-4c6f-803b-9bdfa0eccaa3 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project d66bec30617843b9a56fd924095481f5 combination. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:58.636017 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a581e350-8878-4c6f-803b-9bdfa0eccaa3 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/329793109/action" status: 409 len: 152 microversion: 2.1 time: 0.164120 Jun 16 14:41:58.636017 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 471/900] 10.222.0.57 () {60 vars in 1196 bytes} [Thu Jun 16 14:41:58 2022] POST /compute/v2.1/flavors/329793109/action => generated 152 bytes in 183 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:41:58.646243 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-32c59a08-f8e4-49fa-95e0-6142e14b61cb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:58.647235 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-32c59a08-f8e4-49fa-95e0-6142e14b61cb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:58.659655 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-32c59a08-f8e4-49fa-95e0-6142e14b61cb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:58.660487 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-32c59a08-f8e4-49fa-95e0-6142e14b61cb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:58.661971 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-32c59a08-f8e4-49fa-95e0-6142e14b61cb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:58.662847 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-32c59a08-f8e4-49fa-95e0-6142e14b61cb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:58.695050 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-32c59a08-f8e4-49fa-95e0-6142e14b61cb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] HTTP exception thrown: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-32c59a08-f8e4-49fa-95e0-6142e14b61cb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Request method failure captured: Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c HTTP/1.1 Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0A-bcugIvDatzXWCfCLXGx29JiNmsWRIBV9Ya1siGKaOwewPCJtQVCpp3Xtl43tvLfTWHMPDJb5cg7VcmbdTMBnTyA-vM67JrEFI1JZZslibtjTnkGBFcVMMzfk_u61UgPna4uIVHjMip08-O3dhwSBrRNI3ND2nw-4E2y-BbSbCtU Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: c686fc6c846f444b9c3c8790028ad694 Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2057017494 Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:41:58.698334 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:41:58.699890 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c686fc6c846f444b9c3c8790028ad694", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c686fc6c846f444b9c3c8790028ad694"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c686fc6c846f444b9c3c8790028ad694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c686fc6c846f444b9c3c8790028ad694"}]}] Jun 16 14:41:58.699890 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2057017494 Jun 16 14:41:58.699890 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: c686fc6c846f444b9c3c8790028ad694 Jun 16 14:41:58.699890 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2057017494 Jun 16 14:41:58.699890 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-AttachSCSIVolumeTestJSON-2057017494-project Jun 16 14:41:58.699890 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:58.699890 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:58.699890 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 848a67571a4e4eb5a21d5f4502b35cb4 Jun 16 14:41:58.699890 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2057017494-project Jun 16 14:41:58.699890 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:41:58.699890 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. Jun 16 14:41:58.699890 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'e7771166-9bbf-41d0-b3ca-b4515a46a67c'} Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:58.700726 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. Jun 16 14:41:58.702279 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:58.706992 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-32c59a08-f8e4-49fa-95e0-6142e14b61cb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Returning 404 to user: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:58.708299 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-32c59a08-f8e4-49fa-95e0-6142e14b61cb tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 404 len: 111 microversion: 2.1 time: 0.074508 Jun 16 14:41:58.709559 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 472/901] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:41:58 2022] DELETE /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:41:58.722946 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d36692bb-c5b5-4a9e-96c4-63fd14d91444 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:58.724428 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d36692bb-c5b5-4a9e-96c4-63fd14d91444 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:58.736762 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d36692bb-c5b5-4a9e-96c4-63fd14d91444 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:58.738044 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d36692bb-c5b5-4a9e-96c4-63fd14d91444 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:58.739749 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d36692bb-c5b5-4a9e-96c4-63fd14d91444 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:58.740713 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d36692bb-c5b5-4a9e-96c4-63fd14d91444 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:58.753056 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:41:58.755103 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:41:58.755865 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:41:58.756933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:41:58.758065 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:41:58.773071 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:58.773928 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:58.774981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:58.775624 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:58.804720 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Getting quotas for project c04830ebf498422d9dddfbc009697728. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:41:58.812485 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Getting quotas for user ab3aa4e887694a0e9a42bf6db6b01555 and project c04830ebf498422d9dddfbc009697728. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:41:58.830563 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:41:58.833824 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:41:58.906915 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d5d1f492-6b30-4bb0-a84f-4583968de32f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.434546 Jun 16 14:41:58.912040 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 430/902] 10.222.0.57 () {62 vars in 1187 bytes} [Thu Jun 16 14:41:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1440 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 14:41:58.920977 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-618682526", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "3e7fbc44-6cdd-4ced-8daa-54aa6f771c70"}]}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:58.956866 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d36692bb-c5b5-4a9e-96c4-63fd14d91444 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:58.972006 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d36692bb-c5b5-4a9e-96c4-63fd14d91444 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.257113 Jun 16 14:41:58.973563 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 473/903] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:58 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:41:58.980541 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-75dd8f2d-1c9c-4214-bb88-15916f8ca043 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d66bec30617843b9a56fd924095481f5"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:41:58.984485 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:41:58.984485 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:41:59.021738 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] validate_networks() for [('3e7fbc44-6cdd-4ced-8daa-54aa6f771c70', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:41:59.147143 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-75dd8f2d-1c9c-4214-bb88-15916f8ca043 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/329793109/action" status: 200 len: 21 microversion: 2.1 time: 0.171723 Jun 16 14:41:59.148378 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 474/904] 10.222.0.57 () {60 vars in 1196 bytes} [Thu Jun 16 14:41:58 2022] POST /compute/v2.1/flavors/329793109/action => generated 21 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:41:59.156332 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-724aa6d8-1d4b-4416-af33-915a5b0c3256 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:59.157579 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-724aa6d8-1d4b-4416-af33-915a5b0c3256 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] [instance: e7771166-9bbf-41d0-b3ca-b4515a46a67c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:59.169862 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-724aa6d8-1d4b-4416-af33-915a5b0c3256 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:59.170334 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-724aa6d8-1d4b-4416-af33-915a5b0c3256 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:59.171184 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-724aa6d8-1d4b-4416-af33-915a5b0c3256 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:59.175923 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-724aa6d8-1d4b-4416-af33-915a5b0c3256 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:59.198941 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-724aa6d8-1d4b-4416-af33-915a5b0c3256 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] HTTP exception thrown: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-724aa6d8-1d4b-4416-af33-915a5b0c3256 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Request method failure captured: Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c HTTP/1.1 Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0A-bcugIvDatzXWCfCLXGx29JiNmsWRIBV9Ya1siGKaOwewPCJtQVCpp3Xtl43tvLfTWHMPDJb5cg7VcmbdTMBnTyA-vM67JrEFI1JZZslibtjTnkGBFcVMMzfk_u61UgPna4uIVHjMip08-O3dhwSBrRNI3ND2nw-4E2y-BbSbCtU Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: c686fc6c846f444b9c3c8790028ad694 Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2057017494 Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:41:59.200171 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:41:59.202744 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c686fc6c846f444b9c3c8790028ad694", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c686fc6c846f444b9c3c8790028ad694"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c686fc6c846f444b9c3c8790028ad694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c686fc6c846f444b9c3c8790028ad694"}]}] Jun 16 14:41:59.202744 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2057017494 Jun 16 14:41:59.202744 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: c686fc6c846f444b9c3c8790028ad694 Jun 16 14:41:59.202744 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2057017494 Jun 16 14:41:59.202744 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-AttachSCSIVolumeTestJSON-2057017494-project Jun 16 14:41:59.202744 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:41:59.202744 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:41:59.202744 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 848a67571a4e4eb5a21d5f4502b35cb4 Jun 16 14:41:59.202744 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2057017494-project Jun 16 14:41:59.202744 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:41:59.202744 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. Jun 16 14:41:59.202744 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'e7771166-9bbf-41d0-b3ca-b4515a46a67c'} Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:41:59.203535 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. Jun 16 14:41:59.206420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:41:59.209012 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-724aa6d8-1d4b-4416-af33-915a5b0c3256 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] Returning 404 to user: Instance e7771166-9bbf-41d0-b3ca-b4515a46a67c could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:41:59.209012 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-724aa6d8-1d4b-4416-af33-915a5b0c3256 tempest-AttachSCSIVolumeTestJSON-2057017494 tempest-AttachSCSIVolumeTestJSON-2057017494-project] 10.222.0.57 "GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c" status: 404 len: 111 microversion: 2.1 time: 0.054923 Jun 16 14:41:59.209012 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 475/905] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:59 2022] GET /compute/v2.1/servers/e7771166-9bbf-41d0-b3ca-b4515a46a67c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:41:59.210272 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5976871a-9efe-4c55-a922-474b1b5cf56d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:59.212147 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5976871a-9efe-4c55-a922-474b1b5cf56d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:59.233175 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=7 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:41:59.350153 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5976871a-9efe-4c55-a922-474b1b5cf56d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:59.366356 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5976871a-9efe-4c55-a922-474b1b5cf56d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:59.368635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5976871a-9efe-4c55-a922-474b1b5cf56d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:59.370992 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5976871a-9efe-4c55-a922-474b1b5cf56d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1285 microversion: 2.25 time: 0.164780 Jun 16 14:41:59.371885 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 476/906] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:41:59 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:41:59.379704 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0917e5d1-9835-4f89-a179-a7e3bf444c2b tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:59.380933 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:41:59.380933 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:41:59.415811 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0917e5d1-9835-4f89-a179-a7e3bf444c2b tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/329793109" status: 202 len: 0 microversion: 2.1 time: 0.040472 Jun 16 14:41:59.418164 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 477/907] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:41:59 2022] DELETE /compute/v2.1/flavors/329793109 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:41:59.426414 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-07b8fbe3-f928-4f17-8817-7edde890b878 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:41:59.427769 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-07b8fbe3-f928-4f17-8817-7edde890b878 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:41:59.443106 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-07b8fbe3-f928-4f17-8817-7edde890b878 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:59.446694 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-07b8fbe3-f928-4f17-8817-7edde890b878 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:59.448182 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-07b8fbe3-f928-4f17-8817-7edde890b878 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:41:59.449993 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-07b8fbe3-f928-4f17-8817-7edde890b878 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:41:59.969693 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-07b8fbe3-f928-4f17-8817-7edde890b878 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:41:59.980128 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-07b8fbe3-f928-4f17-8817-7edde890b878 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1313 microversion: 2.1 time: 0.560355 Jun 16 14:41:59.986430 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 478/908] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:41:59 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:00.015003 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0fb2c4db-a438-49ff-988a-0bafaf8ee836 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:00.064606 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0fb2c4db-a438-49ff-988a-0bafaf8ee836 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075143 Jun 16 14:42:00.096776 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 479/909] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:41:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:00.119098 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ab344ae5-e35a-4d60-a01f-5647aaa83bba tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:00.124064 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ab344ae5-e35a-4d60-a01f-5647aaa83bba tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:00.138136 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ab344ae5-e35a-4d60-a01f-5647aaa83bba tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:00.139338 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ab344ae5-e35a-4d60-a01f-5647aaa83bba tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:00.140475 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ab344ae5-e35a-4d60-a01f-5647aaa83bba tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:00.141280 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ab344ae5-e35a-4d60-a01f-5647aaa83bba tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:00.347422 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ab344ae5-e35a-4d60-a01f-5647aaa83bba tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:00.399085 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ab344ae5-e35a-4d60-a01f-5647aaa83bba tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1265 microversion: 2.1 time: 0.300246 Jun 16 14:42:00.412017 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 480/910] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:00 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1265 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:00.421180 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bf3908f6-979d-4fef-b616-fd3b176d68ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:00.430725 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bf3908f6-979d-4fef-b616-fd3b176d68ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:00.445932 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bf3908f6-979d-4fef-b616-fd3b176d68ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:00.447231 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bf3908f6-979d-4fef-b616-fd3b176d68ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:00.448354 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bf3908f6-979d-4fef-b616-fd3b176d68ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:00.448972 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bf3908f6-979d-4fef-b616-fd3b176d68ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:00.477765 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:42:00.478694 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:42:00.479189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:42:00.479793 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:42:00.480327 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:42:00.502335 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:00.502828 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:00.504960 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:00.505438 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:00.539664 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Getting quotas for project 070acceac9dc494481baedda1baf5740. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:42:00.547060 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Getting quotas for user 9669878ef64c4cb982dee4369c88e832 and project 070acceac9dc494481baedda1baf5740. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:42:00.583997 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:42:00.588176 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:42:00.756085 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a9c0bcaf-46fc-4dc8-b9b5-80bf6b77aa6b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.839750 Jun 16 14:42:00.763404 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 431/911] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:41:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:42:00.775430 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d463d103-04ff-4c56-89f9-1365170242df tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-39689851", "id": 845277730, "os-flavor-access:is_public": "True"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:00.777512 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:42:00.777512 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:42:00.827510 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d463d103-04ff-4c56-89f9-1365170242df tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.057157 Jun 16 14:42:00.832235 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 432/912] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:42:00 2022] POST /compute/v2.1/flavors => generated 433 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:00.841351 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fe3798a6-715f-46aa-bf26-0076d2f572b1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:00.842713 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fe3798a6-715f-46aa-bf26-0076d2f572b1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:00.852018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fe3798a6-715f-46aa-bf26-0076d2f572b1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:00.853360 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fe3798a6-715f-46aa-bf26-0076d2f572b1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:00.854802 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fe3798a6-715f-46aa-bf26-0076d2f572b1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:00.855461 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fe3798a6-715f-46aa-bf26-0076d2f572b1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:01.027491 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fe3798a6-715f-46aa-bf26-0076d2f572b1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:01.056586 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fe3798a6-715f-46aa-bf26-0076d2f572b1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:01.067924 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fe3798a6-715f-46aa-bf26-0076d2f572b1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:01.071138 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fe3798a6-715f-46aa-bf26-0076d2f572b1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1337 microversion: 2.25 time: 0.234893 Jun 16 14:42:01.072900 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 433/913] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:42:00 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1337 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:01.112343 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c56293fb-bafb-4379-9cf7-4ef61fbc38bb tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:01.115927 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c56293fb-bafb-4379-9cf7-4ef61fbc38bb tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:01.280260 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c56293fb-bafb-4379-9cf7-4ef61fbc38bb tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:01.292530 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c56293fb-bafb-4379-9cf7-4ef61fbc38bb tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 200 len: 1215 microversion: 2.1 time: 0.214763 Jun 16 14:42:01.294837 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 434/914] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:01 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:01.300527 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2bf92538-ced6-4a5c-a41a-b4e72e178f19 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:01.302719 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:42:01.302719 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:42:01.313991 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-2bf92538-ced6-4a5c-a41a-b4e72e178f19 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] HTTP exception thrown: Access list not available for public flavors. Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2bf92538-ced6-4a5c-a41a-b4e72e178f19 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Request method failure captured: Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/flavors/845277730/os-flavor-access HTTP/1.1 Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0EvU_IZTLU48L4_UFiDOampDJU4dr1jro8EJQJfVP1NlxDgIEd13bUXqSIkpknDxRWySHIQzeDSZ_K4ZfnkMxXUl0lRnauMdY5_FLUyDkFifs-Rj0M5kueBIMUsg6-t2nnvS1b4Qp89dILNneaEOohM8y6Xo22RDbdb5zyjgkLpJ0Q Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: fbdc21c52a3b4f85ad21ed617f7037d7 Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1840404452 Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:42:01.317505 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:42:01.319011 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fbdc21c52a3b4f85ad21ed617f7037d7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbdc21c52a3b4f85ad21ed617f7037d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbdc21c52a3b4f85ad21ed617f7037d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fbdc21c52a3b4f85ad21ed617f7037d7"}]}] Jun 16 14:42:01.319011 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1840404452 Jun 16 14:42:01.319011 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: fbdc21c52a3b4f85ad21ed617f7037d7 Jun 16 14:42:01.319011 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1840404452 Jun 16 14:42:01.319011 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin Jun 16 14:42:01.319011 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:42:01.319011 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:42:01.319011 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 4610bbfe9f9942dab59003c62bf11e42 Jun 16 14:42:01.319011 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin Jun 16 14:42:01.319011 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:42:01.319011 n-d-836830-4 devstack@n-api.service[125862]: exception: Access list not available for public flavors. Jun 16 14:42:01.319011 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'flavor_id': '845277730'} Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jun 16 14:42:01.319754 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:01.324100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2bf92538-ced6-4a5c-a41a-b4e72e178f19 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:42:01.325768 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2bf92538-ced6-4a5c-a41a-b4e72e178f19 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/845277730/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.029730 Jun 16 14:42:01.327219 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 435/915] 10.222.0.57 () {58 vars in 1205 bytes} [Thu Jun 16 14:42:01 2022] GET /compute/v2.1/flavors/845277730/os-flavor-access => generated 91 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:42:01.340409 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c75f574d-bd4c-4368-83f9-9e2fb3a97e02 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:01.342052 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c75f574d-bd4c-4368-83f9-9e2fb3a97e02 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:01.370743 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c75f574d-bd4c-4368-83f9-9e2fb3a97e02 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:01.371230 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c75f574d-bd4c-4368-83f9-9e2fb3a97e02 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:01.373904 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c75f574d-bd4c-4368-83f9-9e2fb3a97e02 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:01.374648 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c75f574d-bd4c-4368-83f9-9e2fb3a97e02 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:01.683205 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bf3908f6-979d-4fef-b616-fd3b176d68ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:01.706024 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bf3908f6-979d-4fef-b616-fd3b176d68ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 1.292325 Jun 16 14:42:01.717795 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 481/916] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:00 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:01.723957 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-96a070f9-4979-47f5-837e-d134b9236a17 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:01.725068 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:42:01.725068 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:42:01.737910 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c75f574d-bd4c-4368-83f9-9e2fb3a97e02 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:01.758710 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-96a070f9-4979-47f5-837e-d134b9236a17 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/845277730" status: 202 len: 0 microversion: 2.1 time: 0.039066 Jun 16 14:42:01.759675 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 482/917] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:42:01 2022] DELETE /compute/v2.1/flavors/845277730 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:42:01.764081 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c75f574d-bd4c-4368-83f9-9e2fb3a97e02 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1313 microversion: 2.1 time: 0.435019 Jun 16 14:42:01.765510 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 436/918] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:01 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:01.766465 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-eb7862dd-4a67-4b17-b076-037556fddcd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:01.767569 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-eb7862dd-4a67-4b17-b076-037556fddcd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:01.775706 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb7862dd-4a67-4b17-b076-037556fddcd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:01.776427 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb7862dd-4a67-4b17-b076-037556fddcd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:01.777420 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb7862dd-4a67-4b17-b076-037556fddcd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:01.778614 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb7862dd-4a67-4b17-b076-037556fddcd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:01.802872 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-214d8f46-06e6-4c86-8d7f-8163e3aaf757 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:01.898065 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-214d8f46-06e6-4c86-8d7f-8163e3aaf757 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.117588 Jun 16 14:42:01.900013 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 437/919] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:42:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:01.918110 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8b82c789-72ba-4c33-9427-8e2763753118 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-432671477", "id": 1972101091, "os-flavor-access:is_public": "False"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:01.921565 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:42:01.921565 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:42:01.952653 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8b82c789-72ba-4c33-9427-8e2763753118 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.039892 Jun 16 14:42:01.959184 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 438/920] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:42:01 2022] POST /compute/v2.1/flavors => generated 438 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:02.089319 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-eb7862dd-4a67-4b17-b076-037556fddcd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:02.106108 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-eb7862dd-4a67-4b17-b076-037556fddcd4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1271 microversion: 2.1 time: 0.344459 Jun 16 14:42:02.118833 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 483/921] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:01 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1271 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:02.125144 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-315adbac-e0df-4e18-96de-7fc8e329d1f8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:02.126173 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-315adbac-e0df-4e18-96de-7fc8e329d1f8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:02.135767 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-315adbac-e0df-4e18-96de-7fc8e329d1f8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:02.136223 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-315adbac-e0df-4e18-96de-7fc8e329d1f8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:02.137053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-315adbac-e0df-4e18-96de-7fc8e329d1f8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:02.141649 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-315adbac-e0df-4e18-96de-7fc8e329d1f8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:02.234966 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-29ce4693-f6dc-4b70-831e-4ecae60553dd tempest-FlavorsAccessNegativeTestJSON-1888197758 tempest-FlavorsAccessNegativeTestJSON-1888197758-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d66bec30617843b9a56fd924095481f5"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:02.236540 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:42:02.236540 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:42:02.237933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-29ce4693-f6dc-4b70-831e-4ecae60553dd tempest-FlavorsAccessNegativeTestJSON-1888197758 tempest-FlavorsAccessNegativeTestJSON-1888197758-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '5d7ede65a2d3419b88de8f2083ea6646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bec30617843b9a56fd924095481f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-29ce4693-f6dc-4b70-831e-4ecae60553dd tempest-FlavorsAccessNegativeTestJSON-1888197758 tempest-FlavorsAccessNegativeTestJSON-1888197758-project] Request method failure captured: Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/flavors/1972101091/action HTTP/1.1 Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 67 Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0EtbOHAMGUcXrhKCal2FcNM48BDvMHB2XF-q0wbSkSzaVFTvbk7x8JzcOD223L9t7yPS124UJSbn0V90w9nnaqMah9NiwVzlaeMqYa4P5-SrLNUvVF6X9M9ORdQJvJGj-jRrbSt87puA4c82q6Xu_2HE69rKKQ83XErUM0C2aegPIM Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: d66bec30617843b9a56fd924095481f5 Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1888197758 Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:42:02.240185 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:42:02.241910 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d66bec30617843b9a56fd924095481f5", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d66bec30617843b9a56fd924095481f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d66bec30617843b9a56fd924095481f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d66bec30617843b9a56fd924095481f5"}]}] Jun 16 14:42:02.241910 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1888197758 Jun 16 14:42:02.241910 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: d66bec30617843b9a56fd924095481f5 Jun 16 14:42:02.241910 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1888197758 Jun 16 14:42:02.241910 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-FlavorsAccessNegativeTestJSON-1888197758-project Jun 16 14:42:02.241910 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:42:02.241910 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:42:02.241910 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 5d7ede65a2d3419b88de8f2083ea6646 Jun 16 14:42:02.241910 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1888197758-project Jun 16 14:42:02.241910 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:42:02.241910 n-d-836830-4 devstack@n-api.service[125862]: {"addTenantAccess": {"tenant": "d66bec30617843b9a56fd924095481f5"}} Jun 16 14:42:02.241910 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '1972101091', 'body': {'addTenantAccess': {'tenant': 'd66bec30617843b9a56fd924095481f5'}}} Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:42:02.242857 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 16 14:42:02.244371 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:02.247704 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-29ce4693-f6dc-4b70-831e-4ecae60553dd tempest-FlavorsAccessNegativeTestJSON-1888197758 tempest-FlavorsAccessNegativeTestJSON-1888197758-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:42:02.249472 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-29ce4693-f6dc-4b70-831e-4ecae60553dd tempest-FlavorsAccessNegativeTestJSON-1888197758 tempest-FlavorsAccessNegativeTestJSON-1888197758-project] 10.222.0.57 "POST /compute/v2.1/flavors/1972101091/action" status: 403 len: 130 microversion: 2.1 time: 0.284527 Jun 16 14:42:02.256206 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 439/922] 10.222.0.57 () {60 vars in 1199 bytes} [Thu Jun 16 14:42:01 2022] POST /compute/v2.1/flavors/1972101091/action => generated 130 bytes in 293 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:42:02.266553 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2d35922c-3883-42bb-8d65-6e5da0a9f9a9 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:02.268304 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:42:02.268304 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:42:02.288339 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-315adbac-e0df-4e18-96de-7fc8e329d1f8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:02.299180 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-315adbac-e0df-4e18-96de-7fc8e329d1f8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:02.301478 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-315adbac-e0df-4e18-96de-7fc8e329d1f8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:02.303596 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-315adbac-e0df-4e18-96de-7fc8e329d1f8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1343 microversion: 2.25 time: 0.183223 Jun 16 14:42:02.304868 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 484/923] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:42:02 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1343 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:02.305583 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2d35922c-3883-42bb-8d65-6e5da0a9f9a9 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1972101091" status: 202 len: 0 microversion: 2.1 time: 0.046577 Jun 16 14:42:02.306342 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 440/924] 10.222.0.57 () {58 vars in 1160 bytes} [Thu Jun 16 14:42:02 2022] DELETE /compute/v2.1/flavors/1972101091 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:42:02.327796 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e88242e7-fe4b-4c8e-b711-abf56da7c3bf tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:02.329411 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e88242e7-fe4b-4c8e-b711-abf56da7c3bf tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:02.331351 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-38b458bd-2caa-4732-8b88-65b3e7adaed4 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:02.340160 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e88242e7-fe4b-4c8e-b711-abf56da7c3bf tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:02.340800 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e88242e7-fe4b-4c8e-b711-abf56da7c3bf tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:02.345193 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e88242e7-fe4b-4c8e-b711-abf56da7c3bf tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:02.346687 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e88242e7-fe4b-4c8e-b711-abf56da7c3bf tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:02.352231 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-38b458bd-2caa-4732-8b88-65b3e7adaed4 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024994 Jun 16 14:42:02.353369 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 441/925] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:42:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:02.378226 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9cee4e72-f59f-4d8b-81d0-c121391ae9fb tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-281466360", "id": 604735822, "os-flavor-access:is_public": "False"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:02.410169 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9cee4e72-f59f-4d8b-81d0-c121391ae9fb tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.035490 Jun 16 14:42:02.411230 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 442/926] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:42:02 2022] POST /compute/v2.1/flavors => generated 435 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:02.429656 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-469da58b-0c0e-45c9-9e7b-5cb5d76c9423 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d66bec30617843b9a56fd924095481f5"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:02.490304 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e88242e7-fe4b-4c8e-b711-abf56da7c3bf tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:02.501314 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e88242e7-fe4b-4c8e-b711-abf56da7c3bf tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 200 len: 1211 microversion: 2.1 time: 0.190542 Jun 16 14:42:02.517760 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 485/927] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:02 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 1211 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:02.522109 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=12,nova_api:DELETE=3 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:02.556356 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-469da58b-0c0e-45c9-9e7b-5cb5d76c9423 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/604735822/action" status: 200 len: 96 microversion: 2.1 time: 0.130725 Jun 16 14:42:02.557998 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 443/928] 10.222.0.57 () {60 vars in 1196 bytes} [Thu Jun 16 14:42:02 2022] POST /compute/v2.1/flavors/604735822/action => generated 96 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 14:42:02.571073 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5309e722-c651-4d60-abf9-bc64fe42087f tempest-FlavorsAccessNegativeTestJSON-1888197758 tempest-FlavorsAccessNegativeTestJSON-1888197758-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d66bec30617843b9a56fd924095481f5"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:02.573319 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:42:02.573319 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:42:02.575535 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5309e722-c651-4d60-abf9-bc64fe42087f tempest-FlavorsAccessNegativeTestJSON-1888197758 tempest-FlavorsAccessNegativeTestJSON-1888197758-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '5d7ede65a2d3419b88de8f2083ea6646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66bec30617843b9a56fd924095481f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5309e722-c651-4d60-abf9-bc64fe42087f tempest-FlavorsAccessNegativeTestJSON-1888197758 tempest-FlavorsAccessNegativeTestJSON-1888197758-project] Request method failure captured: Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/flavors/604735822/action HTTP/1.1 Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 70 Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0EtbOHAMGUcXrhKCal2FcNM48BDvMHB2XF-q0wbSkSzaVFTvbk7x8JzcOD223L9t7yPS124UJSbn0V90w9nnaqMah9NiwVzlaeMqYa4P5-SrLNUvVF6X9M9ORdQJvJGj-jRrbSt87puA4c82q6Xu_2HE69rKKQ83XErUM0C2aegPIM Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: d66bec30617843b9a56fd924095481f5 Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1888197758 Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:42:02.577880 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:42:02.580635 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d66bec30617843b9a56fd924095481f5", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d66bec30617843b9a56fd924095481f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d66bec30617843b9a56fd924095481f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d66bec30617843b9a56fd924095481f5"}]}] Jun 16 14:42:02.580635 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1888197758 Jun 16 14:42:02.580635 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: d66bec30617843b9a56fd924095481f5 Jun 16 14:42:02.580635 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1888197758 Jun 16 14:42:02.580635 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-FlavorsAccessNegativeTestJSON-1888197758-project Jun 16 14:42:02.580635 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:42:02.580635 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:42:02.580635 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 5d7ede65a2d3419b88de8f2083ea6646 Jun 16 14:42:02.580635 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1888197758-project Jun 16 14:42:02.580635 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:42:02.580635 n-d-836830-4 devstack@n-api.service[125863]: {"removeTenantAccess": {"tenant": "d66bec30617843b9a56fd924095481f5"}} Jun 16 14:42:02.580635 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '604735822', 'body': {'removeTenantAccess': {'tenant': 'd66bec30617843b9a56fd924095481f5'}}} Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi context.can( Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:42:02.582061 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 16 14:42:02.584714 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:02.592059 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5309e722-c651-4d60-abf9-bc64fe42087f tempest-FlavorsAccessNegativeTestJSON-1888197758 tempest-FlavorsAccessNegativeTestJSON-1888197758-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:42:02.592290 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5309e722-c651-4d60-abf9-bc64fe42087f tempest-FlavorsAccessNegativeTestJSON-1888197758 tempest-FlavorsAccessNegativeTestJSON-1888197758-project] 10.222.0.57 "POST /compute/v2.1/flavors/604735822/action" status: 403 len: 133 microversion: 2.1 time: 0.026284 Jun 16 14:42:02.593398 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 486/929] 10.222.0.57 () {60 vars in 1196 bytes} [Thu Jun 16 14:42:02 2022] POST /compute/v2.1/flavors/604735822/action => generated 133 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:42:02.610427 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-eb138f3e-7797-4710-9c6a-2c512daef386 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d66bec30617843b9a56fd924095481f5"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:02.611171 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:42:02.611171 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:42:02.698292 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-eb138f3e-7797-4710-9c6a-2c512daef386 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/604735822/action" status: 200 len: 21 microversion: 2.1 time: 0.100278 Jun 16 14:42:02.699302 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 444/930] 10.222.0.57 () {60 vars in 1196 bytes} [Thu Jun 16 14:42:02 2022] POST /compute/v2.1/flavors/604735822/action => generated 21 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:42:02.709138 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-abf74ad1-1315-4c16-a73c-c94b8a246209 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:02.709956 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:42:02.709956 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:42:02.731434 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6bdc2b60-a2b5-40f7-a326-4d5efdef970b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:02.733018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6bdc2b60-a2b5-40f7-a326-4d5efdef970b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:02.736203 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-abf74ad1-1315-4c16-a73c-c94b8a246209 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/604735822" status: 202 len: 0 microversion: 2.1 time: 0.030811 Jun 16 14:42:02.736777 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 487/931] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:42:02 2022] DELETE /compute/v2.1/flavors/604735822 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:42:02.743044 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6bdc2b60-a2b5-40f7-a326-4d5efdef970b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:02.743813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6bdc2b60-a2b5-40f7-a326-4d5efdef970b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:02.745484 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6bdc2b60-a2b5-40f7-a326-4d5efdef970b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:02.746106 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6bdc2b60-a2b5-40f7-a326-4d5efdef970b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:02.752659 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9c6cbc4d-a517-4186-8333-a2105b99fa4c tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:02.779325 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9c6cbc4d-a517-4186-8333-a2105b99fa4c tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036736 Jun 16 14:42:02.780251 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 488/932] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:42:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:02.799903 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1f05cb15-006a-4697-aaa1-60a53b05ab4d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:02.801217 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1f05cb15-006a-4697-aaa1-60a53b05ab4d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:02.816046 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1f05cb15-006a-4697-aaa1-60a53b05ab4d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:02.817051 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1f05cb15-006a-4697-aaa1-60a53b05ab4d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:02.819382 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1f05cb15-006a-4697-aaa1-60a53b05ab4d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:02.820280 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1f05cb15-006a-4697-aaa1-60a53b05ab4d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:02.950732 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6bdc2b60-a2b5-40f7-a326-4d5efdef970b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:02.971801 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6bdc2b60-a2b5-40f7-a326-4d5efdef970b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.247548 Jun 16 14:42:02.973583 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 445/933] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:02 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:02.985393 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dde1ae25-a35c-417e-af0c-c6bd2be168cf tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2048363260", "id": 1279683015, "os-flavor-access:is_public": "False"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:02.991878 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:42:02.991878 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:42:03.015784 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-dde1ae25-a35c-417e-af0c-c6bd2be168cf tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.039425 Jun 16 14:42:03.017690 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 446/934] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:42:02 2022] POST /compute/v2.1/flavors => generated 439 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:03.037756 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ff4f64c1-f535-4943-88da-5c8397357931 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8fd44c9c30db404bb27e51c393a4b631"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:03.039633 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:42:03.039633 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:42:03.191848 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-ff4f64c1-f535-4943-88da-5c8397357931 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] HTTP exception thrown: Flavor access not found for 39 / 8fd44c9c30db404bb27e51c393a4b631 combination. Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ff4f64c1-f535-4943-88da-5c8397357931 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Request method failure captured: Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/flavors/1279683015/action HTTP/1.1 Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 70 Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0EvU_IZTLU48L4_UFiDOampDJU4dr1jro8EJQJfVP1NlxDgIEd13bUXqSIkpknDxRWySHIQzeDSZ_K4ZfnkMxXUl0lRnauMdY5_FLUyDkFifs-Rj0M5kueBIMUsg6-t2nnvS1b4Qp89dILNneaEOohM8y6Xo22RDbdb5zyjgkLpJ0Q Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: fbdc21c52a3b4f85ad21ed617f7037d7 Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1840404452 Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:42:03.194176 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:42:03.197151 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fbdc21c52a3b4f85ad21ed617f7037d7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbdc21c52a3b4f85ad21ed617f7037d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fbdc21c52a3b4f85ad21ed617f7037d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fbdc21c52a3b4f85ad21ed617f7037d7"}]}] Jun 16 14:42:03.197151 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1840404452 Jun 16 14:42:03.197151 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: fbdc21c52a3b4f85ad21ed617f7037d7 Jun 16 14:42:03.197151 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1840404452 Jun 16 14:42:03.197151 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin Jun 16 14:42:03.197151 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:42:03.197151 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:42:03.197151 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 4610bbfe9f9942dab59003c62bf11e42 Jun 16 14:42:03.197151 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin Jun 16 14:42:03.197151 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:42:03.197151 n-d-836830-4 devstack@n-api.service[125862]: {"removeTenantAccess": {"tenant": "8fd44c9c30db404bb27e51c393a4b631"}} Jun 16 14:42:03.197151 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: exception: Flavor access not found for 39 / 8fd44c9c30db404bb27e51c393a4b631 combination. Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '1279683015', 'body': {'removeTenantAccess': {'tenant': '8fd44c9c30db404bb27e51c393a4b631'}}} Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jun 16 14:42:03.198892 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / 8fd44c9c30db404bb27e51c393a4b631 combination. Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / 8fd44c9c30db404bb27e51c393a4b631 combination. Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:03.201402 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:03.204233 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:03.204233 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:03.204233 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:42:03.204233 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:42:03.204233 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / 8fd44c9c30db404bb27e51c393a4b631 combination. Jun 16 14:42:03.204233 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:03.204233 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ff4f64c1-f535-4943-88da-5c8397357931 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Returning 404 to user: Flavor access not found for 39 / 8fd44c9c30db404bb27e51c393a4b631 combination. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:42:03.204233 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ff4f64c1-f535-4943-88da-5c8397357931 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors/1279683015/action" status: 404 len: 124 microversion: 2.1 time: 0.166166 Jun 16 14:42:03.204233 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 447/935] 10.222.0.57 () {60 vars in 1199 bytes} [Thu Jun 16 14:42:03 2022] POST /compute/v2.1/flavors/1279683015/action => generated 124 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:42:03.210519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b13628e3-b2aa-47ad-a5b5-c865610d4980 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:03.210519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b13628e3-b2aa-47ad-a5b5-c865610d4980 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:03.217787 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b13628e3-b2aa-47ad-a5b5-c865610d4980 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:03.218451 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b13628e3-b2aa-47ad-a5b5-c865610d4980 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:03.219564 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b13628e3-b2aa-47ad-a5b5-c865610d4980 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:03.220140 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b13628e3-b2aa-47ad-a5b5-c865610d4980 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:03.256526 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:03.370656 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b13628e3-b2aa-47ad-a5b5-c865610d4980 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:03.383435 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b13628e3-b2aa-47ad-a5b5-c865610d4980 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1271 microversion: 2.1 time: 0.181779 Jun 16 14:42:03.384042 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 448/936] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:03 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:03.410307 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8eee54f9-46d2-4b11-b792-b85caeabc66f tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:03.415874 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:42:03.415874 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:42:03.485390 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8eee54f9-46d2-4b11-b792-b85caeabc66f tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/1279683015" status: 202 len: 0 microversion: 2.1 time: 0.075430 Jun 16 14:42:03.490724 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 449/937] 10.222.0.57 () {58 vars in 1160 bytes} [Thu Jun 16 14:42:03 2022] DELETE /compute/v2.1/flavors/1279683015 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:42:03.522520 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c8435b2a-1f91-49e9-84af-519322521691 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:03.525121 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c8435b2a-1f91-49e9-84af-519322521691 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:03.545981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8435b2a-1f91-49e9-84af-519322521691 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:03.549834 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8435b2a-1f91-49e9-84af-519322521691 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:03.552864 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8435b2a-1f91-49e9-84af-519322521691 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:03.554208 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8435b2a-1f91-49e9-84af-519322521691 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:03.716743 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1f05cb15-006a-4697-aaa1-60a53b05ab4d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:03.768081 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1f05cb15-006a-4697-aaa1-60a53b05ab4d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1313 microversion: 2.1 time: 0.974966 Jun 16 14:42:03.774558 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 489/938] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:02 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1313 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:03.813196 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1c324839-4bac-4949-af01-4b92641b7445 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:03.816489 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c8435b2a-1f91-49e9-84af-519322521691 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:03.856021 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c8435b2a-1f91-49e9-84af-519322521691 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:03.860011 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c8435b2a-1f91-49e9-84af-519322521691 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:03.864151 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c8435b2a-1f91-49e9-84af-519322521691 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1343 microversion: 2.25 time: 0.369372 Jun 16 14:42:03.877427 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 450/939] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:42:03 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1343 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:03.879462 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-281ee81d-ed36-4ec5-9d30-f9aeb9f17947 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:03.880571 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1c324839-4bac-4949-af01-4b92641b7445 tempest-FlavorsAccessNegativeTestJSON-1840404452 tempest-FlavorsAccessNegativeTestJSON-1840404452-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.103836 Jun 16 14:42:03.880946 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-281ee81d-ed36-4ec5-9d30-f9aeb9f17947 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:03.884836 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 490/940] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:42:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:03.904289 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-281ee81d-ed36-4ec5-9d30-f9aeb9f17947 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:03.905462 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-281ee81d-ed36-4ec5-9d30-f9aeb9f17947 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:03.909013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-f8e1091e-b0f7-4771-8b34-8c6004207e06 req-4a7cc406-c599-4ef8-8292-83fdcce70e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2e2338-dec8-4753-a740-584fb8e9c439", "name": "network-vif-plugged", "status": "completed", "tag": "91c43310-3cd5-422d-9c57-aa5e15664ff8"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:03.912479 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-281ee81d-ed36-4ec5-9d30-f9aeb9f17947 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:03.914398 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-281ee81d-ed36-4ec5-9d30-f9aeb9f17947 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:03.927289 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-f8e1091e-b0f7-4771-8b34-8c6004207e06 req-4a7cc406-c599-4ef8-8292-83fdcce70e9a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:03.927890 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-f8e1091e-b0f7-4771-8b34-8c6004207e06 req-4a7cc406-c599-4ef8-8292-83fdcce70e9a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:03.963404 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-f8e1091e-b0f7-4771-8b34-8c6004207e06 req-4a7cc406-c599-4ef8-8292-83fdcce70e9a service nova] Creating event network-vif-plugged:91c43310-3cd5-422d-9c57-aa5e15664ff8 for instance 5b2e2338-dec8-4753-a740-584fb8e9c439 on n-h1-836830-4 Jun 16 14:42:03.974360 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-f8e1091e-b0f7-4771-8b34-8c6004207e06 req-4a7cc406-c599-4ef8-8292-83fdcce70e9a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070094 Jun 16 14:42:03.975034 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 491/941] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:04.000777 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1b2049d3-f7a6-4a3c-8f33-887ff15ef917 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:04.002530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1b2049d3-f7a6-4a3c-8f33-887ff15ef917 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:04.044514 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b2049d3-f7a6-4a3c-8f33-887ff15ef917 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:04.045490 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b2049d3-f7a6-4a3c-8f33-887ff15ef917 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:04.046543 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b2049d3-f7a6-4a3c-8f33-887ff15ef917 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:04.048411 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b2049d3-f7a6-4a3c-8f33-887ff15ef917 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:04.225220 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-281ee81d-ed36-4ec5-9d30-f9aeb9f17947 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:04.266187 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-281ee81d-ed36-4ec5-9d30-f9aeb9f17947 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 200 len: 1273 microversion: 2.1 time: 0.397169 Jun 16 14:42:04.279515 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 451/942] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:03 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 1273 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:04.434520 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-50a0e2f7-d077-4325-a6ea-a43e5d19f581 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:04.436693 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-50a0e2f7-d077-4325-a6ea-a43e5d19f581 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:04.453732 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50a0e2f7-d077-4325-a6ea-a43e5d19f581 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:04.463087 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50a0e2f7-d077-4325-a6ea-a43e5d19f581 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:04.467273 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50a0e2f7-d077-4325-a6ea-a43e5d19f581 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:04.468601 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50a0e2f7-d077-4325-a6ea-a43e5d19f581 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:05.132887 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-50a0e2f7-d077-4325-a6ea-a43e5d19f581 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:05.143013 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-50a0e2f7-d077-4325-a6ea-a43e5d19f581 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1313 microversion: 2.1 time: 0.733918 Jun 16 14:42:05.155212 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 452/943] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:04 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1313 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:05.161111 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7728f9d6-a257-42de-890f-2af614ad4f49 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:05.161862 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7728f9d6-a257-42de-890f-2af614ad4f49 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:05.175837 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7728f9d6-a257-42de-890f-2af614ad4f49 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:05.177487 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7728f9d6-a257-42de-890f-2af614ad4f49 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:05.179874 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7728f9d6-a257-42de-890f-2af614ad4f49 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:05.181131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7728f9d6-a257-42de-890f-2af614ad4f49 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:05.633700 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1b2049d3-f7a6-4a3c-8f33-887ff15ef917 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:05.657627 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1b2049d3-f7a6-4a3c-8f33-887ff15ef917 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 1.661282 Jun 16 14:42:05.679443 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 492/944] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:03 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:42:05.693730 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1b7cedf3-f6ba-4b9e-a9be-b58dd02d2a29 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:05.695570 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1b7cedf3-f6ba-4b9e-a9be-b58dd02d2a29 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:05.721212 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b7cedf3-f6ba-4b9e-a9be-b58dd02d2a29 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:05.722034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b7cedf3-f6ba-4b9e-a9be-b58dd02d2a29 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:05.723753 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b7cedf3-f6ba-4b9e-a9be-b58dd02d2a29 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:05.726091 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b7cedf3-f6ba-4b9e-a9be-b58dd02d2a29 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:05.771187 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7728f9d6-a257-42de-890f-2af614ad4f49 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:05.782893 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7728f9d6-a257-42de-890f-2af614ad4f49 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1313 microversion: 2.1 time: 0.626132 Jun 16 14:42:05.787182 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 453/945] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:05 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1313 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:05.813789 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-323399b3-9291-4cbd-b93d-76c71ddd3509 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:05.814769 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-323399b3-9291-4cbd-b93d-76c71ddd3509 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:05.825545 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-323399b3-9291-4cbd-b93d-76c71ddd3509 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:05.829781 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-323399b3-9291-4cbd-b93d-76c71ddd3509 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:05.830967 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-323399b3-9291-4cbd-b93d-76c71ddd3509 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:05.831597 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-323399b3-9291-4cbd-b93d-76c71ddd3509 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:06.224228 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1b7cedf3-f6ba-4b9e-a9be-b58dd02d2a29 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:06.242748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1b7cedf3-f6ba-4b9e-a9be-b58dd02d2a29 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:06.247030 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1b7cedf3-f6ba-4b9e-a9be-b58dd02d2a29 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:06.248916 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1b7cedf3-f6ba-4b9e-a9be-b58dd02d2a29 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1343 microversion: 2.25 time: 0.567853 Jun 16 14:42:06.264366 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 493/946] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:42:05 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1343 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:06.275161 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b4e22edd-b3e5-4ef5-9589-7bf52952b77a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:06.277466 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b4e22edd-b3e5-4ef5-9589-7bf52952b77a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:06.296496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4e22edd-b3e5-4ef5-9589-7bf52952b77a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:06.297620 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4e22edd-b3e5-4ef5-9589-7bf52952b77a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:06.299961 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4e22edd-b3e5-4ef5-9589-7bf52952b77a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:06.301543 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4e22edd-b3e5-4ef5-9589-7bf52952b77a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:06.356388 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-323399b3-9291-4cbd-b93d-76c71ddd3509 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:06.371946 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-323399b3-9291-4cbd-b93d-76c71ddd3509 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 200 len: 1315 microversion: 2.1 time: 0.564193 Jun 16 14:42:06.373648 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 454/947] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:05 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:06.554454 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:07.216139 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b4e22edd-b3e5-4ef5-9589-7bf52952b77a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:07.229269 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b4e22edd-b3e5-4ef5-9589-7bf52952b77a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1313 microversion: 2.1 time: 0.963271 Jun 16 14:42:07.230431 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 494/948] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:06 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1313 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:07.238094 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5b39860c-a109-403f-871f-5999ba12aef1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:07.239298 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5b39860c-a109-403f-871f-5999ba12aef1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:07.263292 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b39860c-a109-403f-871f-5999ba12aef1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:07.266661 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b39860c-a109-403f-871f-5999ba12aef1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:07.271481 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b39860c-a109-403f-871f-5999ba12aef1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:07.273878 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b39860c-a109-403f-871f-5999ba12aef1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:07.368798 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a42f4910-9c20-4642-a995-3b487344fd4c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:07.370882 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a42f4910-9c20-4642-a995-3b487344fd4c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:07.396235 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a42f4910-9c20-4642-a995-3b487344fd4c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:07.397063 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a42f4910-9c20-4642-a995-3b487344fd4c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:07.399270 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a42f4910-9c20-4642-a995-3b487344fd4c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:07.400648 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a42f4910-9c20-4642-a995-3b487344fd4c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:07.953813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a42f4910-9c20-4642-a995-3b487344fd4c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:07.982891 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a42f4910-9c20-4642-a995-3b487344fd4c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 1.299724 Jun 16 14:42:07.984214 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 455/949] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:06 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:42:07.993809 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-47b8b8d8-eea1-482b-ad8c-2f1842cd0b21 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:08.002676 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-47b8b8d8-eea1-482b-ad8c-2f1842cd0b21 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:08.025526 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-47b8b8d8-eea1-482b-ad8c-2f1842cd0b21 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:08.027385 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-47b8b8d8-eea1-482b-ad8c-2f1842cd0b21 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:08.029063 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-47b8b8d8-eea1-482b-ad8c-2f1842cd0b21 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:08.032759 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-47b8b8d8-eea1-482b-ad8c-2f1842cd0b21 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:08.662603 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5b39860c-a109-403f-871f-5999ba12aef1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:08.689620 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5b39860c-a109-403f-871f-5999ba12aef1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1463 microversion: 2.1 time: 1.456882 Jun 16 14:42:08.699286 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 495/950] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:07 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1463 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:08.719552 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-45695b27-dc0d-467d-a735-e21b3fa5cb35 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:08.720941 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-45695b27-dc0d-467d-a735-e21b3fa5cb35 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:08.742336 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-45695b27-dc0d-467d-a735-e21b3fa5cb35 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:08.743194 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-45695b27-dc0d-467d-a735-e21b3fa5cb35 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:08.754883 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-45695b27-dc0d-467d-a735-e21b3fa5cb35 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:08.755499 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-45695b27-dc0d-467d-a735-e21b3fa5cb35 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:08.997246 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-47b8b8d8-eea1-482b-ad8c-2f1842cd0b21 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:09.013896 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-47b8b8d8-eea1-482b-ad8c-2f1842cd0b21 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:09.044123 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-47b8b8d8-eea1-482b-ad8c-2f1842cd0b21 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:09.047888 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-47b8b8d8-eea1-482b-ad8c-2f1842cd0b21 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1411 microversion: 2.25 time: 1.061261 Jun 16 14:42:09.076497 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 456/951] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:42:07 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1411 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:09.091391 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-2d0a7806-da7d-4b88-8ad9-ae404b25a313 req-d2ac3ea6-6edb-4cfb-9716-ceb072a980f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512e2984-9834-496e-b3a6-085dc29a58a2", "tag": "6427fc84-9f0c-4e17-abd5-21b7c6824b81"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:09.119469 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-2d0a7806-da7d-4b88-8ad9-ae404b25a313 req-d2ac3ea6-6edb-4cfb-9716-ceb072a980f0 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:09.122823 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-2d0a7806-da7d-4b88-8ad9-ae404b25a313 req-d2ac3ea6-6edb-4cfb-9716-ceb072a980f0 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:09.139828 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-2d0a7806-da7d-4b88-8ad9-ae404b25a313 req-d2ac3ea6-6edb-4cfb-9716-ceb072a980f0 service nova] Creating event network-changed:6427fc84-9f0c-4e17-abd5-21b7c6824b81 for instance 512e2984-9834-496e-b3a6-085dc29a58a2 on n-h2-836830-4 Jun 16 14:42:09.164897 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-2d0a7806-da7d-4b88-8ad9-ae404b25a313 req-d2ac3ea6-6edb-4cfb-9716-ceb072a980f0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085537 Jun 16 14:42:09.168607 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 457/952] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:09.185691 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-23b13db2-fbe6-450d-bd32-f33d551190e4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:09.187650 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-23b13db2-fbe6-450d-bd32-f33d551190e4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:09.202934 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23b13db2-fbe6-450d-bd32-f33d551190e4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:09.203539 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23b13db2-fbe6-450d-bd32-f33d551190e4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:09.206716 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23b13db2-fbe6-450d-bd32-f33d551190e4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:09.208520 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23b13db2-fbe6-450d-bd32-f33d551190e4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:09.367047 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=14 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:09.477528 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-23b13db2-fbe6-450d-bd32-f33d551190e4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:09.490189 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-23b13db2-fbe6-450d-bd32-f33d551190e4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1313 microversion: 2.1 time: 0.318463 Jun 16 14:42:09.492378 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 458/953] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:09 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:09.501376 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-98ecec2a-626c-4fb2-8a19-07c2e21b29b7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:09.509456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-98ecec2a-626c-4fb2-8a19-07c2e21b29b7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:09.522366 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98ecec2a-626c-4fb2-8a19-07c2e21b29b7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:09.523301 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98ecec2a-626c-4fb2-8a19-07c2e21b29b7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:09.524934 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98ecec2a-626c-4fb2-8a19-07c2e21b29b7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:09.526721 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98ecec2a-626c-4fb2-8a19-07c2e21b29b7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:09.806257 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-98ecec2a-626c-4fb2-8a19-07c2e21b29b7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:09.836202 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-98ecec2a-626c-4fb2-8a19-07c2e21b29b7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Old instance type m1.heat2, new instance type m1.heat {{(pid=125862) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 14:42:09.873526 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-98ecec2a-626c-4fb2-8a19-07c2e21b29b7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:42:09.874966 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-98ecec2a-626c-4fb2-8a19-07c2e21b29b7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:42:09.880021 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-98ecec2a-626c-4fb2-8a19-07c2e21b29b7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:42:09.883185 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-98ecec2a-626c-4fb2-8a19-07c2e21b29b7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:42:09.887601 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-98ecec2a-626c-4fb2-8a19-07c2e21b29b7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:42:10.126699 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-45695b27-dc0d-467d-a735-e21b3fa5cb35 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:10.140780 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-45695b27-dc0d-467d-a735-e21b3fa5cb35 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 200 len: 1315 microversion: 2.1 time: 1.439755 Jun 16 14:42:10.141470 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 496/954] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:08 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 1315 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:10.165144 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-69a436ba-8cb5-43b6-a5fd-e614311d6827 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:10.165787 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-69a436ba-8cb5-43b6-a5fd-e614311d6827 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:10.179435 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-69a436ba-8cb5-43b6-a5fd-e614311d6827 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:10.180391 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-69a436ba-8cb5-43b6-a5fd-e614311d6827 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:10.181757 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-69a436ba-8cb5-43b6-a5fd-e614311d6827 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:10.182837 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-69a436ba-8cb5-43b6-a5fd-e614311d6827 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:10.187373 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:10.268868 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-98ecec2a-626c-4fb2-8a19-07c2e21b29b7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "POST /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439/action" status: 202 len: 0 microversion: 2.1 time: 0.774887 Jun 16 14:42:10.270297 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 459/955] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:42:09 2022] POST /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439/action => generated 0 bytes in 777 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:42:10.284235 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7a4341ec-8998-47be-b7c9-4eb970a7c442 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:10.286320 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7a4341ec-8998-47be-b7c9-4eb970a7c442 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:10.303185 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7a4341ec-8998-47be-b7c9-4eb970a7c442 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:10.304548 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7a4341ec-8998-47be-b7c9-4eb970a7c442 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:10.307625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7a4341ec-8998-47be-b7c9-4eb970a7c442 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:10.309278 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7a4341ec-8998-47be-b7c9-4eb970a7c442 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:10.526042 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:10.671164 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7a4341ec-8998-47be-b7c9-4eb970a7c442 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:10.748479 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7a4341ec-8998-47be-b7c9-4eb970a7c442 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:10.751551 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7a4341ec-8998-47be-b7c9-4eb970a7c442 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:10.757729 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7a4341ec-8998-47be-b7c9-4eb970a7c442 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1411 microversion: 2.25 time: 0.485464 Jun 16 14:42:10.759025 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 460/956] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:42:10 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1411 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:10.779793 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f72fb01c-626e-45c1-8d65-c3f9092d6a35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:10.785975 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f72fb01c-626e-45c1-8d65-c3f9092d6a35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:10.800909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f72fb01c-626e-45c1-8d65-c3f9092d6a35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:10.802332 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f72fb01c-626e-45c1-8d65-c3f9092d6a35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:10.805846 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f72fb01c-626e-45c1-8d65-c3f9092d6a35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:10.807775 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f72fb01c-626e-45c1-8d65-c3f9092d6a35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:10.934552 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-69a436ba-8cb5-43b6-a5fd-e614311d6827 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:10.946984 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-69a436ba-8cb5-43b6-a5fd-e614311d6827 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.791230 Jun 16 14:42:10.948155 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 497/957] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:10 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:10.970339 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3bf63dbc-2f4b-40dd-9b2e-a9127ea26300 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:10.977293 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3bf63dbc-2f4b-40dd-9b2e-a9127ea26300 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:11.013461 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3bf63dbc-2f4b-40dd-9b2e-a9127ea26300 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:11.017858 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3bf63dbc-2f4b-40dd-9b2e-a9127ea26300 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:11.024530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3bf63dbc-2f4b-40dd-9b2e-a9127ea26300 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:11.037947 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3bf63dbc-2f4b-40dd-9b2e-a9127ea26300 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:11.288450 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=14 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:11.649242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f72fb01c-626e-45c1-8d65-c3f9092d6a35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:11.665482 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f72fb01c-626e-45c1-8d65-c3f9092d6a35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1472 microversion: 2.1 time: 0.905111 Jun 16 14:42:11.666512 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 461/958] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:10 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1472 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:11.676666 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c989042f-454f-49ea-82d7-f80136111d0d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:11.678805 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c989042f-454f-49ea-82d7-f80136111d0d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:11.703508 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c989042f-454f-49ea-82d7-f80136111d0d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:11.704231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c989042f-454f-49ea-82d7-f80136111d0d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:11.707255 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c989042f-454f-49ea-82d7-f80136111d0d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:11.708333 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c989042f-454f-49ea-82d7-f80136111d0d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:11.950009 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3bf63dbc-2f4b-40dd-9b2e-a9127ea26300 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:11.962527 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3bf63dbc-2f4b-40dd-9b2e-a9127ea26300 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1313 microversion: 2.1 time: 1.001350 Jun 16 14:42:11.965971 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 498/959] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:10 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1313 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:11.984111 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-d15e6cd9-6845-430a-a145-127b01fd2d83 req-866e8b20-16be-42c4-80a0-6a0c92c64044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b", "tag": "eabf5bdc-af0f-48b9-8cab-200ee753d374"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:12.023225 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-d15e6cd9-6845-430a-a145-127b01fd2d83 req-866e8b20-16be-42c4-80a0-6a0c92c64044 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:12.024096 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-d15e6cd9-6845-430a-a145-127b01fd2d83 req-866e8b20-16be-42c4-80a0-6a0c92c64044 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:12.073383 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-d15e6cd9-6845-430a-a145-127b01fd2d83 req-866e8b20-16be-42c4-80a0-6a0c92c64044 service nova] Creating event network-changed:eabf5bdc-af0f-48b9-8cab-200ee753d374 for instance 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b on n-h1-836830-4 Jun 16 14:42:12.086400 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-d15e6cd9-6845-430a-a145-127b01fd2d83 req-866e8b20-16be-42c4-80a0-6a0c92c64044 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115783 Jun 16 14:42:12.094123 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 499/960] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:12.111254 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cbedc479-b027-4172-a3fd-8dddfbd99a63 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:12.124419 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cbedc479-b027-4172-a3fd-8dddfbd99a63 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:12.146189 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cbedc479-b027-4172-a3fd-8dddfbd99a63 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:12.147038 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cbedc479-b027-4172-a3fd-8dddfbd99a63 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:12.148472 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cbedc479-b027-4172-a3fd-8dddfbd99a63 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:12.149255 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cbedc479-b027-4172-a3fd-8dddfbd99a63 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:12.592205 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c989042f-454f-49ea-82d7-f80136111d0d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:12.617488 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c989042f-454f-49ea-82d7-f80136111d0d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 200 len: 1315 microversion: 2.1 time: 0.948049 Jun 16 14:42:12.621085 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 462/961] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:11 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 1315 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:12.631228 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1e3347fe-48fa-45ba-bb85-ac3cd3bffe70 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:12.632061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1e3347fe-48fa-45ba-bb85-ac3cd3bffe70 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:12.654991 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1e3347fe-48fa-45ba-bb85-ac3cd3bffe70 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:12.656636 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1e3347fe-48fa-45ba-bb85-ac3cd3bffe70 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:12.658982 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1e3347fe-48fa-45ba-bb85-ac3cd3bffe70 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:12.666878 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1e3347fe-48fa-45ba-bb85-ac3cd3bffe70 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:12.976572 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-cbedc479-b027-4172-a3fd-8dddfbd99a63 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:13.046125 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-cbedc479-b027-4172-a3fd-8dddfbd99a63 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:13.049804 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-cbedc479-b027-4172-a3fd-8dddfbd99a63 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:13.058229 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cbedc479-b027-4172-a3fd-8dddfbd99a63 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1411 microversion: 2.25 time: 0.961758 Jun 16 14:42:13.062822 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 500/962] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:42:12 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1411 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:13.110058 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-57085245-6261-4451-b135-91c1fc0d65fd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:13.110797 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-57085245-6261-4451-b135-91c1fc0d65fd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:13.137256 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57085245-6261-4451-b135-91c1fc0d65fd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:13.137597 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57085245-6261-4451-b135-91c1fc0d65fd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:13.143206 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57085245-6261-4451-b135-91c1fc0d65fd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:13.143676 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57085245-6261-4451-b135-91c1fc0d65fd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:13.481987 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1e3347fe-48fa-45ba-bb85-ac3cd3bffe70 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:13.502787 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1e3347fe-48fa-45ba-bb85-ac3cd3bffe70 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.880431 Jun 16 14:42:13.505427 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 463/963] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:12 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:13.520711 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1da69609-6368-4354-84d3-357927087207 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:13.521506 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1da69609-6368-4354-84d3-357927087207 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:13.542481 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1da69609-6368-4354-84d3-357927087207 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:13.544534 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1da69609-6368-4354-84d3-357927087207 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:13.546637 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1da69609-6368-4354-84d3-357927087207 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:13.547200 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1da69609-6368-4354-84d3-357927087207 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:13.934215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1da69609-6368-4354-84d3-357927087207 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:13.947229 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1da69609-6368-4354-84d3-357927087207 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1313 microversion: 2.1 time: 0.440117 Jun 16 14:42:13.948385 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 464/964] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:13 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:13.954946 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-edcc93bf-3e31-4ef0-a030-bb874db72467 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:13.955907 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-edcc93bf-3e31-4ef0-a030-bb874db72467 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:13.965798 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-edcc93bf-3e31-4ef0-a030-bb874db72467 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:13.966407 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-edcc93bf-3e31-4ef0-a030-bb874db72467 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:13.967551 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-edcc93bf-3e31-4ef0-a030-bb874db72467 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:13.968109 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-edcc93bf-3e31-4ef0-a030-bb874db72467 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:13.968780 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-57085245-6261-4451-b135-91c1fc0d65fd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:13.980088 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-57085245-6261-4451-b135-91c1fc0d65fd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1472 microversion: 2.1 time: 0.915558 Jun 16 14:42:13.982852 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 501/965] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:13 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1472 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:14.000100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:14.082467 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-302d116e-589f-4228-883d-f7f0b7effb25 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:14.083565 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-302d116e-589f-4228-883d-f7f0b7effb25 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:14.091808 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-302d116e-589f-4228-883d-f7f0b7effb25 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:14.103186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-302d116e-589f-4228-883d-f7f0b7effb25 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:14.105741 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-302d116e-589f-4228-883d-f7f0b7effb25 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:14.114679 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-302d116e-589f-4228-883d-f7f0b7effb25 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:14.451024 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-edcc93bf-3e31-4ef0-a030-bb874db72467 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:14.461279 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-edcc93bf-3e31-4ef0-a030-bb874db72467 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 200 len: 1315 microversion: 2.1 time: 0.510353 Jun 16 14:42:14.462601 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 465/966] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:13 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:14.479799 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-89e1e503-f210-4324-b0db-527e8fdc0c14 req-4a1024c2-ec5c-4dad-98dd-a1ed13b84092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4855363-724b-4eff-a76e-915e440af995", "tag": "f4722aca-79de-427f-b18d-882b6697a114"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:14.490948 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-89e1e503-f210-4324-b0db-527e8fdc0c14 req-4a1024c2-ec5c-4dad-98dd-a1ed13b84092 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:14.492113 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-89e1e503-f210-4324-b0db-527e8fdc0c14 req-4a1024c2-ec5c-4dad-98dd-a1ed13b84092 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:14.513384 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-89e1e503-f210-4324-b0db-527e8fdc0c14 req-4a1024c2-ec5c-4dad-98dd-a1ed13b84092 service nova] Creating event network-changed:f4722aca-79de-427f-b18d-882b6697a114 for instance e4855363-724b-4eff-a76e-915e440af995 on n-h2-836830-4 Jun 16 14:42:14.523055 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-89e1e503-f210-4324-b0db-527e8fdc0c14 req-4a1024c2-ec5c-4dad-98dd-a1ed13b84092 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058533 Jun 16 14:42:14.526372 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 466/967] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:14.534294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-07fced3c-9f6f-496a-b6bb-a7f2eeedae96 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:14.535510 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-07fced3c-9f6f-496a-b6bb-a7f2eeedae96 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:14.553842 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07fced3c-9f6f-496a-b6bb-a7f2eeedae96 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:14.554893 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07fced3c-9f6f-496a-b6bb-a7f2eeedae96 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:14.556942 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07fced3c-9f6f-496a-b6bb-a7f2eeedae96 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:14.557781 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07fced3c-9f6f-496a-b6bb-a7f2eeedae96 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:14.904950 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-07fced3c-9f6f-496a-b6bb-a7f2eeedae96 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:14.916143 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-07fced3c-9f6f-496a-b6bb-a7f2eeedae96 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.387203 Jun 16 14:42:14.916972 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 467/968] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:14 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:14.953242 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-302d116e-589f-4228-883d-f7f0b7effb25 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:14.963407 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-302d116e-589f-4228-883d-f7f0b7effb25 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:14.965495 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-302d116e-589f-4228-883d-f7f0b7effb25 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:14.966711 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-302d116e-589f-4228-883d-f7f0b7effb25 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1411 microversion: 2.25 time: 0.888670 Jun 16 14:42:14.975267 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0c4b7af3-12a9-4ba5-906b-4d70869f2d3e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:14.976336 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0c4b7af3-12a9-4ba5-906b-4d70869f2d3e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:14.979047 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 502/969] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:42:14 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1411 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:14.993462 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c4b7af3-12a9-4ba5-906b-4d70869f2d3e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:14.994057 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c4b7af3-12a9-4ba5-906b-4d70869f2d3e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:14.996000 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c4b7af3-12a9-4ba5-906b-4d70869f2d3e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:14.996000 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c4b7af3-12a9-4ba5-906b-4d70869f2d3e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:15.006297 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-076db8d8-c458-43db-bd9a-b6f62e9cca50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:15.011230 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-076db8d8-c458-43db-bd9a-b6f62e9cca50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:15.032158 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-076db8d8-c458-43db-bd9a-b6f62e9cca50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:15.032624 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-076db8d8-c458-43db-bd9a-b6f62e9cca50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:15.034400 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-076db8d8-c458-43db-bd9a-b6f62e9cca50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:15.034868 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-076db8d8-c458-43db-bd9a-b6f62e9cca50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:15.271973 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0c4b7af3-12a9-4ba5-906b-4d70869f2d3e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:15.283336 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0c4b7af3-12a9-4ba5-906b-4d70869f2d3e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1313 microversion: 2.1 time: 0.313298 Jun 16 14:42:15.284131 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 468/970] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:14 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:15.374964 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-076db8d8-c458-43db-bd9a-b6f62e9cca50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:15.388408 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-076db8d8-c458-43db-bd9a-b6f62e9cca50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1472 microversion: 2.1 time: 0.389452 Jun 16 14:42:15.401101 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 503/971] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:14 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1472 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:15.487645 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a39b8282-6c05-4939-95eb-d3beb69a0611 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:15.488814 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a39b8282-6c05-4939-95eb-d3beb69a0611 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:15.497360 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a39b8282-6c05-4939-95eb-d3beb69a0611 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:15.498263 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a39b8282-6c05-4939-95eb-d3beb69a0611 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:15.499310 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a39b8282-6c05-4939-95eb-d3beb69a0611 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:15.499924 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a39b8282-6c05-4939-95eb-d3beb69a0611 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:15.607884 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6a1bd12a-3204-4ff6-9bb7-e087c590366a tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Calling method '.version_select at 0x7fdf0c72c0d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:15.610142 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:42:15.610142 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:42:15.612439 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a1bd12a-3204-4ff6-9bb7-e087c590366a tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:15.613183 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a1bd12a-3204-4ff6-9bb7-e087c590366a tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:15.634511 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a1bd12a-3204-4ff6-9bb7-e087c590366a tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:15.635132 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a1bd12a-3204-4ff6-9bb7-e087c590366a tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:15.698400 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a1bd12a-3204-4ff6-9bb7-e087c590366a tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:15.699146 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a1bd12a-3204-4ff6-9bb7-e087c590366a tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:15.724777 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a1bd12a-3204-4ff6-9bb7-e087c590366a tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:15.725288 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a1bd12a-3204-4ff6-9bb7-e087c590366a tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:15.772404 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a1bd12a-3204-4ff6-9bb7-e087c590366a tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:15.773128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a1bd12a-3204-4ff6-9bb7-e087c590366a tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:15.782232 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6a1bd12a-3204-4ff6-9bb7-e087c590366a tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2624 microversion: 2.53 time: 0.363904 Jun 16 14:42:15.791069 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 469/972] 10.222.0.57 () {60 vars in 1242 bytes} [Thu Jun 16 14:42:15 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2624 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:15.798674 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-efcf6d6b-843b-4146-b40f-6ace0df96320 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Calling method '.version_select at 0x7fdf0c973700>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:15.803777 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:42:15.803777 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:42:15.807300 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efcf6d6b-843b-4146-b40f-6ace0df96320 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:15.808151 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efcf6d6b-843b-4146-b40f-6ace0df96320 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:15.838517 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a39b8282-6c05-4939-95eb-d3beb69a0611 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:15.864236 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efcf6d6b-843b-4146-b40f-6ace0df96320 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:15.864893 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efcf6d6b-843b-4146-b40f-6ace0df96320 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:15.870050 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a39b8282-6c05-4939-95eb-d3beb69a0611 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 200 len: 1315 microversion: 2.1 time: 0.385864 Jun 16 14:42:15.871407 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 504/973] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:15 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:15.920627 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efcf6d6b-843b-4146-b40f-6ace0df96320 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:15.921418 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efcf6d6b-843b-4146-b40f-6ace0df96320 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:15.937847 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-58d82cc5-92fc-4ed2-88c1-83130ac01840 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:15.938880 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-58d82cc5-92fc-4ed2-88c1-83130ac01840 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:15.951308 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-58d82cc5-92fc-4ed2-88c1-83130ac01840 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:15.957547 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-58d82cc5-92fc-4ed2-88c1-83130ac01840 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:15.958911 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-58d82cc5-92fc-4ed2-88c1-83130ac01840 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:15.959636 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-58d82cc5-92fc-4ed2-88c1-83130ac01840 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:15.964459 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efcf6d6b-843b-4146-b40f-6ace0df96320 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:15.965144 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efcf6d6b-843b-4146-b40f-6ace0df96320 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:16.057317 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efcf6d6b-843b-4146-b40f-6ace0df96320 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:16.058920 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efcf6d6b-843b-4146-b40f-6ace0df96320 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:16.069319 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-efcf6d6b-843b-4146-b40f-6ace0df96320 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1318 microversion: 2.53 time: 0.274724 Jun 16 14:42:16.073079 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 470/974] 10.222.0.57 () {60 vars in 1221 bytes} [Thu Jun 16 14:42:15 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:16.091593 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-772c5c77-c814-4a83-96c9-7b1d78d64696 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:16.092755 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-772c5c77-c814-4a83-96c9-7b1d78d64696 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:16.107601 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-772c5c77-c814-4a83-96c9-7b1d78d64696 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:16.109331 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-772c5c77-c814-4a83-96c9-7b1d78d64696 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:16.110661 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-772c5c77-c814-4a83-96c9-7b1d78d64696 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:16.111409 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-772c5c77-c814-4a83-96c9-7b1d78d64696 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:16.524747 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-772c5c77-c814-4a83-96c9-7b1d78d64696 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:16.535777 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-772c5c77-c814-4a83-96c9-7b1d78d64696 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:16.537552 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-772c5c77-c814-4a83-96c9-7b1d78d64696 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:16.538863 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-772c5c77-c814-4a83-96c9-7b1d78d64696 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1411 microversion: 2.25 time: 0.464116 Jun 16 14:42:16.551206 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 471/975] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:42:16 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1411 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:16.558015 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d513cd45-bc4c-451c-bb0a-06a1aec19660 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Calling method '.version_select at 0x7fdf0c750550>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:16.559682 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:42:16.559682 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:42:16.561290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d513cd45-bc4c-451c-bb0a-06a1aec19660 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:16.561771 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d513cd45-bc4c-451c-bb0a-06a1aec19660 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:16.587479 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d513cd45-bc4c-451c-bb0a-06a1aec19660 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:16.588144 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d513cd45-bc4c-451c-bb0a-06a1aec19660 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:16.596373 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d513cd45-bc4c-451c-bb0a-06a1aec19660 tempest-HypervisorAdminV253TestBase-1516646368 tempest-HypervisorAdminV253TestBase-1516646368-project-admin] 10.222.0.57 "GET /compute/v2.1/os-hypervisors/4f35cd48-c450-487e-8f87-c177d6faaab5" status: 200 len: 791 microversion: 2.53 time: 0.043179 Jun 16 14:42:16.606966 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 472/976] 10.222.0.57 () {60 vars in 1297 bytes} [Thu Jun 16 14:42:16 2022] GET /compute/v2.1/os-hypervisors/4f35cd48-c450-487e-8f87-c177d6faaab5 => generated 791 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:42:16.613435 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-357a0dd5-6802-4ac4-b18a-4943824fe481 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:16.614335 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-357a0dd5-6802-4ac4-b18a-4943824fe481 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:16.622634 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-357a0dd5-6802-4ac4-b18a-4943824fe481 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:16.623456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-357a0dd5-6802-4ac4-b18a-4943824fe481 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:16.624482 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-357a0dd5-6802-4ac4-b18a-4943824fe481 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:16.625107 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-357a0dd5-6802-4ac4-b18a-4943824fe481 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:16.887806 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-58d82cc5-92fc-4ed2-88c1-83130ac01840 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:16.904249 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-58d82cc5-92fc-4ed2-88c1-83130ac01840 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.970988 Jun 16 14:42:16.919180 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 505/977] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:15 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:16.929599 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-da7cbf44-4cbb-4df6-aad8-79306d2b5d43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:16.932372 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-da7cbf44-4cbb-4df6-aad8-79306d2b5d43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:16.947833 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-da7cbf44-4cbb-4df6-aad8-79306d2b5d43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:16.949189 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-da7cbf44-4cbb-4df6-aad8-79306d2b5d43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:16.957995 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-da7cbf44-4cbb-4df6-aad8-79306d2b5d43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:16.959316 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-da7cbf44-4cbb-4df6-aad8-79306d2b5d43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:17.089358 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-357a0dd5-6802-4ac4-b18a-4943824fe481 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:17.160410 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-357a0dd5-6802-4ac4-b18a-4943824fe481 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1313 microversion: 2.1 time: 0.550291 Jun 16 14:42:17.188120 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 473/978] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:16 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1313 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:17.222730 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8504207d-1c4d-483d-8fad-1a0b52eca31b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:17.224132 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8504207d-1c4d-483d-8fad-1a0b52eca31b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:17.264119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8504207d-1c4d-483d-8fad-1a0b52eca31b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:17.267606 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8504207d-1c4d-483d-8fad-1a0b52eca31b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:17.269585 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8504207d-1c4d-483d-8fad-1a0b52eca31b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:17.276982 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8504207d-1c4d-483d-8fad-1a0b52eca31b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:17.748145 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8504207d-1c4d-483d-8fad-1a0b52eca31b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:17.776304 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8504207d-1c4d-483d-8fad-1a0b52eca31b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 200 len: 1315 microversion: 2.1 time: 0.583044 Jun 16 14:42:17.778571 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 474/979] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:17 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:17.827996 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-97ae3033-4a01-40a7-8e40-6a3a33a3d53d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:17.829867 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-97ae3033-4a01-40a7-8e40-6a3a33a3d53d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:17.851153 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97ae3033-4a01-40a7-8e40-6a3a33a3d53d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:17.853727 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97ae3033-4a01-40a7-8e40-6a3a33a3d53d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:17.856779 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97ae3033-4a01-40a7-8e40-6a3a33a3d53d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:17.858535 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97ae3033-4a01-40a7-8e40-6a3a33a3d53d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:18.307705 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-da7cbf44-4cbb-4df6-aad8-79306d2b5d43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:18.346323 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-da7cbf44-4cbb-4df6-aad8-79306d2b5d43 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1472 microversion: 2.1 time: 1.425345 Jun 16 14:42:18.363156 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 506/980] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:16 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1472 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:18.371434 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-65a4446e-be44-4563-97a0-44c30f712177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:18.372525 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-65a4446e-be44-4563-97a0-44c30f712177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:18.380568 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65a4446e-be44-4563-97a0-44c30f712177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:18.381392 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65a4446e-be44-4563-97a0-44c30f712177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:18.382442 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65a4446e-be44-4563-97a0-44c30f712177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:18.383797 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65a4446e-be44-4563-97a0-44c30f712177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:18.658932 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-97ae3033-4a01-40a7-8e40-6a3a33a3d53d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:18.672189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-97ae3033-4a01-40a7-8e40-6a3a33a3d53d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:18.674762 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-97ae3033-4a01-40a7-8e40-6a3a33a3d53d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:18.676845 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-97ae3033-4a01-40a7-8e40-6a3a33a3d53d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1411 microversion: 2.25 time: 0.892863 Jun 16 14:42:18.678292 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 475/981] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:42:17 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1411 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:18.687067 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8f7dbfca-75ee-4c6a-98a3-f180546b2230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:18.688113 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8f7dbfca-75ee-4c6a-98a3-f180546b2230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:18.696595 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f7dbfca-75ee-4c6a-98a3-f180546b2230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:18.697336 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f7dbfca-75ee-4c6a-98a3-f180546b2230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:18.698449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f7dbfca-75ee-4c6a-98a3-f180546b2230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:18.699083 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f7dbfca-75ee-4c6a-98a3-f180546b2230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:19.019763 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8f7dbfca-75ee-4c6a-98a3-f180546b2230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:19.037003 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8f7dbfca-75ee-4c6a-98a3-f180546b2230 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1313 microversion: 2.1 time: 0.357059 Jun 16 14:42:19.040726 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 476/982] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:18 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:19.194292 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-65a4446e-be44-4563-97a0-44c30f712177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:19.212199 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-65a4446e-be44-4563-97a0-44c30f712177 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.846872 Jun 16 14:42:19.214104 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 507/983] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:18 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:19.245857 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c707b0ca-62ee-47ad-a0fb-28db42371ba6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:19.246927 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c707b0ca-62ee-47ad-a0fb-28db42371ba6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:19.264070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c707b0ca-62ee-47ad-a0fb-28db42371ba6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:19.265374 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c707b0ca-62ee-47ad-a0fb-28db42371ba6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:19.268078 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c707b0ca-62ee-47ad-a0fb-28db42371ba6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:19.269219 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c707b0ca-62ee-47ad-a0fb-28db42371ba6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:19.341518 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-785706fd-83ed-448a-8d84-1e5a66a5b6bd req-5de0dd02-7d89-4e2e-8040-cb277c54497e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512e2984-9834-496e-b3a6-085dc29a58a2", "name": "network-vif-plugged", "status": "completed", "tag": "6427fc84-9f0c-4e17-abd5-21b7c6824b81"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:19.365673 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:DELETE=5 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:19.400720 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-785706fd-83ed-448a-8d84-1e5a66a5b6bd req-5de0dd02-7d89-4e2e-8040-cb277c54497e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:19.400720 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-785706fd-83ed-448a-8d84-1e5a66a5b6bd req-5de0dd02-7d89-4e2e-8040-cb277c54497e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:19.414761 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-785706fd-83ed-448a-8d84-1e5a66a5b6bd req-5de0dd02-7d89-4e2e-8040-cb277c54497e service nova] Creating event network-vif-plugged:6427fc84-9f0c-4e17-abd5-21b7c6824b81 for instance 512e2984-9834-496e-b3a6-085dc29a58a2 on n-h2-836830-4 Jun 16 14:42:19.425264 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-785706fd-83ed-448a-8d84-1e5a66a5b6bd req-5de0dd02-7d89-4e2e-8040-cb277c54497e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.377980 Jun 16 14:42:19.428819 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 477/984] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:19.446010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b7296c32-c517-47e8-ad32-154b9855465e tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "446e32f1-f9b8-4287-b42c-e6bf92f6f16f"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:19.448040 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b7296c32-c517-47e8-ad32-154b9855465e tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:19.464658 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b7296c32-c517-47e8-ad32-154b9855465e tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:19.465623 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b7296c32-c517-47e8-ad32-154b9855465e tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:19.467261 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b7296c32-c517-47e8-ad32-154b9855465e tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:19.468169 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b7296c32-c517-47e8-ad32-154b9855465e tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:19.948374 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c707b0ca-62ee-47ad-a0fb-28db42371ba6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:19.962849 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c707b0ca-62ee-47ad-a0fb-28db42371ba6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 200 len: 1315 microversion: 2.1 time: 0.734912 Jun 16 14:42:19.965407 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 508/985] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:19 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 1315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:19.978477 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a1c2dc53-904d-4159-a746-5d39191ed815 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:19.979560 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a1c2dc53-904d-4159-a746-5d39191ed815 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:19.993295 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a1c2dc53-904d-4159-a746-5d39191ed815 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:19.994695 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a1c2dc53-904d-4159-a746-5d39191ed815 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:19.995105 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b7296c32-c517-47e8-ad32-154b9855465e tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "POST /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.562497 Jun 16 14:42:19.995866 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 478/986] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 16 14:42:19 2022] POST /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:19.999512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a1c2dc53-904d-4159-a746-5d39191ed815 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:20.002496 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-14b30402-0859-4e89-92be-88b12a556b82 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:20.003656 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a1c2dc53-904d-4159-a746-5d39191ed815 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:20.009485 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-14b30402-0859-4e89-92be-88b12a556b82 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:20.037210 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-14b30402-0859-4e89-92be-88b12a556b82 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:20.037679 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-14b30402-0859-4e89-92be-88b12a556b82 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:20.039148 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-14b30402-0859-4e89-92be-88b12a556b82 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:20.039837 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-14b30402-0859-4e89-92be-88b12a556b82 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:20.373461 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-14b30402-0859-4e89-92be-88b12a556b82 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:20.383085 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:20.386750 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-14b30402-0859-4e89-92be-88b12a556b82 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:20.388632 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-14b30402-0859-4e89-92be-88b12a556b82 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:20.389886 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-14b30402-0859-4e89-92be-88b12a556b82 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1411 microversion: 2.25 time: 0.392616 Jun 16 14:42:20.399149 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 479/987] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:42:19 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1411 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:20.410684 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-770efaf8-f9cc-4088-86b5-00dfbc2a9c0d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:20.411611 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-770efaf8-f9cc-4088-86b5-00dfbc2a9c0d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:20.424554 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-770efaf8-f9cc-4088-86b5-00dfbc2a9c0d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:20.425380 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-770efaf8-f9cc-4088-86b5-00dfbc2a9c0d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:20.426590 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-770efaf8-f9cc-4088-86b5-00dfbc2a9c0d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:20.427271 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-770efaf8-f9cc-4088-86b5-00dfbc2a9c0d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:20.760859 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-770efaf8-f9cc-4088-86b5-00dfbc2a9c0d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:20.780808 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-770efaf8-f9cc-4088-86b5-00dfbc2a9c0d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1313 microversion: 2.1 time: 0.379626 Jun 16 14:42:20.795923 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 480/988] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:20 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:20.811055 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7d6355a8-f9eb-409e-b2d9-6a2ed48a1ef9 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:20.812547 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7d6355a8-f9eb-409e-b2d9-6a2ed48a1ef9 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:20.838006 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7d6355a8-f9eb-409e-b2d9-6a2ed48a1ef9 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:20.838995 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7d6355a8-f9eb-409e-b2d9-6a2ed48a1ef9 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:20.841378 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7d6355a8-f9eb-409e-b2d9-6a2ed48a1ef9 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:20.842167 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7d6355a8-f9eb-409e-b2d9-6a2ed48a1ef9 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:20.846568 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a1c2dc53-904d-4159-a746-5d39191ed815 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:20.874301 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a1c2dc53-904d-4159-a746-5d39191ed815 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1477 microversion: 2.1 time: 0.905895 Jun 16 14:42:20.883304 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 509/989] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:19 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1477 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:20.983914 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-589abe4f-90bf-4fc9-993f-cb6331e24bc9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:20.986285 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-589abe4f-90bf-4fc9-993f-cb6331e24bc9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:21.001413 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-589abe4f-90bf-4fc9-993f-cb6331e24bc9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:21.002309 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-589abe4f-90bf-4fc9-993f-cb6331e24bc9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:21.004920 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-589abe4f-90bf-4fc9-993f-cb6331e24bc9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:21.006224 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-589abe4f-90bf-4fc9-993f-cb6331e24bc9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:21.387408 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7d6355a8-f9eb-409e-b2d9-6a2ed48a1ef9 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:21.418783 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7d6355a8-f9eb-409e-b2d9-6a2ed48a1ef9 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.618994 Jun 16 14:42:21.425493 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 481/990] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:20 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:21.443819 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-18cd2c53-81f1-4571-99cb-774c2a5db196 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:21.452747 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-18cd2c53-81f1-4571-99cb-774c2a5db196 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:21.484688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18cd2c53-81f1-4571-99cb-774c2a5db196 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:21.485999 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18cd2c53-81f1-4571-99cb-774c2a5db196 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:21.493473 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18cd2c53-81f1-4571-99cb-774c2a5db196 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:21.496107 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18cd2c53-81f1-4571-99cb-774c2a5db196 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:21.634604 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-589abe4f-90bf-4fc9-993f-cb6331e24bc9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:21.666153 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-589abe4f-90bf-4fc9-993f-cb6331e24bc9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 200 len: 1315 microversion: 2.1 time: 0.686771 Jun 16 14:42:21.670635 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 510/991] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:20 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:42:21.794677 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-21e83e3f-eeb3-4190-8d08-d12988c1fc84 req-10a1b1b3-e58f-43e7-a9df-12bbe334f276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4855363-724b-4eff-a76e-915e440af995", "name": "network-vif-plugged", "status": "completed", "tag": "f4722aca-79de-427f-b18d-882b6697a114"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:21.846199 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-21e83e3f-eeb3-4190-8d08-d12988c1fc84 req-10a1b1b3-e58f-43e7-a9df-12bbe334f276 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:21.849051 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-21e83e3f-eeb3-4190-8d08-d12988c1fc84 req-10a1b1b3-e58f-43e7-a9df-12bbe334f276 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:21.911584 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-21e83e3f-eeb3-4190-8d08-d12988c1fc84 req-10a1b1b3-e58f-43e7-a9df-12bbe334f276 service nova] Creating event network-vif-plugged:f4722aca-79de-427f-b18d-882b6697a114 for instance e4855363-724b-4eff-a76e-915e440af995 on n-h2-836830-4 Jun 16 14:42:21.944136 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-21e83e3f-eeb3-4190-8d08-d12988c1fc84 req-10a1b1b3-e58f-43e7-a9df-12bbe334f276 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161185 Jun 16 14:42:21.952564 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-18cd2c53-81f1-4571-99cb-774c2a5db196 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:21.957450 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 511/992] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:21.994502 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-18cd2c53-81f1-4571-99cb-774c2a5db196 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:21.999497 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-18cd2c53-81f1-4571-99cb-774c2a5db196 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:22.000946 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9dbb0d15-9916-46b6-bbec-55931551c878 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:22.003696 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-18cd2c53-81f1-4571-99cb-774c2a5db196 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1411 microversion: 2.25 time: 0.575246 Jun 16 14:42:22.006426 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 482/993] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:42:21 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1411 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:22.006671 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9dbb0d15-9916-46b6-bbec-55931551c878 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:22.020713 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-078569a1-04d1-4c9f-8a65-11f9e71012b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:22.023307 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-078569a1-04d1-4c9f-8a65-11f9e71012b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:22.041845 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9dbb0d15-9916-46b6-bbec-55931551c878 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:22.043007 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9dbb0d15-9916-46b6-bbec-55931551c878 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:22.046300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9dbb0d15-9916-46b6-bbec-55931551c878 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:22.051072 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9dbb0d15-9916-46b6-bbec-55931551c878 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:22.054246 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-078569a1-04d1-4c9f-8a65-11f9e71012b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:22.058430 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-078569a1-04d1-4c9f-8a65-11f9e71012b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:22.060762 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-078569a1-04d1-4c9f-8a65-11f9e71012b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:22.061957 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-078569a1-04d1-4c9f-8a65-11f9e71012b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:22.381236 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-078569a1-04d1-4c9f-8a65-11f9e71012b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:22.416125 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-078569a1-04d1-4c9f-8a65-11f9e71012b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1477 microversion: 2.1 time: 0.405762 Jun 16 14:42:22.419801 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 483/994] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:22 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1477 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:22.457854 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f200964d-ba1a-45e7-bc29-4e5a2280934c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:22.461282 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f200964d-ba1a-45e7-bc29-4e5a2280934c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:22.483266 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f200964d-ba1a-45e7-bc29-4e5a2280934c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:22.485774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f200964d-ba1a-45e7-bc29-4e5a2280934c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:22.490285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f200964d-ba1a-45e7-bc29-4e5a2280934c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:22.491683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f200964d-ba1a-45e7-bc29-4e5a2280934c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:22.683005 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9dbb0d15-9916-46b6-bbec-55931551c878 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:22.695829 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9dbb0d15-9916-46b6-bbec-55931551c878 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1313 microversion: 2.1 time: 0.730808 Jun 16 14:42:22.696635 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 512/995] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:21 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1313 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:22.720425 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-93421164-02d1-4481-ae1b-6b151f604203 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:22.723252 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-93421164-02d1-4481-ae1b-6b151f604203 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:22.738907 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-93421164-02d1-4481-ae1b-6b151f604203 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:22.740199 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-93421164-02d1-4481-ae1b-6b151f604203 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:22.741856 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-93421164-02d1-4481-ae1b-6b151f604203 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:22.742246 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-93421164-02d1-4481-ae1b-6b151f604203 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:22.899565 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f200964d-ba1a-45e7-bc29-4e5a2280934c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:22.918695 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f200964d-ba1a-45e7-bc29-4e5a2280934c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.469748 Jun 16 14:42:22.920856 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 484/996] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:22 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:23.031280 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-903b4b59-55ab-41f8-9212-51bf8f011f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:23.037324 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-903b4b59-55ab-41f8-9212-51bf8f011f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:23.073662 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-903b4b59-55ab-41f8-9212-51bf8f011f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:23.074484 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-903b4b59-55ab-41f8-9212-51bf8f011f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:23.075960 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-903b4b59-55ab-41f8-9212-51bf8f011f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:23.076755 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-903b4b59-55ab-41f8-9212-51bf8f011f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:23.352595 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-93421164-02d1-4481-ae1b-6b151f604203 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:23.376377 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-93421164-02d1-4481-ae1b-6b151f604203 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 200 len: 1504 microversion: 2.1 time: 0.668144 Jun 16 14:42:23.416040 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 513/997] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:22 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 1504 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:23.450879 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4af44396-ebd2-4d50-ac07-f3f528cfab7a tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1280787791"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:23.452490 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4af44396-ebd2-4d50-ac07-f3f528cfab7a tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:23.469032 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4af44396-ebd2-4d50-ac07-f3f528cfab7a tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:23.479735 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4af44396-ebd2-4d50-ac07-f3f528cfab7a tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:23.481942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4af44396-ebd2-4d50-ac07-f3f528cfab7a tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:23.483221 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4af44396-ebd2-4d50-ac07-f3f528cfab7a tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:23.511475 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-903b4b59-55ab-41f8-9212-51bf8f011f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:23.536461 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-903b4b59-55ab-41f8-9212-51bf8f011f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:23.540764 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-903b4b59-55ab-41f8-9212-51bf8f011f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:23.543781 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-903b4b59-55ab-41f8-9212-51bf8f011f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1411 microversion: 2.25 time: 0.519029 Jun 16 14:42:23.545755 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 485/998] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:42:23 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1411 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:23.558089 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-aaa1f08d-e2cf-462c-9f36-4902bf117fb4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:23.559732 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-aaa1f08d-e2cf-462c-9f36-4902bf117fb4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:23.578536 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aaa1f08d-e2cf-462c-9f36-4902bf117fb4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:23.579842 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aaa1f08d-e2cf-462c-9f36-4902bf117fb4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:23.581740 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aaa1f08d-e2cf-462c-9f36-4902bf117fb4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:23.583648 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aaa1f08d-e2cf-462c-9f36-4902bf117fb4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:23.823277 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-aaa1f08d-e2cf-462c-9f36-4902bf117fb4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:23.832987 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-aaa1f08d-e2cf-462c-9f36-4902bf117fb4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1477 microversion: 2.1 time: 0.285524 Jun 16 14:42:23.834242 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 486/999] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:23 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1477 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:23.840435 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4df020d8-66c2-4af2-9059-65e41990fa9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:23.841415 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4df020d8-66c2-4af2-9059-65e41990fa9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:23.848309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4df020d8-66c2-4af2-9059-65e41990fa9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:23.849040 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4df020d8-66c2-4af2-9059-65e41990fa9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:23.850552 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4df020d8-66c2-4af2-9059-65e41990fa9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:23.851284 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4df020d8-66c2-4af2-9059-65e41990fa9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:24.344837 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-4df020d8-66c2-4af2-9059-65e41990fa9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:24.398911 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4df020d8-66c2-4af2-9059-65e41990fa9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1313 microversion: 2.1 time: 0.559553 Jun 16 14:42:24.402837 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 487/1000] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:23 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:24.418464 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-41825626-3971-405e-af50-12c305944631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:24.426563 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-41825626-3971-405e-af50-12c305944631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:24.451390 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-41825626-3971-405e-af50-12c305944631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:24.452023 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-41825626-3971-405e-af50-12c305944631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:24.452909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-41825626-3971-405e-af50-12c305944631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:24.453454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-41825626-3971-405e-af50-12c305944631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:24.473729 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.network.security_group_api [None req-4af44396-ebd2-4d50-ac07-f3f528cfab7a tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Adding security group 65d89d10-197e-467b-9b59-7603ac9f99dd to port 6427fc84-9f0c-4e17-abd5-21b7c6824b81 Jun 16 14:42:24.785712 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-41825626-3971-405e-af50-12c305944631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:24.822499 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-41825626-3971-405e-af50-12c305944631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.413216 Jun 16 14:42:24.823640 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 488/1001] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:24 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:24.846424 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-7d8f781b-2a60-4ebe-8168-ac2ce9e7e41f req-08e460f3-2965-49ad-ba83-77fd2f63ddcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b", "name": "network-vif-plugged", "status": "completed", "tag": "eabf5bdc-af0f-48b9-8cab-200ee753d374"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:24.864554 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-7d8f781b-2a60-4ebe-8168-ac2ce9e7e41f req-08e460f3-2965-49ad-ba83-77fd2f63ddcd service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:24.866669 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-7d8f781b-2a60-4ebe-8168-ac2ce9e7e41f req-08e460f3-2965-49ad-ba83-77fd2f63ddcd service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:24.898247 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-7d8f781b-2a60-4ebe-8168-ac2ce9e7e41f req-08e460f3-2965-49ad-ba83-77fd2f63ddcd service nova] Creating event network-vif-plugged:eabf5bdc-af0f-48b9-8cab-200ee753d374 for instance 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b on n-h1-836830-4 Jun 16 14:42:24.924306 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-7d8f781b-2a60-4ebe-8168-ac2ce9e7e41f req-08e460f3-2965-49ad-ba83-77fd2f63ddcd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095432 Jun 16 14:42:24.926096 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 489/1002] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:24.947160 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-05cf5228-e273-486f-9e2f-e9553c63a648 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:24.950115 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-05cf5228-e273-486f-9e2f-e9553c63a648 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:24.970789 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-05cf5228-e273-486f-9e2f-e9553c63a648 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:24.972133 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-05cf5228-e273-486f-9e2f-e9553c63a648 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:24.984750 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-05cf5228-e273-486f-9e2f-e9553c63a648 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:24.986314 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-05cf5228-e273-486f-9e2f-e9553c63a648 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:25.464426 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-05cf5228-e273-486f-9e2f-e9553c63a648 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:25.476909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-05cf5228-e273-486f-9e2f-e9553c63a648 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:25.480235 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-05cf5228-e273-486f-9e2f-e9553c63a648 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:25.482320 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-05cf5228-e273-486f-9e2f-e9553c63a648 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1606 microversion: 2.25 time: 0.553859 Jun 16 14:42:25.483530 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 490/1003] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:42:24 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1606 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:42:25.506851 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d65df2c8-c67e-481b-9492-27e67a978ebe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:25.511954 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d65df2c8-c67e-481b-9492-27e67a978ebe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:25.527793 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d65df2c8-c67e-481b-9492-27e67a978ebe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:25.529920 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d65df2c8-c67e-481b-9492-27e67a978ebe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:25.532920 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d65df2c8-c67e-481b-9492-27e67a978ebe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:25.534513 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d65df2c8-c67e-481b-9492-27e67a978ebe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:26.134308 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d65df2c8-c67e-481b-9492-27e67a978ebe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:26.164079 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d65df2c8-c67e-481b-9492-27e67a978ebe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1477 microversion: 2.1 time: 0.678372 Jun 16 14:42:26.165313 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 491/1004] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:25 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1477 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:26.190073 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4af64df4-4b28-4cc0-afef-e397790de7e3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:26.194344 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4af64df4-4b28-4cc0-afef-e397790de7e3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:26.218093 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4af64df4-4b28-4cc0-afef-e397790de7e3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:26.223839 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4af64df4-4b28-4cc0-afef-e397790de7e3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:26.226099 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4af64df4-4b28-4cc0-afef-e397790de7e3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:26.227286 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4af64df4-4b28-4cc0-afef-e397790de7e3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:26.542248 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-4af64df4-4b28-4cc0-afef-e397790de7e3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:26.554966 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4af64df4-4b28-4cc0-afef-e397790de7e3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1313 microversion: 2.1 time: 0.385245 Jun 16 14:42:26.556507 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 492/1005] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:26 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:26.562078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2ee1b885-f4a3-4f45-90a0-6cb09d7b1ede tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:26.562881 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2ee1b885-f4a3-4f45-90a0-6cb09d7b1ede tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:26.571817 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2ee1b885-f4a3-4f45-90a0-6cb09d7b1ede tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:26.572769 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2ee1b885-f4a3-4f45-90a0-6cb09d7b1ede tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:26.574308 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2ee1b885-f4a3-4f45-90a0-6cb09d7b1ede tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:26.575488 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2ee1b885-f4a3-4f45-90a0-6cb09d7b1ede tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:26.637673 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4af44396-ebd2-4d50-ac07-f3f528cfab7a tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2/action" status: 202 len: 0 microversion: 2.1 time: 3.219114 Jun 16 14:42:26.639518 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 514/1006] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:42:23 2022] POST /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2/action => generated 0 bytes in 3223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:42:26.832402 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2ee1b885-f4a3-4f45-90a0-6cb09d7b1ede tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.274124 Jun 16 14:42:26.835277 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 493/1007] 10.222.0.57 () {60 vars in 1315 bytes} [Thu Jun 16 14:42:26 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-interface => generated 284 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:42:26.858743 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-d4339b81-adfd-440f-a02e-115b1eb7b85a req-8c564d2b-3527-479b-931a-2d51798a46c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cb64d6-b915-425c-aed2-442d3e2a1676", "name": "network-vif-unplugged", "status": "completed", "tag": "dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:26.948035 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-d4339b81-adfd-440f-a02e-115b1eb7b85a req-8c564d2b-3527-479b-931a-2d51798a46c6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:26.949897 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-d4339b81-adfd-440f-a02e-115b1eb7b85a req-8c564d2b-3527-479b-931a-2d51798a46c6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:27.055691 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-d4339b81-adfd-440f-a02e-115b1eb7b85a req-8c564d2b-3527-479b-931a-2d51798a46c6 service nova] Creating event network-vif-unplugged:dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a for instance e8cb64d6-b915-425c-aed2-442d3e2a1676 on n-h1-836830-4 Jun 16 14:42:27.096264 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-d4339b81-adfd-440f-a02e-115b1eb7b85a req-8c564d2b-3527-479b-931a-2d51798a46c6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.258525 Jun 16 14:42:27.102368 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 494/1008] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:27.139092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-33c6626d-edf6-41d2-a9ce-99beb19f1ea8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:27.145584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-33c6626d-edf6-41d2-a9ce-99beb19f1ea8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:27.179250 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-33c6626d-edf6-41d2-a9ce-99beb19f1ea8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:27.180498 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-33c6626d-edf6-41d2-a9ce-99beb19f1ea8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:27.182691 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-33c6626d-edf6-41d2-a9ce-99beb19f1ea8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:27.183953 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-33c6626d-edf6-41d2-a9ce-99beb19f1ea8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:27.281979 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1b3ee91c-1acd-4ef1-b0d2-187a4633cbae tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0c07b0d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:27.488722 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b3ee91c-1acd-4ef1-b0d2-187a4633cbae tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:27.515957 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b3ee91c-1acd-4ef1-b0d2-187a4633cbae tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:27.538639 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b3ee91c-1acd-4ef1-b0d2-187a4633cbae tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:27.553372 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b3ee91c-1acd-4ef1-b0d2-187a4633cbae tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:27.720192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=9,nova_api:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:27.781086 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1b3ee91c-1acd-4ef1-b0d2-187a4633cbae tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/76b45c611061433e8eab06acbac6b1e0" status: 200 len: 148 microversion: 2.57 time: 1.138619 Jun 16 14:42:27.789277 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 515/1009] 10.222.0.57 () {62 vars in 1302 bytes} [Thu Jun 16 14:42:26 2022] PUT /compute/v2.1/os-quota-sets/76b45c611061433e8eab06acbac6b1e0 => generated 148 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:42:27.801906 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4fab2747-49bf-4e52-8967-7702a80413b5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1664809860"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:27.805123 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4fab2747-49bf-4e52-8967-7702a80413b5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:27.825488 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4fab2747-49bf-4e52-8967-7702a80413b5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:27.828715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4fab2747-49bf-4e52-8967-7702a80413b5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:27.831095 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4fab2747-49bf-4e52-8967-7702a80413b5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:27.832677 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4fab2747-49bf-4e52-8967-7702a80413b5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:27.841171 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:28.363714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-33c6626d-edf6-41d2-a9ce-99beb19f1ea8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:28.374471 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-33c6626d-edf6-41d2-a9ce-99beb19f1ea8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 1.267531 Jun 16 14:42:28.375069 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 495/1010] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:27 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:28.388105 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-de903368-c482-4240-91ee-945edb3cd5ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:28.393741 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-de903368-c482-4240-91ee-945edb3cd5ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:28.406317 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-de903368-c482-4240-91ee-945edb3cd5ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:28.409435 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-de903368-c482-4240-91ee-945edb3cd5ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:28.416103 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-de903368-c482-4240-91ee-945edb3cd5ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:28.416954 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-de903368-c482-4240-91ee-945edb3cd5ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:28.702315 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-de903368-c482-4240-91ee-945edb3cd5ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:28.715655 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-de903368-c482-4240-91ee-945edb3cd5ff tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1477 microversion: 2.1 time: 0.333067 Jun 16 14:42:28.727053 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 496/1011] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:28 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1477 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:28.732409 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cba8cb44-0d89-4b78-a6d6-239f8512fb69 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:28.733471 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cba8cb44-0d89-4b78-a6d6-239f8512fb69 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:28.741397 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cba8cb44-0d89-4b78-a6d6-239f8512fb69 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:28.742162 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cba8cb44-0d89-4b78-a6d6-239f8512fb69 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:28.743514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cba8cb44-0d89-4b78-a6d6-239f8512fb69 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:28.744149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cba8cb44-0d89-4b78-a6d6-239f8512fb69 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:29.040501 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.network.security_group_api [None req-4fab2747-49bf-4e52-8967-7702a80413b5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Adding security group 82b71b79-2f44-4ff3-8327-e6767db62a23 to port 6427fc84-9f0c-4e17-abd5-21b7c6824b81 Jun 16 14:42:29.221456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cba8cb44-0d89-4b78-a6d6-239f8512fb69 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:29.234135 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cba8cb44-0d89-4b78-a6d6-239f8512fb69 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1463 microversion: 2.1 time: 0.505612 Jun 16 14:42:29.240486 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 497/1012] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:28 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1463 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:29.250330 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-019c7330-8646-43c2-b6fd-c109bf2f8b16 tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Calling method '.version_select at 0x7fdf0c87cd30>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:29.542767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-019c7330-8646-43c2-b6fd-c109bf2f8b16 tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:29.546639 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-019c7330-8646-43c2-b6fd-c109bf2f8b16 tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:29.548447 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-019c7330-8646-43c2-b6fd-c109bf2f8b16 tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:29.552632 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-019c7330-8646-43c2-b6fd-c109bf2f8b16 tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:29.584142 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:29.616508 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-019c7330-8646-43c2-b6fd-c109bf2f8b16 tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/76b45c611061433e8eab06acbac6b1e0/detail" status: 200 len: 463 microversion: 2.57 time: 0.374529 Jun 16 14:42:29.624980 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 498/1013] 10.222.0.57 () {60 vars in 1303 bytes} [Thu Jun 16 14:42:29 2022] GET /compute/v2.1/os-quota-sets/76b45c611061433e8eab06acbac6b1e0/detail => generated 463 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:42:29.997027 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bbf850fb-c8f6-426b-ac9d-08f13dc6164c tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:30.004191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bbf850fb-c8f6-426b-ac9d-08f13dc6164c tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Searching by: {'deleted': False, 'project_id': '3d38dd5098f0487c96b0c314356fd937'} {{(pid=125862) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:42:30.016402 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bbf850fb-c8f6-426b-ac9d-08f13dc6164c tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:30.017619 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bbf850fb-c8f6-426b-ac9d-08f13dc6164c tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:30.018984 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bbf850fb-c8f6-426b-ac9d-08f13dc6164c tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:30.019883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bbf850fb-c8f6-426b-ac9d-08f13dc6164c tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:30.063823 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4fab2747-49bf-4e52-8967-7702a80413b5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2/action" status: 202 len: 0 microversion: 2.1 time: 2.273033 Jun 16 14:42:30.064512 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 516/1014] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:42:27 2022] POST /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2/action => generated 0 bytes in 2275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:42:30.072806 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5ee0582a-52de-46ca-90c6-b27ba8737d8c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:30.073815 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5ee0582a-52de-46ca-90c6-b27ba8737d8c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:30.088698 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5ee0582a-52de-46ca-90c6-b27ba8737d8c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:30.089158 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5ee0582a-52de-46ca-90c6-b27ba8737d8c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:30.089988 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5ee0582a-52de-46ca-90c6-b27ba8737d8c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:30.090462 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5ee0582a-52de-46ca-90c6-b27ba8737d8c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:30.262693 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bbf850fb-c8f6-426b-ac9d-08f13dc6164c tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.636431 Jun 16 14:42:30.263702 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 499/1015] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:42:29 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:42:30.281535 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-3f6de4dd-e7d1-4d24-9325-dc1f5d3815a8 req-d59f8049-dd37-473b-a771-fedadf96ffea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512e2984-9834-496e-b3a6-085dc29a58a2", "tag": "6427fc84-9f0c-4e17-abd5-21b7c6824b81"}, {"name": "network-changed", "server_uuid": "e8cb64d6-b915-425c-aed2-442d3e2a1676", "tag": "dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:30.315727 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3f6de4dd-e7d1-4d24-9325-dc1f5d3815a8 req-d59f8049-dd37-473b-a771-fedadf96ffea service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:30.317122 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3f6de4dd-e7d1-4d24-9325-dc1f5d3815a8 req-d59f8049-dd37-473b-a771-fedadf96ffea service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:30.347607 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-3f6de4dd-e7d1-4d24-9325-dc1f5d3815a8 req-d59f8049-dd37-473b-a771-fedadf96ffea service nova] Creating event network-changed:6427fc84-9f0c-4e17-abd5-21b7c6824b81 for instance 512e2984-9834-496e-b3a6-085dc29a58a2 on n-h2-836830-4 Jun 16 14:42:30.371023 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-3f6de4dd-e7d1-4d24-9325-dc1f5d3815a8 req-d59f8049-dd37-473b-a771-fedadf96ffea service nova] Creating event network-changed:dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a for instance e8cb64d6-b915-425c-aed2-442d3e2a1676 on n-h1-836830-4 Jun 16 14:42:30.391848 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-3f6de4dd-e7d1-4d24-9325-dc1f5d3815a8 req-d59f8049-dd37-473b-a771-fedadf96ffea service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.121104 Jun 16 14:42:30.393383 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 500/1016] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:30.428531 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-43179d0d-3b53-4a27-8510-c1c1729fd6e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:30.437247 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-43179d0d-3b53-4a27-8510-c1c1729fd6e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:30.476256 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-43179d0d-3b53-4a27-8510-c1c1729fd6e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:30.478196 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-43179d0d-3b53-4a27-8510-c1c1729fd6e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:30.479883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-43179d0d-3b53-4a27-8510-c1c1729fd6e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:30.480831 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-43179d0d-3b53-4a27-8510-c1c1729fd6e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:30.658851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5ee0582a-52de-46ca-90c6-b27ba8737d8c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:30.675689 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5ee0582a-52de-46ca-90c6-b27ba8737d8c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.609792 Jun 16 14:42:30.685442 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 517/1017] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:30 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:30.701104 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d3e88f77-e5f8-4614-8abf-48d6360db447 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:30.701348 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d3e88f77-e5f8-4614-8abf-48d6360db447 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:30.720855 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3e88f77-e5f8-4614-8abf-48d6360db447 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:30.721313 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3e88f77-e5f8-4614-8abf-48d6360db447 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:30.735014 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3e88f77-e5f8-4614-8abf-48d6360db447 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:30.735748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3e88f77-e5f8-4614-8abf-48d6360db447 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:30.926322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-43179d0d-3b53-4a27-8510-c1c1729fd6e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:30.945304 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-43179d0d-3b53-4a27-8510-c1c1729fd6e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1477 microversion: 2.1 time: 0.549334 Jun 16 14:42:30.946505 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 501/1018] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:30 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1477 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:30.953904 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a012d1b4-c431-4061-812b-cbfc39519fec tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0c267310>, body: {"quota_set": {"ram": "2048"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:31.151855 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d3e88f77-e5f8-4614-8abf-48d6360db447 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.463587 Jun 16 14:42:31.163374 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 518/1019] 10.222.0.57 () {58 vars in 1292 bytes} [Thu Jun 16 14:42:30 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2/os-security-groups => generated 1158 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:31.172871 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c53aad5e-863d-4f6e-a56d-8062300af845 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:31.185597 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c53aad5e-863d-4f6e-a56d-8062300af845 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Searching by: {'deleted': False} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:42:31.201029 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c53aad5e-863d-4f6e-a56d-8062300af845 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:31.201492 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c53aad5e-863d-4f6e-a56d-8062300af845 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:31.202327 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c53aad5e-863d-4f6e-a56d-8062300af845 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:31.202846 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c53aad5e-863d-4f6e-a56d-8062300af845 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:31.422481 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.multi_cell_list [None req-c53aad5e-863d-4f6e-a56d-8062300af845 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=125863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:42:31.601204 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a012d1b4-c431-4061-812b-cbfc39519fec tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:31.601685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a012d1b4-c431-4061-812b-cbfc39519fec tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:31.602606 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a012d1b4-c431-4061-812b-cbfc39519fec tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:31.603056 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a012d1b4-c431-4061-812b-cbfc39519fec tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:31.637173 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c53aad5e-863d-4f6e-a56d-8062300af845 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:31.637831 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c53aad5e-863d-4f6e-a56d-8062300af845 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:31.711543 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a012d1b4-c431-4061-812b-cbfc39519fec tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:31.727706 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a012d1b4-c431-4061-812b-cbfc39519fec tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:31.730581 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a012d1b4-c431-4061-812b-cbfc39519fec tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:31.731641 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a012d1b4-c431-4061-812b-cbfc39519fec tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:31.889400 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a012d1b4-c431-4061-812b-cbfc39519fec tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/76b45c611061433e8eab06acbac6b1e0?user_id=b46c31b6abc64f4880b94b18e3c9f3ad" status: 200 len: 148 microversion: 2.57 time: 0.939314 Jun 16 14:42:31.898005 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 502/1020] 10.222.0.57 () {62 vars in 1383 bytes} [Thu Jun 16 14:42:30 2022] PUT /compute/v2.1/os-quota-sets/76b45c611061433e8eab06acbac6b1e0?user_id=b46c31b6abc64f4880b94b18e3c9f3ad => generated 148 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:42:31.904352 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-170c2219-1381-4d5c-a820-1371ddbd359c req-bc389d21-1589-4ef1-92ca-a5ae745ef39e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4855363-724b-4eff-a76e-915e440af995", "tag": "f4722aca-79de-427f-b18d-882b6697a114"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:31.946261 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-170c2219-1381-4d5c-a820-1371ddbd359c req-bc389d21-1589-4ef1-92ca-a5ae745ef39e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:31.951278 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-170c2219-1381-4d5c-a820-1371ddbd359c req-bc389d21-1589-4ef1-92ca-a5ae745ef39e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:31.968174 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-170c2219-1381-4d5c-a820-1371ddbd359c req-bc389d21-1589-4ef1-92ca-a5ae745ef39e service nova] Creating event network-changed:f4722aca-79de-427f-b18d-882b6697a114 for instance e4855363-724b-4eff-a76e-915e440af995 on n-h2-836830-4 Jun 16 14:42:31.975309 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-170c2219-1381-4d5c-a820-1371ddbd359c req-bc389d21-1589-4ef1-92ca-a5ae745ef39e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075791 Jun 16 14:42:31.976643 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 503/1021] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:31.984398 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-815a59b3-1f97-4fc0-b45a-680a1295210f tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'create', calling method: .version_select at 0x7fdf0c4e14c0>, body: {"security_group": {"name": " tempest-securitygroup -1604619616 ", "description": "tempest-description-1900505801"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:32.355050 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-815a59b3-1f97-4fc0-b45a-680a1295210f tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.376542 Jun 16 14:42:32.356616 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 504/1022] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:42:31 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:32.373835 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7315b638-5235-43dd-8f40-838ec92d5993 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:32.375617 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7315b638-5235-43dd-8f40-838ec92d5993 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:32.399430 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7315b638-5235-43dd-8f40-838ec92d5993 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:32.399913 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7315b638-5235-43dd-8f40-838ec92d5993 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:32.400719 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7315b638-5235-43dd-8f40-838ec92d5993 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:32.401161 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7315b638-5235-43dd-8f40-838ec92d5993 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:32.581830 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c53aad5e-863d-4f6e-a56d-8062300af845 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 21812 microversion: 2.1 time: 1.415644 Jun 16 14:42:32.584581 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 519/1023] 10.222.0.57 () {58 vars in 1170 bytes} [Thu Jun 16 14:42:31 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 21812 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:42:32.626221 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-06b3530e-642d-4ce3-824a-367380b67276 tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] Calling method '.version_select at 0x7fdf0c1e8430>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:32.637770 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7315b638-5235-43dd-8f40-838ec92d5993 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:32.653445 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7315b638-5235-43dd-8f40-838ec92d5993 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.287311 Jun 16 14:42:32.654431 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 505/1024] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:32 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:32.659972 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-17fc8f65-c40b-47f4-b027-b9801dfe7d7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:32.660943 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-17fc8f65-c40b-47f4-b027-b9801dfe7d7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:32.669745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-17fc8f65-c40b-47f4-b027-b9801dfe7d7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:32.670271 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-17fc8f65-c40b-47f4-b027-b9801dfe7d7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:32.671342 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-17fc8f65-c40b-47f4-b027-b9801dfe7d7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:32.671999 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-17fc8f65-c40b-47f4-b027-b9801dfe7d7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:32.911938 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-17fc8f65-c40b-47f4-b027-b9801dfe7d7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:32.928773 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-17fc8f65-c40b-47f4-b027-b9801dfe7d7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1477 microversion: 2.1 time: 0.271953 Jun 16 14:42:32.935122 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 506/1025] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:32 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1477 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:32.945056 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-beff25aa-f296-438a-b294-3f59d820c400 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdf0c188160>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:33.071397 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-beff25aa-f296-438a-b294-3f59d820c400 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/93f158b7-1d87-46d2-b72a-c4045aee0f7b" status: 200 len: 224 microversion: 2.1 time: 0.133971 Jun 16 14:42:33.073385 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 507/1026] 10.222.0.57 () {58 vars in 1268 bytes} [Thu Jun 16 14:42:32 2022] GET /compute/v2.1/os-security-groups/93f158b7-1d87-46d2-b72a-c4045aee0f7b => generated 224 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:33.088560 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-8fdafb8b-e4b6-43a2-b142-394f2e1cc3a6 req-5726d4d7-3f48-43fc-a07b-d71a9362eac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512e2984-9834-496e-b3a6-085dc29a58a2", "tag": "6427fc84-9f0c-4e17-abd5-21b7c6824b81"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:33.122602 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-8fdafb8b-e4b6-43a2-b142-394f2e1cc3a6 req-5726d4d7-3f48-43fc-a07b-d71a9362eac4 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:33.126101 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-8fdafb8b-e4b6-43a2-b142-394f2e1cc3a6 req-5726d4d7-3f48-43fc-a07b-d71a9362eac4 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:33.155436 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-8fdafb8b-e4b6-43a2-b142-394f2e1cc3a6 req-5726d4d7-3f48-43fc-a07b-d71a9362eac4 service nova] Creating event network-changed:6427fc84-9f0c-4e17-abd5-21b7c6824b81 for instance 512e2984-9834-496e-b3a6-085dc29a58a2 on n-h2-836830-4 Jun 16 14:42:33.170705 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-8fdafb8b-e4b6-43a2-b142-394f2e1cc3a6 req-5726d4d7-3f48-43fc-a07b-d71a9362eac4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095174 Jun 16 14:42:33.172247 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 508/1027] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:33.211446 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-606c5c5a-7ee6-491d-a581-d09d4833fe7f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:33.221619 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-606c5c5a-7ee6-491d-a581-d09d4833fe7f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Searching by: {'deleted': False, 'project_id': '3d38dd5098f0487c96b0c314356fd937'} {{(pid=125862) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:42:33.233663 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-606c5c5a-7ee6-491d-a581-d09d4833fe7f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:33.234621 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-606c5c5a-7ee6-491d-a581-d09d4833fe7f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:33.236538 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-606c5c5a-7ee6-491d-a581-d09d4833fe7f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:33.237403 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-606c5c5a-7ee6-491d-a581-d09d4833fe7f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:33.308370 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-606c5c5a-7ee6-491d-a581-d09d4833fe7f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/detail?tenant_id=b50858433c774049b7c3fe4a4f98e948" status: 200 len: 15 microversion: 2.1 time: 0.134262 Jun 16 14:42:33.309363 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 509/1028] 10.222.0.57 () {58 vars in 1230 bytes} [Thu Jun 16 14:42:33 2022] GET /compute/v2.1/servers/detail?tenant_id=b50858433c774049b7c3fe4a4f98e948 => generated 15 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:42:33.324102 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-06b3530e-642d-4ce3-824a-367380b67276 tempest-QuotasAdminTestV257-822998762 tempest-QuotasAdminTestV257-822998762-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/76b45c611061433e8eab06acbac6b1e0?user_id=b46c31b6abc64f4880b94b18e3c9f3ad" status: 200 len: 190 microversion: 2.57 time: 0.735236 Jun 16 14:42:33.324438 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-90f56f97-e71f-43eb-b239-88e84af54c4d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdf0c87cf70>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:33.335514 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 520/1029] 10.222.0.57 () {60 vars in 1363 bytes} [Thu Jun 16 14:42:32 2022] GET /compute/v2.1/os-quota-sets/76b45c611061433e8eab06acbac6b1e0?user_id=b46c31b6abc64f4880b94b18e3c9f3ad => generated 190 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:42:33.350261 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5b0514aa-0b4c-42c0-ae5e-4cd078d6b2d3 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:33.363040 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5b0514aa-0b4c-42c0-ae5e-4cd078d6b2d3 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Searching by: {'tenant_id': 'b50858433c774049b7c3fe4a4f98e948', 'deleted': False} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:42:33.382110 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b0514aa-0b4c-42c0-ae5e-4cd078d6b2d3 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:33.382532 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b0514aa-0b4c-42c0-ae5e-4cd078d6b2d3 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:33.384951 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b0514aa-0b4c-42c0-ae5e-4cd078d6b2d3 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:33.385434 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b0514aa-0b4c-42c0-ae5e-4cd078d6b2d3 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:33.629536 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.multi_cell_list [None req-5b0514aa-0b4c-42c0-ae5e-4cd078d6b2d3 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:42:33.708101 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-90f56f97-e71f-43eb-b239-88e84af54c4d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/93f158b7-1d87-46d2-b72a-c4045aee0f7b" status: 202 len: 0 microversion: 2.1 time: 0.396732 Jun 16 14:42:33.709181 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 510/1030] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:42:33 2022] DELETE /compute/v2.1/os-security-groups/93f158b7-1d87-46d2-b72a-c4045aee0f7b => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:42:33.720195 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-595eae32-b8d6-4ddc-a6a2-09999903f26a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:33.723133 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-595eae32-b8d6-4ddc-a6a2-09999903f26a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:33.743297 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-595eae32-b8d6-4ddc-a6a2-09999903f26a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:33.744130 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-595eae32-b8d6-4ddc-a6a2-09999903f26a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:33.745880 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-595eae32-b8d6-4ddc-a6a2-09999903f26a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:33.746889 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-595eae32-b8d6-4ddc-a6a2-09999903f26a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:33.877003 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b0514aa-0b4c-42c0-ae5e-4cd078d6b2d3 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:33.878129 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b0514aa-0b4c-42c0-ae5e-4cd078d6b2d3 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:34.001571 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-595eae32-b8d6-4ddc-a6a2-09999903f26a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:34.022195 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-595eae32-b8d6-4ddc-a6a2-09999903f26a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.307504 Jun 16 14:42:34.024177 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 511/1031] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:33 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:34.039943 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8443b580-e328-4bf2-87b1-5e70fa0f2227 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdf0c1a0790>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:34.089927 n-d-836830-4 devstack@n-api.service[125862]: DEBUG neutronclient.v2_0.client [None req-8443b580-e328-4bf2-87b1-5e70fa0f2227 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist", "detail": ""}} {{(pid=125862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:42:34.099562 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.security_group_api [None req-8443b580-e328-4bf2-87b1-5e70fa0f2227 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Neutron security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b not found {{(pid=125862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 14:42:34.099562 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-8443b580-e328-4bf2-87b1-5e70fa0f2227 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist Jun 16 14:42:34.099562 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-fcb56d03-84bc-4563-a9b3-4634c80d018b'] Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8443b580-e328-4bf2-87b1-5e70fa0f2227 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-security-groups/93f158b7-1d87-46d2-b72a-c4045aee0f7b HTTP/1.1 Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:42:34.108172 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:42:34.110017 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:42:34.110017 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:42:34.110017 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:42:34.110017 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:42:34.110017 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:42:34.110017 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:42:34.110017 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:42:34.110017 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:42:34.110017 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:42:34.110017 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:42:34.110017 n-d-836830-4 devstack@n-api.service[125862]: exception: Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist Jun 16 14:42:34.110017 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-fcb56d03-84bc-4563-a9b3-4634c80d018b'] Jun 16 14:42:34.110017 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '93f158b7-1d87-46d2-b72a-c4045aee0f7b'} Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:34.111164 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcb56d03-84bc-4563-a9b3-4634c80d018b'] Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 14:42:34.112637 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcb56d03-84bc-4563-a9b3-4634c80d018b'] Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcb56d03-84bc-4563-a9b3-4634c80d018b'] Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:34.115177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:34.116949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:34.116949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:34.116949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:42:34.116949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:42:34.116949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist Jun 16 14:42:34.116949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcb56d03-84bc-4563-a9b3-4634c80d018b'] Jun 16 14:42:34.116949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:34.116949 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8443b580-e328-4bf2-87b1-5e70fa0f2227 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 404 to user: Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist Jun 16 14:42:34.116949 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-fcb56d03-84bc-4563-a9b3-4634c80d018b'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:42:34.118277 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8443b580-e328-4bf2-87b1-5e70fa0f2227 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/93f158b7-1d87-46d2-b72a-c4045aee0f7b" status: 404 len: 194 microversion: 2.1 time: 0.091194 Jun 16 14:42:34.119541 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 512/1032] 10.222.0.57 () {58 vars in 1268 bytes} [Thu Jun 16 14:42:34 2022] GET /compute/v2.1/os-security-groups/93f158b7-1d87-46d2-b72a-c4045aee0f7b => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:42:34.135270 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-366352cb-8864-41af-853b-39204a47fe0b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:34.136741 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-366352cb-8864-41af-853b-39204a47fe0b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:34.150893 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-366352cb-8864-41af-853b-39204a47fe0b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:34.151702 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-366352cb-8864-41af-853b-39204a47fe0b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:34.153174 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-366352cb-8864-41af-853b-39204a47fe0b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:34.154001 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-366352cb-8864-41af-853b-39204a47fe0b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:34.293369 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5b0514aa-0b4c-42c0-ae5e-4cd078d6b2d3 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b50858433c774049b7c3fe4a4f98e948" status: 200 len: 4822 microversion: 2.1 time: 0.956594 Jun 16 14:42:34.309695 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 521/1033] 10.222.0.57 () {58 vars in 1256 bytes} [Thu Jun 16 14:42:33 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b50858433c774049b7c3fe4a4f98e948 => generated 4822 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:34.322395 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6ff3d19b-707a-43c0-8023-ceb5ce1fc37d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'create', calling method: .version_select at 0x7fdf0c3ea3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-217859634", "description": "tempest-description-1545770489"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:34.382529 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-366352cb-8864-41af-853b-39204a47fe0b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:34.399800 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-366352cb-8864-41af-853b-39204a47fe0b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1477 microversion: 2.1 time: 0.278753 Jun 16 14:42:34.400976 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 513/1034] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:34 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:34.431034 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a3c81b94-2d89-4c08-882b-9253f964d616 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:34.444376 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a3c81b94-2d89-4c08-882b-9253f964d616 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Searching by: {'tenant_id': '3d38dd5098f0487c96b0c314356fd937', 'deleted': False} {{(pid=125862) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:42:34.459078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3c81b94-2d89-4c08-882b-9253f964d616 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:34.459945 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3c81b94-2d89-4c08-882b-9253f964d616 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:34.461499 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3c81b94-2d89-4c08-882b-9253f964d616 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:34.462269 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3c81b94-2d89-4c08-882b-9253f964d616 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:34.527809 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a3c81b94-2d89-4c08-882b-9253f964d616 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3d38dd5098f0487c96b0c314356fd937" status: 200 len: 15 microversion: 2.1 time: 0.109502 Jun 16 14:42:34.529586 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 514/1035] 10.222.0.57 () {58 vars in 1256 bytes} [Thu Jun 16 14:42:34 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3d38dd5098f0487c96b0c314356fd937 => generated 15 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:42:34.565945 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bf0eab6e-1bf1-4ac6-853e-21c5541f090e tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:34.616461 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bf0eab6e-1bf1-4ac6-853e-21c5541f090e tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.069081 Jun 16 14:42:34.632078 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 515/1036] 10.222.0.57 () {58 vars in 1188 bytes} [Thu Jun 16 14:42:34 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:42:34.648280 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2e00f023-d4b1-41e7-8939-5d8d04527d1d tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:34.652301 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2e00f023-d4b1-41e7-8939-5d8d04527d1d tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:34.659025 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:34.669548 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2e00f023-d4b1-41e7-8939-5d8d04527d1d tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:34.670521 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2e00f023-d4b1-41e7-8939-5d8d04527d1d tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:34.671818 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2e00f023-d4b1-41e7-8939-5d8d04527d1d tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:34.672770 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2e00f023-d4b1-41e7-8939-5d8d04527d1d tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:34.726073 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6ff3d19b-707a-43c0-8023-ceb5ce1fc37d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.417885 Jun 16 14:42:34.726758 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 522/1037] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:42:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:34.744542 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7a799510-fae4-4e95-ba99-706522a24837 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'create', calling method: .version_select at 0x7fdf0c0308b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-718099883", "description": "tempest-description-1595621312"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:34.825080 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2e00f023-d4b1-41e7-8939-5d8d04527d1d tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb/action" status: 202 len: 0 microversion: 2.1 time: 0.181062 Jun 16 14:42:34.828939 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 516/1038] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:42:34 2022] POST /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 14:42:34.839684 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c822f536-d26e-4b86-9509-0542c959727a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:34.844243 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c822f536-d26e-4b86-9509-0542c959727a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:34.845871 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c822f536-d26e-4b86-9509-0542c959727a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'b50858433c774049b7c3fe4a4f98e948'} {{(pid=125862) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:42:34.859248 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c822f536-d26e-4b86-9509-0542c959727a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:34.859248 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c822f536-d26e-4b86-9509-0542c959727a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:34.859248 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c822f536-d26e-4b86-9509-0542c959727a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:34.859248 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c822f536-d26e-4b86-9509-0542c959727a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:35.008990 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.multi_cell_list [None req-c822f536-d26e-4b86-9509-0542c959727a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:42:35.068221 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7a799510-fae4-4e95-ba99-706522a24837 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.329738 Jun 16 14:42:35.068829 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 523/1039] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:42:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:35.074605 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d198f4d5-c409-4187-bcc1-8458b3b82deb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:35.076109 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d198f4d5-c409-4187-bcc1-8458b3b82deb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:35.096731 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d198f4d5-c409-4187-bcc1-8458b3b82deb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:35.099407 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d198f4d5-c409-4187-bcc1-8458b3b82deb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:35.102220 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d198f4d5-c409-4187-bcc1-8458b3b82deb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:35.103417 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d198f4d5-c409-4187-bcc1-8458b3b82deb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:35.335316 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c822f536-d26e-4b86-9509-0542c959727a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers?status=error" status: 200 len: 337 microversion: 2.1 time: 0.501004 Jun 16 14:42:35.340048 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 517/1040] 10.222.0.57 () {58 vars in 1149 bytes} [Thu Jun 16 14:42:34 2022] GET /compute/v2.1/servers?status=error => generated 337 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:35.357004 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f33c0b7f-a487-4bb7-afd9-059348caa210 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'create', calling method: .version_select at 0x7fdf0c2679d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-628518420", "description": "tempest-description-1815943328"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:35.389580 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d198f4d5-c409-4187-bcc1-8458b3b82deb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:35.433396 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d198f4d5-c409-4187-bcc1-8458b3b82deb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.352257 Jun 16 14:42:35.435574 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 524/1041] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:35 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:35.464137 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4060b721-56d9-45ed-a5f9-4716c00b47b8 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:35.474193 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4060b721-56d9-45ed-a5f9-4716c00b47b8 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:35.507994 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4060b721-56d9-45ed-a5f9-4716c00b47b8 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:35.509357 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4060b721-56d9-45ed-a5f9-4716c00b47b8 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:35.511275 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4060b721-56d9-45ed-a5f9-4716c00b47b8 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:35.512078 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4060b721-56d9-45ed-a5f9-4716c00b47b8 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:35.721356 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4060b721-56d9-45ed-a5f9-4716c00b47b8 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb/action" status: 202 len: 0 microversion: 2.1 time: 0.278088 Jun 16 14:42:35.728837 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 525/1042] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:42:35 2022] POST /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:42:35.741524 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-078c9d32-9f10-4d59-84d1-8634f23c9bd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:35.742190 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-078c9d32-9f10-4d59-84d1-8634f23c9bd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:35.767926 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-078c9d32-9f10-4d59-84d1-8634f23c9bd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:35.771263 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-078c9d32-9f10-4d59-84d1-8634f23c9bd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:35.774536 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-078c9d32-9f10-4d59-84d1-8634f23c9bd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:35.776191 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-078c9d32-9f10-4d59-84d1-8634f23c9bd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:35.870921 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f33c0b7f-a487-4bb7-afd9-059348caa210 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.526850 Jun 16 14:42:35.872131 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 518/1043] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:42:35 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:35.877364 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ae1eb6ec-5ff1-489d-9f4e-9d394182c241 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:35.878414 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ae1eb6ec-5ff1-489d-9f4e-9d394182c241 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:35.892536 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ae1eb6ec-5ff1-489d-9f4e-9d394182c241 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:35.892874 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ae1eb6ec-5ff1-489d-9f4e-9d394182c241 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:35.898870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ae1eb6ec-5ff1-489d-9f4e-9d394182c241 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:35.899446 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ae1eb6ec-5ff1-489d-9f4e-9d394182c241 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:36.402477 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-078c9d32-9f10-4d59-84d1-8634f23c9bd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:36.424581 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-078c9d32-9f10-4d59-84d1-8634f23c9bd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1477 microversion: 2.1 time: 0.689823 Jun 16 14:42:36.426312 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 526/1044] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:35 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1477 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:36.438917 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-048c56cf-b6b2-4175-b27f-61117001206e tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdf0c07b940>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:36.489470 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ae1eb6ec-5ff1-489d-9f4e-9d394182c241 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1612 microversion: 2.1 time: 0.615766 Jun 16 14:42:36.509271 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 519/1045] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:35 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1612 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:36.522272 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b24b136f-8090-4e59-9050-d3a87cc797bd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:36.528920 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b24b136f-8090-4e59-9050-d3a87cc797bd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:36.550087 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b24b136f-8090-4e59-9050-d3a87cc797bd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:36.551524 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b24b136f-8090-4e59-9050-d3a87cc797bd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:36.552329 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b24b136f-8090-4e59-9050-d3a87cc797bd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:36.552857 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b24b136f-8090-4e59-9050-d3a87cc797bd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:36.969568 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b24b136f-8090-4e59-9050-d3a87cc797bd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:36.981941 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b24b136f-8090-4e59-9050-d3a87cc797bd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.468029 Jun 16 14:42:36.987235 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 520/1046] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:36 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:37.001058 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-56f36d00-1f71-45c5-a502-6a62a5a2ceb8 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:37.005074 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-56f36d00-1f71-45c5-a502-6a62a5a2ceb8 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:37.022876 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56f36d00-1f71-45c5-a502-6a62a5a2ceb8 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:37.022876 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56f36d00-1f71-45c5-a502-6a62a5a2ceb8 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:37.022876 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56f36d00-1f71-45c5-a502-6a62a5a2ceb8 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:37.022876 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56f36d00-1f71-45c5-a502-6a62a5a2ceb8 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:37.045544 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-048c56cf-b6b2-4175-b27f-61117001206e tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.617516 Jun 16 14:42:37.047467 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 527/1047] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:42:36 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:37.506270 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-56f36d00-1f71-45c5-a502-6a62a5a2ceb8 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1612 microversion: 2.1 time: 0.509830 Jun 16 14:42:37.514551 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 521/1048] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:36 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1612 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:37.539856 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a48bf543-dc14-4ea0-a1c0-99f575fc5293 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdf0c188c10>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:37.543795 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e722fae0-7a29-4d07-9e0b-750aa2a6829e tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f2d2641f-7c7f-41f9-89df-6d0cda8a508a"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:37.547413 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e722fae0-7a29-4d07-9e0b-750aa2a6829e tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:37.561171 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e722fae0-7a29-4d07-9e0b-750aa2a6829e tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:37.562009 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e722fae0-7a29-4d07-9e0b-750aa2a6829e tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:37.563578 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e722fae0-7a29-4d07-9e0b-750aa2a6829e tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:37.564631 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e722fae0-7a29-4d07-9e0b-750aa2a6829e tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:38.093444 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-e722fae0-7a29-4d07-9e0b-750aa2a6829e tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] HTTP exception thrown: Volume f2d2641f-7c7f-41f9-89df-6d0cda8a508a could not be found. Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e722fae0-7a29-4d07-9e0b-750aa2a6829e tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] Request method failure captured: Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: request: PUT /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments/446e32f1-f9b8-4287-b42c-e6bf92f6f16f HTTP/1.1 Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 74 Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0Dc41l-zrBSgjtO9Bd-jaUO8mZ2fss_gcE9CDo4V348tU7xIYxjZ-SlkRtb2to47iD59-lhKUhK5F_fF5R3j3GlFtHzwLuKV6aVhzt11w0Eun5iCuQDSOFBX-1St1w7xGL67zp6I-rLBiMiAkv2Vyn7zKnL8HWIB3X0-fXkDDaQKWw Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 922b9d07f9b0461a95beabbac86674ff Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-VolumesAdminNegativeTest-1506851913 Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:42:38.136101 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:42:38.139497 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_922b9d07f9b0461a95beabbac86674ff", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/922b9d07f9b0461a95beabbac86674ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/922b9d07f9b0461a95beabbac86674ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/922b9d07f9b0461a95beabbac86674ff"}]}] Jun 16 14:42:38.139497 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-VolumesAdminNegativeTest-1506851913 Jun 16 14:42:38.139497 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 922b9d07f9b0461a95beabbac86674ff Jun 16 14:42:38.139497 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1506851913 Jun 16 14:42:38.139497 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-VolumesAdminNegativeTest-1506851913-project-admin Jun 16 14:42:38.139497 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:42:38.139497 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:42:38.139497 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 41601ca682e349f7b916a6f3e57e9aa6 Jun 16 14:42:38.139497 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-VolumesAdminNegativeTest-1506851913-project-admin Jun 16 14:42:38.139497 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:42:38.139497 n-d-836830-4 devstack@n-api.service[125863]: {"volumeAttachment": {"volumeId": "f2d2641f-7c7f-41f9-89df-6d0cda8a508a"}} Jun 16 14:42:38.139497 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:42:38.139497 n-d-836830-4 devstack@n-api.service[125863]: exception: Volume f2d2641f-7c7f-41f9-89df-6d0cda8a508a could not be found. Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'server_id': 'b3e44fe0-8c95-439e-b249-80c3791ff385', 'id': '446e32f1-f9b8-4287-b42c-e6bf92f6f16f', 'body': {'volumeAttachment': {'volumeId': 'f2d2641f-7c7f-41f9-89df-6d0cda8a508a'}}} Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:42:38.147083 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2d2641f-7c7f-41f9-89df-6d0cda8a508a could not be found. (HTTP 404) (Request-ID: req-5d52200e-e916-4743-b81e-3f46e74e2541) Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:42:38.149134 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2d2641f-7c7f-41f9-89df-6d0cda8a508a could not be found. Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:42:38.153733 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume f2d2641f-7c7f-41f9-89df-6d0cda8a508a could not be found. Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2d2641f-7c7f-41f9-89df-6d0cda8a508a could not be found. Jun 16 14:42:38.160140 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:38.168740 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e722fae0-7a29-4d07-9e0b-750aa2a6829e tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] Returning 400 to user: Volume f2d2641f-7c7f-41f9-89df-6d0cda8a508a could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:42:38.194994 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e722fae0-7a29-4d07-9e0b-750aa2a6829e tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] 10.222.0.57 "PUT /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments/446e32f1-f9b8-4287-b42c-e6bf92f6f16f" status: 400 len: 107 microversion: 2.1 time: 1.123268 Jun 16 14:42:38.196511 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 528/1049] 10.222.0.57 () {60 vars in 1432 bytes} [Thu Jun 16 14:42:37 2022] PUT /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments/446e32f1-f9b8-4287-b42c-e6bf92f6f16f => generated 107 bytes in 1148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:42:38.258502 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a48bf543-dc14-4ea0-a1c0-99f575fc5293 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/0791aeaf-0e0e-440c-937a-653948ed0792" status: 202 len: 0 microversion: 2.1 time: 0.744351 Jun 16 14:42:38.260418 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 522/1050] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:42:37 2022] DELETE /compute/v2.1/os-security-groups/0791aeaf-0e0e-440c-937a-653948ed0792 => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:42:38.270171 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a18c4f29-9623-4771-b9cb-e682b69318a3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:38.271080 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a18c4f29-9623-4771-b9cb-e682b69318a3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:38.277323 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-607c41ba-5df8-4ea7-b0ca-a7bb5eb157f1 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:38.288599 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a18c4f29-9623-4771-b9cb-e682b69318a3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:38.289254 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a18c4f29-9623-4771-b9cb-e682b69318a3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:38.290093 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a18c4f29-9623-4771-b9cb-e682b69318a3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:38.290570 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a18c4f29-9623-4771-b9cb-e682b69318a3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:38.338855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-607c41ba-5df8-4ea7-b0ca-a7bb5eb157f1 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Searching by: {'host': 'n-h1-836830-4', 'deleted': False} {{(pid=125862) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:42:38.371743 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-607c41ba-5df8-4ea7-b0ca-a7bb5eb157f1 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:38.376269 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-607c41ba-5df8-4ea7-b0ca-a7bb5eb157f1 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:38.381312 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-607c41ba-5df8-4ea7-b0ca-a7bb5eb157f1 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:38.382478 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-607c41ba-5df8-4ea7-b0ca-a7bb5eb157f1 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:38.793630 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.multi_cell_list [None req-607c41ba-5df8-4ea7-b0ca-a7bb5eb157f1 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=125862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:42:38.873358 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a18c4f29-9623-4771-b9cb-e682b69318a3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:38.902482 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a18c4f29-9623-4771-b9cb-e682b69318a3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1477 microversion: 2.1 time: 0.684101 Jun 16 14:42:38.914582 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 529/1051] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:38 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1477 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:38.930611 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-47b350d4-0b23-45b9-8441-d9246a631d2a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:38.931834 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-47b350d4-0b23-45b9-8441-d9246a631d2a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:38.959281 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-47b350d4-0b23-45b9-8441-d9246a631d2a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:38.960107 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-47b350d4-0b23-45b9-8441-d9246a631d2a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:38.961561 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-47b350d4-0b23-45b9-8441-d9246a631d2a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:38.962354 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-47b350d4-0b23-45b9-8441-d9246a631d2a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:38.995227 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-607c41ba-5df8-4ea7-b0ca-a7bb5eb157f1 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "GET /compute/v2.1/servers?host=n-h1-836830-4&all_tenants=1" status: 200 len: 2296 microversion: 2.1 time: 0.731337 Jun 16 14:42:38.996490 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 523/1052] 10.222.0.57 () {58 vars in 1189 bytes} [Thu Jun 16 14:42:38 2022] GET /compute/v2.1/servers?host=n-h1-836830-4&all_tenants=1 => generated 2296 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:39.009276 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-945ff522-73f5-47fb-a2f3-81f0acb5bf56 req-3817e334-34ad-4898-925e-346d31e43712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cb64d6-b915-425c-aed2-442d3e2a1676", "name": "network-vif-unplugged", "status": "completed", "tag": "dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:39.051496 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-945ff522-73f5-47fb-a2f3-81f0acb5bf56 req-3817e334-34ad-4898-925e-346d31e43712 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:39.052836 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-945ff522-73f5-47fb-a2f3-81f0acb5bf56 req-3817e334-34ad-4898-925e-346d31e43712 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:39.097495 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-945ff522-73f5-47fb-a2f3-81f0acb5bf56 req-3817e334-34ad-4898-925e-346d31e43712 service nova] Creating event network-vif-unplugged:dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a for instance e8cb64d6-b915-425c-aed2-442d3e2a1676 on n-h1-836830-4 Jun 16 14:42:39.109167 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-945ff522-73f5-47fb-a2f3-81f0acb5bf56 req-3817e334-34ad-4898-925e-346d31e43712 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110628 Jun 16 14:42:39.110126 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 524/1053] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:39.124708 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7b5b1372-3230-4691-8506-a3c32698d846 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdf0c0eca60>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:39.180330 n-d-836830-4 devstack@n-api.service[125862]: DEBUG neutronclient.v2_0.client [None req-7b5b1372-3230-4691-8506-a3c32698d846 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist", "detail": ""}} {{(pid=125862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:42:39.180964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.security_group_api [None req-7b5b1372-3230-4691-8506-a3c32698d846 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Neutron security group 0791aeaf-0e0e-440c-937a-653948ed0792 not found {{(pid=125862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 14:42:39.181513 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-7b5b1372-3230-4691-8506-a3c32698d846 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist Jun 16 14:42:39.181513 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-26b5881b-0cdf-4547-ba50-c3c483bed08b'] Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7b5b1372-3230-4691-8506-a3c32698d846 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-security-groups/0791aeaf-0e0e-440c-937a-653948ed0792 HTTP/1.1 Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:42:39.183919 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:42:39.185607 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:42:39.185607 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:42:39.185607 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:42:39.185607 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:42:39.185607 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:42:39.185607 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:42:39.185607 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:42:39.185607 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:42:39.185607 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:42:39.185607 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:42:39.185607 n-d-836830-4 devstack@n-api.service[125862]: exception: Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist Jun 16 14:42:39.185607 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-26b5881b-0cdf-4547-ba50-c3c483bed08b'] Jun 16 14:42:39.185607 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '0791aeaf-0e0e-440c-937a-653948ed0792'} Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:39.186464 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26b5881b-0cdf-4547-ba50-c3c483bed08b'] Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 14:42:39.187720 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26b5881b-0cdf-4547-ba50-c3c483bed08b'] Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26b5881b-0cdf-4547-ba50-c3c483bed08b'] Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:39.188811 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:39.190266 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:39.190266 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:39.190266 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:42:39.190266 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:42:39.190266 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist Jun 16 14:42:39.190266 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26b5881b-0cdf-4547-ba50-c3c483bed08b'] Jun 16 14:42:39.190266 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:39.194663 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7b5b1372-3230-4691-8506-a3c32698d846 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 404 to user: Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist Jun 16 14:42:39.194663 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-26b5881b-0cdf-4547-ba50-c3c483bed08b'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:42:39.194663 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7b5b1372-3230-4691-8506-a3c32698d846 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/0791aeaf-0e0e-440c-937a-653948ed0792" status: 404 len: 194 microversion: 2.1 time: 0.082751 Jun 16 14:42:39.196320 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 525/1054] 10.222.0.57 () {58 vars in 1268 bytes} [Thu Jun 16 14:42:39 2022] GET /compute/v2.1/os-security-groups/0791aeaf-0e0e-440c-937a-653948ed0792 => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:42:39.202371 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fd4c8f6f-f91d-4962-a9e2-0ee3ca4ebc2a tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:39.203127 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fd4c8f6f-f91d-4962-a9e2-0ee3ca4ebc2a tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:39.218455 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd4c8f6f-f91d-4962-a9e2-0ee3ca4ebc2a tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:39.219355 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd4c8f6f-f91d-4962-a9e2-0ee3ca4ebc2a tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:39.223230 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd4c8f6f-f91d-4962-a9e2-0ee3ca4ebc2a tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:39.224423 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd4c8f6f-f91d-4962-a9e2-0ee3ca4ebc2a tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:39.292078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:39.348304 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-47b350d4-0b23-45b9-8441-d9246a631d2a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:39.360820 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-47b350d4-0b23-45b9-8441-d9246a631d2a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.449851 Jun 16 14:42:39.361421 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 530/1055] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:38 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:39.379865 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f9a340de-cde9-49a3-a4bd-1ab05594f9ab tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:39.390822 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f9a340de-cde9-49a3-a4bd-1ab05594f9ab tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:42:39.403250 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f9a340de-cde9-49a3-a4bd-1ab05594f9ab tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:39.404013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f9a340de-cde9-49a3-a4bd-1ab05594f9ab tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:39.405183 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f9a340de-cde9-49a3-a4bd-1ab05594f9ab tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:39.405862 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f9a340de-cde9-49a3-a4bd-1ab05594f9ab tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:39.575198 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f9a340de-cde9-49a3-a4bd-1ab05594f9ab tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.212616 Jun 16 14:42:39.577938 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 531/1056] 10.222.0.57 () {58 vars in 1195 bytes} [Thu Jun 16 14:42:39 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:42:39.590765 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4224749c-4bf4-4331-bb79-3bf8026c69c7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdeffdbd1f0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:39.631038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-fd4c8f6f-f91d-4962-a9e2-0ee3ca4ebc2a tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lazy-loading 'services' on Instance uuid b3e44fe0-8c95-439e-b249-80c3791ff385 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:42:39.831442 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fd4c8f6f-f91d-4962-a9e2-0ee3ca4ebc2a tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments/446e32f1-f9b8-4287-b42c-e6bf92f6f16f" status: 202 len: 0 microversion: 2.1 time: 0.628682 Jun 16 14:42:39.834033 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 526/1057] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jun 16 14:42:39 2022] DELETE /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments/446e32f1-f9b8-4287-b42c-e6bf92f6f16f => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:42:39.848960 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5d0ee28b-66ba-4a68-8b0f-adceeeee5432 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:39.851516 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5d0ee28b-66ba-4a68-8b0f-adceeeee5432 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:39.867065 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d0ee28b-66ba-4a68-8b0f-adceeeee5432 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:39.867826 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d0ee28b-66ba-4a68-8b0f-adceeeee5432 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:39.869217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d0ee28b-66ba-4a68-8b0f-adceeeee5432 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:39.870159 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d0ee28b-66ba-4a68-8b0f-adceeeee5432 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:40.100545 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5d0ee28b-66ba-4a68-8b0f-adceeeee5432 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb/action" status: 202 len: 0 microversion: 2.1 time: 0.260329 Jun 16 14:42:40.103599 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 527/1058] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:42:39 2022] POST /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:42:40.116471 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e308c796-fa69-4136-bbbc-294f136c9d71 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:40.119741 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e308c796-fa69-4136-bbbc-294f136c9d71 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:40.139625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e308c796-fa69-4136-bbbc-294f136c9d71 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:40.141593 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e308c796-fa69-4136-bbbc-294f136c9d71 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:40.144158 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e308c796-fa69-4136-bbbc-294f136c9d71 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:40.145423 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e308c796-fa69-4136-bbbc-294f136c9d71 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:40.258554 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e308c796-fa69-4136-bbbc-294f136c9d71 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152297 Jun 16 14:42:40.264727 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 528/1059] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:42:40 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:40.281064 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0aa6ddf3-6179-4198-a809-56041a9b81c8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:40.282238 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0aa6ddf3-6179-4198-a809-56041a9b81c8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:40.294728 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0aa6ddf3-6179-4198-a809-56041a9b81c8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:40.295480 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0aa6ddf3-6179-4198-a809-56041a9b81c8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:40.296972 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0aa6ddf3-6179-4198-a809-56041a9b81c8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:40.297416 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0aa6ddf3-6179-4198-a809-56041a9b81c8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:40.569150 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0aa6ddf3-6179-4198-a809-56041a9b81c8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:40.580116 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0aa6ddf3-6179-4198-a809-56041a9b81c8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1477 microversion: 2.1 time: 0.318721 Jun 16 14:42:40.582275 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 529/1060] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:40 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1477 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:40.588068 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:40.590258 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:40.600817 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:40.601285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:40.602658 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:40.603025 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:40.788239 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4224749c-4bf4-4331-bb79-3bf8026c69c7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/2a94d927-8e48-4ab0-ac5f-4ce77a4e21af" status: 202 len: 0 microversion: 2.1 time: 1.209093 Jun 16 14:42:40.789916 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 532/1061] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:42:39 2022] DELETE /compute/v2.1/os-security-groups/2a94d927-8e48-4ab0-ac5f-4ce77a4e21af => generated 0 bytes in 1211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:42:40.809343 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-73ad08dc-868e-468a-9f37-8643f8c5e772 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:40.813626 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:42:40.816348 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-73ad08dc-868e-468a-9f37-8643f8c5e772 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:40.818502 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:42:40.819363 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:42:40.821982 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:42:40.822815 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:42:40.836800 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-73ad08dc-868e-468a-9f37-8643f8c5e772 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:40.839615 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-73ad08dc-868e-468a-9f37-8643f8c5e772 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:40.842196 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-73ad08dc-868e-468a-9f37-8643f8c5e772 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:40.843189 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-73ad08dc-868e-468a-9f37-8643f8c5e772 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:41.079499 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:41.093599 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:41.094903 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:41.097439 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:41.098618 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:41.173533 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9d49e072-404b-46ee-bdc5-1c7972f44ded tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "POST /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb/action" status: 202 len: 1065 microversion: 2.1 time: 0.589370 Jun 16 14:42:41.174804 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 530/1062] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:42:40 2022] POST /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb/action => generated 1065 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 16 14:42:41.199259 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0e1c24dc-9ee3-4d21-8d58-20c4b1b7761c tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdf0c243040>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:41.311928 n-d-836830-4 devstack@n-api.service[125862]: DEBUG neutronclient.v2_0.client [None req-0e1c24dc-9ee3-4d21-8d58-20c4b1b7761c tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist", "detail": ""}} {{(pid=125862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:42:41.313480 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.security_group_api [None req-0e1c24dc-9ee3-4d21-8d58-20c4b1b7761c tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Neutron security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af not found {{(pid=125862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 14:42:41.315771 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-0e1c24dc-9ee3-4d21-8d58-20c4b1b7761c tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist Jun 16 14:42:41.315771 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-dae4f0db-9f68-4e57-943b-1019c25131ee'] Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0e1c24dc-9ee3-4d21-8d58-20c4b1b7761c tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-security-groups/2a94d927-8e48-4ab0-ac5f-4ce77a4e21af HTTP/1.1 Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:42:41.320839 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:42:41.324166 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:42:41.324166 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:42:41.324166 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:42:41.324166 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:42:41.324166 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:42:41.324166 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:42:41.324166 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:42:41.324166 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:42:41.324166 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:42:41.324166 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:42:41.324166 n-d-836830-4 devstack@n-api.service[125862]: exception: Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist Jun 16 14:42:41.324166 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-dae4f0db-9f68-4e57-943b-1019c25131ee'] Jun 16 14:42:41.324166 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '2a94d927-8e48-4ab0-ac5f-4ce77a4e21af'} Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:41.326828 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dae4f0db-9f68-4e57-943b-1019c25131ee'] Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 14:42:41.331139 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dae4f0db-9f68-4e57-943b-1019c25131ee'] Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dae4f0db-9f68-4e57-943b-1019c25131ee'] Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:41.337602 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:41.341643 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:41.341643 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:41.341643 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:42:41.341643 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:42:41.341643 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist Jun 16 14:42:41.341643 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dae4f0db-9f68-4e57-943b-1019c25131ee'] Jun 16 14:42:41.341643 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:42:41.343255 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-73ad08dc-868e-468a-9f37-8643f8c5e772 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:41.344986 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0e1c24dc-9ee3-4d21-8d58-20c4b1b7761c tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 404 to user: Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist Jun 16 14:42:41.344986 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-dae4f0db-9f68-4e57-943b-1019c25131ee'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:42:41.345367 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-73ad08dc-868e-468a-9f37-8643f8c5e772 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.552109 Jun 16 14:42:41.347229 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 533/1063] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:40 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:41.354910 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0e1c24dc-9ee3-4d21-8d58-20c4b1b7761c tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/2a94d927-8e48-4ab0-ac5f-4ce77a4e21af" status: 404 len: 194 microversion: 2.1 time: 0.159818 Jun 16 14:42:41.356323 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 531/1064] 10.222.0.57 () {58 vars in 1268 bytes} [Thu Jun 16 14:42:41 2022] GET /compute/v2.1/os-security-groups/2a94d927-8e48-4ab0-ac5f-4ce77a4e21af => generated 194 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:42:41.358885 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e893ecd8-9325-4004-bbd4-75960ecb0394 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:41.360793 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e893ecd8-9325-4004-bbd4-75960ecb0394 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:41.369306 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0140ff58-b613-4b46-a66a-20172f71016b tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:41.371639 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0140ff58-b613-4b46-a66a-20172f71016b tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:41.373912 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e893ecd8-9325-4004-bbd4-75960ecb0394 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:41.374414 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e893ecd8-9325-4004-bbd4-75960ecb0394 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:41.375261 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e893ecd8-9325-4004-bbd4-75960ecb0394 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:41.375703 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e893ecd8-9325-4004-bbd4-75960ecb0394 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:41.386688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0140ff58-b613-4b46-a66a-20172f71016b tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:41.387534 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0140ff58-b613-4b46-a66a-20172f71016b tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:41.389064 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0140ff58-b613-4b46-a66a-20172f71016b tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:41.389906 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0140ff58-b613-4b46-a66a-20172f71016b tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:41.461810 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0140ff58-b613-4b46-a66a-20172f71016b tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096823 Jun 16 14:42:41.464951 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 532/1065] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:42:41 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:41.485468 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0ec511b8-bc11-4b5c-b3ef-0f8db9a26e68 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdeffedd5e0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:41.788831 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e893ecd8-9325-4004-bbd4-75960ecb0394 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:41.859582 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e893ecd8-9325-4004-bbd4-75960ecb0394 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1469 microversion: 2.1 time: 0.501832 Jun 16 14:42:41.867758 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=14 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:41.869716 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 534/1066] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:41 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1469 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:41.891852 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-22de0ed4-fab1-4cbc-ab47-56e47dab46f0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:41.895862 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-22de0ed4-fab1-4cbc-ab47-56e47dab46f0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:41.923911 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-22de0ed4-fab1-4cbc-ab47-56e47dab46f0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:41.935111 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-22de0ed4-fab1-4cbc-ab47-56e47dab46f0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:41.937455 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-22de0ed4-fab1-4cbc-ab47-56e47dab46f0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:41.940393 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-22de0ed4-fab1-4cbc-ab47-56e47dab46f0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:42.636404 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-22de0ed4-fab1-4cbc-ab47-56e47dab46f0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:42.653297 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-22de0ed4-fab1-4cbc-ab47-56e47dab46f0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1476 microversion: 2.1 time: 0.779254 Jun 16 14:42:42.666214 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 535/1067] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:41 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1476 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:42.680991 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1a707147-95c8-4984-baf4-1506e9dbf809 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:42.686209 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1a707147-95c8-4984-baf4-1506e9dbf809 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:42.707193 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a707147-95c8-4984-baf4-1506e9dbf809 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:42.711024 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a707147-95c8-4984-baf4-1506e9dbf809 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:42.712563 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a707147-95c8-4984-baf4-1506e9dbf809 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:42.722339 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a707147-95c8-4984-baf4-1506e9dbf809 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:42.838151 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:43.070790 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0ec511b8-bc11-4b5c-b3ef-0f8db9a26e68 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/aa6ffe21-123a-4d9f-9caa-2b86c25197ae" status: 202 len: 0 microversion: 2.1 time: 1.602359 Jun 16 14:42:43.073238 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 533/1068] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:42:41 2022] DELETE /compute/v2.1/os-security-groups/aa6ffe21-123a-4d9f-9caa-2b86c25197ae => generated 0 bytes in 1607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:42:43.097966 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-966db3f6-40c7-4075-9e02-a0cc63bd9c39 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:43.107764 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-966db3f6-40c7-4075-9e02-a0cc63bd9c39 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:43.141770 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-966db3f6-40c7-4075-9e02-a0cc63bd9c39 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:43.143552 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-966db3f6-40c7-4075-9e02-a0cc63bd9c39 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:43.145361 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-966db3f6-40c7-4075-9e02-a0cc63bd9c39 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:43.151477 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-966db3f6-40c7-4075-9e02-a0cc63bd9c39 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:43.305938 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-966db3f6-40c7-4075-9e02-a0cc63bd9c39 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.230256 Jun 16 14:42:43.317445 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 534/1069] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:42:43 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments => generated 197 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:43.333972 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f16ea1dd-ccbb-4b0d-a12b-7f70af3a9ac8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:43.335816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f16ea1dd-ccbb-4b0d-a12b-7f70af3a9ac8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:43.364001 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f16ea1dd-ccbb-4b0d-a12b-7f70af3a9ac8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:43.377898 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f16ea1dd-ccbb-4b0d-a12b-7f70af3a9ac8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:43.381693 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f16ea1dd-ccbb-4b0d-a12b-7f70af3a9ac8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:43.385209 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f16ea1dd-ccbb-4b0d-a12b-7f70af3a9ac8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:43.855175 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=16 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:44.013278 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1a707147-95c8-4984-baf4-1506e9dbf809 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:44.057555 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1a707147-95c8-4984-baf4-1506e9dbf809 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 1.389116 Jun 16 14:42:44.059701 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 536/1070] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:42 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:44.080387 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6d7e1e58-73b7-4503-afa4-95740ab75b22 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdf0c07d670>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:44.112828 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f16ea1dd-ccbb-4b0d-a12b-7f70af3a9ac8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:44.125958 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f16ea1dd-ccbb-4b0d-a12b-7f70af3a9ac8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1469 microversion: 2.1 time: 0.806435 Jun 16 14:42:44.130444 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 535/1071] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:43 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1469 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:44.144477 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bfe82667-ad7a-4cb5-a585-a5f0712bcc15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:44.145219 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bfe82667-ad7a-4cb5-a585-a5f0712bcc15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:44.167451 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bfe82667-ad7a-4cb5-a585-a5f0712bcc15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:44.170775 n-d-836830-4 devstack@n-api.service[125863]: DEBUG neutronclient.v2_0.client [None req-6d7e1e58-73b7-4503-afa4-95740ab75b22 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist", "detail": ""}} {{(pid=125863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:42:44.171589 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bfe82667-ad7a-4cb5-a585-a5f0712bcc15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:44.172601 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.security_group_api [None req-6d7e1e58-73b7-4503-afa4-95740ab75b22 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Neutron security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae not found {{(pid=125863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 14:42:44.174648 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-6d7e1e58-73b7-4503-afa4-95740ab75b22 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist Jun 16 14:42:44.174648 n-d-836830-4 devstack@n-api.service[125863]: Neutron server returns request_ids: ['req-caeaae21-2874-4519-84a2-772b38458454'] Jun 16 14:42:44.175131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bfe82667-ad7a-4cb5-a585-a5f0712bcc15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:44.175484 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bfe82667-ad7a-4cb5-a585-a5f0712bcc15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6d7e1e58-73b7-4503-afa4-95740ab75b22 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/os-security-groups/aa6ffe21-123a-4d9f-9caa-2b86c25197ae HTTP/1.1 Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:42:44.184214 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:42:44.187115 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:42:44.187115 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:42:44.187115 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:42:44.187115 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:42:44.187115 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:42:44.187115 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:42:44.187115 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:42:44.187115 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:42:44.187115 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:42:44.187115 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:42:44.187115 n-d-836830-4 devstack@n-api.service[125863]: exception: Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist Jun 16 14:42:44.187115 n-d-836830-4 devstack@n-api.service[125863]: Neutron server returns request_ids: ['req-caeaae21-2874-4519-84a2-772b38458454'] Jun 16 14:42:44.187115 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'aa6ffe21-123a-4d9f-9caa-2b86c25197ae'} Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:44.188806 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caeaae21-2874-4519-84a2-772b38458454'] Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 14:42:44.191514 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caeaae21-2874-4519-84a2-772b38458454'] Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caeaae21-2874-4519-84a2-772b38458454'] Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:44.194871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:42:44.199342 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:42:44.199342 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:42:44.199342 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:42:44.199342 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:42:44.199342 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist Jun 16 14:42:44.199342 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-caeaae21-2874-4519-84a2-772b38458454'] Jun 16 14:42:44.199342 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:42:44.204608 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6d7e1e58-73b7-4503-afa4-95740ab75b22 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 404 to user: Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist Jun 16 14:42:44.204608 n-d-836830-4 devstack@n-api.service[125863]: Neutron server returns request_ids: ['req-caeaae21-2874-4519-84a2-772b38458454'] {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:42:44.208868 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6d7e1e58-73b7-4503-afa4-95740ab75b22 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/aa6ffe21-123a-4d9f-9caa-2b86c25197ae" status: 404 len: 194 microversion: 2.1 time: 0.136994 Jun 16 14:42:44.218643 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 537/1072] 10.222.0.57 () {58 vars in 1268 bytes} [Thu Jun 16 14:42:44 2022] GET /compute/v2.1/os-security-groups/aa6ffe21-123a-4d9f-9caa-2b86c25197ae => generated 194 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:42:44.244232 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-97da78ed-04da-44d6-b0e0-f389d7561785 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdf0c01a0d0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:45.166873 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-97da78ed-04da-44d6-b0e0-f389d7561785 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.945812 Jun 16 14:42:45.169046 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 538/1073] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:42:44 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:45.193182 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-85ab90c8-3da7-427b-800c-4a207ac2230f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:45.206705 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-85ab90c8-3da7-427b-800c-4a207ac2230f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:45.226371 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85ab90c8-3da7-427b-800c-4a207ac2230f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:45.232686 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85ab90c8-3da7-427b-800c-4a207ac2230f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:45.240195 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85ab90c8-3da7-427b-800c-4a207ac2230f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:45.241459 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85ab90c8-3da7-427b-800c-4a207ac2230f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:45.388672 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-85ab90c8-3da7-427b-800c-4a207ac2230f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.217129 Jun 16 14:42:45.389172 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 539/1074] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:42:45 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:45.403625 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-2716ecbb-1768-41b3-95f8-8e2eeab0317a req-7551c422-371a-4943-beec-be4829cb17e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2e2338-dec8-4753-a740-584fb8e9c439", "name": "network-vif-unplugged", "status": "completed", "tag": "91c43310-3cd5-422d-9c57-aa5e15664ff8"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:45.429789 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-2716ecbb-1768-41b3-95f8-8e2eeab0317a req-7551c422-371a-4943-beec-be4829cb17e6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:45.430692 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-2716ecbb-1768-41b3-95f8-8e2eeab0317a req-7551c422-371a-4943-beec-be4829cb17e6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:45.477859 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-2716ecbb-1768-41b3-95f8-8e2eeab0317a req-7551c422-371a-4943-beec-be4829cb17e6 service nova] Creating event network-vif-unplugged:91c43310-3cd5-422d-9c57-aa5e15664ff8 for instance 5b2e2338-dec8-4753-a740-584fb8e9c439 on n-h2-836830-4 Jun 16 14:42:45.504223 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [req-2716ecbb-1768-41b3-95f8-8e2eeab0317a req-7551c422-371a-4943-beec-be4829cb17e6 service nova] Instance 5b2e2338-dec8-4753-a740-584fb8e9c439 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:42:45.545169 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-2716ecbb-1768-41b3-95f8-8e2eeab0317a req-7551c422-371a-4943-beec-be4829cb17e6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154356 Jun 16 14:42:45.549586 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 540/1075] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:45.565557 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-13d34b32-8496-4d2d-aef7-94704b4660e3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:45.570588 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-13d34b32-8496-4d2d-aef7-94704b4660e3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:45.588828 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bfe82667-ad7a-4cb5-a585-a5f0712bcc15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:45.593845 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13d34b32-8496-4d2d-aef7-94704b4660e3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:45.600944 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13d34b32-8496-4d2d-aef7-94704b4660e3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:45.601411 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bfe82667-ad7a-4cb5-a585-a5f0712bcc15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1476 microversion: 2.1 time: 1.469638 Jun 16 14:42:45.603417 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 536/1076] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:44 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1476 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:45.604019 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13d34b32-8496-4d2d-aef7-94704b4660e3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:45.618307 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b34d41ca-4d78-4b16-944d-b977d70f7730 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:45.622884 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13d34b32-8496-4d2d-aef7-94704b4660e3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:45.633332 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b34d41ca-4d78-4b16-944d-b977d70f7730 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:45.655930 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b34d41ca-4d78-4b16-944d-b977d70f7730 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:45.656681 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b34d41ca-4d78-4b16-944d-b977d70f7730 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:45.659832 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b34d41ca-4d78-4b16-944d-b977d70f7730 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:45.663786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b34d41ca-4d78-4b16-944d-b977d70f7730 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:46.498811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b34d41ca-4d78-4b16-944d-b977d70f7730 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:46.535888 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b34d41ca-4d78-4b16-944d-b977d70f7730 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1469 microversion: 2.1 time: 0.928552 Jun 16 14:42:46.538646 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 537/1077] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:45 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1469 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:46.564647 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5a6efe2b-d6c7-4328-9c77-0e18f5c111d8 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'create', calling method: .version_select at 0x7fdf0c0d6430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-497807136", "description": "tempest-description-244482774"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:46.790851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-13d34b32-8496-4d2d-aef7-94704b4660e3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:46.812618 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-13d34b32-8496-4d2d-aef7-94704b4660e3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 1.251222 Jun 16 14:42:46.816257 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 541/1078] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:45 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:46.841157 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6a67f295-363b-4b28-8090-96d34ece9fa6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:46.843023 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6a67f295-363b-4b28-8090-96d34ece9fa6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:46.855989 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6a67f295-363b-4b28-8090-96d34ece9fa6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:46.856962 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6a67f295-363b-4b28-8090-96d34ece9fa6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:46.859046 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6a67f295-363b-4b28-8090-96d34ece9fa6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:46.862345 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6a67f295-363b-4b28-8090-96d34ece9fa6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:46.927289 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6a67f295-363b-4b28-8090-96d34ece9fa6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106009 Jun 16 14:42:46.933500 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 542/1079] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:42:46 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:46.947055 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a8cbaf93-58e8-49da-afc3-4254ef507d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:46.949669 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a8cbaf93-58e8-49da-afc3-4254ef507d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:46.957701 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a8cbaf93-58e8-49da-afc3-4254ef507d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:46.959843 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a8cbaf93-58e8-49da-afc3-4254ef507d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:46.961883 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a8cbaf93-58e8-49da-afc3-4254ef507d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:46.962824 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a8cbaf93-58e8-49da-afc3-4254ef507d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:47.554085 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a8cbaf93-58e8-49da-afc3-4254ef507d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:47.608481 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a8cbaf93-58e8-49da-afc3-4254ef507d35 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1476 microversion: 2.1 time: 0.672458 Jun 16 14:42:47.616660 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 543/1080] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:46 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1476 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:47.632040 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-69267947-c88a-4a1a-9295-03bde4ab8da0 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:47.633514 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-69267947-c88a-4a1a-9295-03bde4ab8da0 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:47.653644 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-69267947-c88a-4a1a-9295-03bde4ab8da0 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:47.655521 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-69267947-c88a-4a1a-9295-03bde4ab8da0 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:47.658863 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-69267947-c88a-4a1a-9295-03bde4ab8da0 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:47.661013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-69267947-c88a-4a1a-9295-03bde4ab8da0 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:47.700446 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5a6efe2b-d6c7-4328-9c77-0e18f5c111d8 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.158133 Jun 16 14:42:47.703419 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 538/1081] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:42:46 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:47.723578 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-34ec1464-939f-4ac3-9a9f-a04a5bc8d623 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'create', calling method: .version_select at 0x7fdeffef9430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1603273681", "description": "tempest-description-726719384"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:48.432588 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-69267947-c88a-4a1a-9295-03bde4ab8da0 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:48.446346 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-69267947-c88a-4a1a-9295-03bde4ab8da0 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1469 microversion: 2.1 time: 0.827151 Jun 16 14:42:48.446979 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 544/1082] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:47 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1469 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:48.466459 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-d7b9bf4b-32e4-433e-bb0d-dd75c816747b req-512df556-1ec0-4021-8b97-166b1cead8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2e2338-dec8-4753-a740-584fb8e9c439", "tag": "91c43310-3cd5-422d-9c57-aa5e15664ff8"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:48.476887 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-d7b9bf4b-32e4-433e-bb0d-dd75c816747b req-512df556-1ec0-4021-8b97-166b1cead8b6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:48.477612 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-d7b9bf4b-32e4-433e-bb0d-dd75c816747b req-512df556-1ec0-4021-8b97-166b1cead8b6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:48.501082 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-d7b9bf4b-32e4-433e-bb0d-dd75c816747b req-512df556-1ec0-4021-8b97-166b1cead8b6 service nova] Creating event network-changed:91c43310-3cd5-422d-9c57-aa5e15664ff8 for instance 5b2e2338-dec8-4753-a740-584fb8e9c439 on n-h2-836830-4 Jun 16 14:42:48.512640 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [req-d7b9bf4b-32e4-433e-bb0d-dd75c816747b req-512df556-1ec0-4021-8b97-166b1cead8b6 service nova] Instance 5b2e2338-dec8-4753-a740-584fb8e9c439 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:42:48.518785 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=17 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:48.540614 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-d7b9bf4b-32e4-433e-bb0d-dd75c816747b req-512df556-1ec0-4021-8b97-166b1cead8b6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091538 Jun 16 14:42:48.542533 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 545/1083] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:48.555510 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ff7b7aad-6186-4019-964a-3c9e43aa13a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:48.556964 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ff7b7aad-6186-4019-964a-3c9e43aa13a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:48.573548 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ff7b7aad-6186-4019-964a-3c9e43aa13a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:48.574798 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ff7b7aad-6186-4019-964a-3c9e43aa13a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:48.577365 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ff7b7aad-6186-4019-964a-3c9e43aa13a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:48.578628 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ff7b7aad-6186-4019-964a-3c9e43aa13a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:48.738750 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-34ec1464-939f-4ac3-9a9f-a04a5bc8d623 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.026333 Jun 16 14:42:48.738750 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 539/1084] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:42:47 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:48.756133 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fcaaffe9-76a1-4a99-a248-59361ca98079 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:48.757419 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fcaaffe9-76a1-4a99-a248-59361ca98079 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:48.764630 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fcaaffe9-76a1-4a99-a248-59361ca98079 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:48.765514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fcaaffe9-76a1-4a99-a248-59361ca98079 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:48.766663 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fcaaffe9-76a1-4a99-a248-59361ca98079 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:48.767577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fcaaffe9-76a1-4a99-a248-59361ca98079 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:48.805028 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fcaaffe9-76a1-4a99-a248-59361ca98079 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052807 Jun 16 14:42:48.806059 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 540/1085] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:42:48 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:48.811134 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2247cbe5-78bc-47cb-bf45-d70d6d44c189 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:48.812386 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2247cbe5-78bc-47cb-bf45-d70d6d44c189 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:48.820322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2247cbe5-78bc-47cb-bf45-d70d6d44c189 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:48.821124 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2247cbe5-78bc-47cb-bf45-d70d6d44c189 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:48.822530 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2247cbe5-78bc-47cb-bf45-d70d6d44c189 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:48.823230 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2247cbe5-78bc-47cb-bf45-d70d6d44c189 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:49.035959 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ff7b7aad-6186-4019-964a-3c9e43aa13a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:49.080835 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ff7b7aad-6186-4019-964a-3c9e43aa13a4 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.532291 Jun 16 14:42:49.082321 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 546/1086] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:48 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:49.138827 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1527390836", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "3e7fbc44-6cdd-4ced-8daa-54aa6f771c70"}]}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:49.278065 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] validate_networks() for [('3e7fbc44-6cdd-4ced-8daa-54aa6f771c70', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:42:49.494302 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=8 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:49.983414 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2247cbe5-78bc-47cb-bf45-d70d6d44c189 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:50.009752 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2247cbe5-78bc-47cb-bf45-d70d6d44c189 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1476 microversion: 2.1 time: 1.201606 Jun 16 14:42:50.011113 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 541/1087] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:48 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1476 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:50.024422 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e0114474-3131-440e-84e4-ebefe68c4cee tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:50.025904 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e0114474-3131-440e-84e4-ebefe68c4cee tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:50.039381 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0114474-3131-440e-84e4-ebefe68c4cee tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:50.040722 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0114474-3131-440e-84e4-ebefe68c4cee tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:50.042231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0114474-3131-440e-84e4-ebefe68c4cee tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:50.043272 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0114474-3131-440e-84e4-ebefe68c4cee tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:50.573302 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e0114474-3131-440e-84e4-ebefe68c4cee tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:50.577562 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:50.593566 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e0114474-3131-440e-84e4-ebefe68c4cee tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1469 microversion: 2.1 time: 0.580669 Jun 16 14:42:50.595376 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 542/1088] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:50 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1469 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:50.601298 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a338d614-6d23-43dc-897a-26f4c3690a7f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:50.618329 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a338d614-6d23-43dc-897a-26f4c3690a7f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:50.626072 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a338d614-6d23-43dc-897a-26f4c3690a7f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:50.626832 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a338d614-6d23-43dc-897a-26f4c3690a7f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:50.627876 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a338d614-6d23-43dc-897a-26f4c3690a7f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:50.639175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a338d614-6d23-43dc-897a-26f4c3690a7f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:50.711099 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a338d614-6d23-43dc-897a-26f4c3690a7f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114389 Jun 16 14:42:50.711997 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 543/1089] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:42:50 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:50.717206 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d60a8b32-19f7-4cdd-bac6-c10212cc8442 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:50.731435 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d60a8b32-19f7-4cdd-bac6-c10212cc8442 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:50.738517 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d60a8b32-19f7-4cdd-bac6-c10212cc8442 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:50.739275 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d60a8b32-19f7-4cdd-bac6-c10212cc8442 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:50.740318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d60a8b32-19f7-4cdd-bac6-c10212cc8442 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:50.740975 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d60a8b32-19f7-4cdd-bac6-c10212cc8442 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:50.859998 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:42:50.860727 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:42:50.861474 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:42:50.862344 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:42:50.863270 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:42:50.918328 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:50.926797 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:50.931223 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:50.937030 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:51.071899 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Getting quotas for project 070acceac9dc494481baedda1baf5740. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:42:51.124687 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Getting quotas for user 9669878ef64c4cb982dee4369c88e832 and project 070acceac9dc494481baedda1baf5740. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:42:51.150536 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d60a8b32-19f7-4cdd-bac6-c10212cc8442 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:51.166449 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d60a8b32-19f7-4cdd-bac6-c10212cc8442 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1717 microversion: 2.1 time: 0.452622 Jun 16 14:42:51.175881 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:42:51.177581 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 544/1090] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:50 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1717 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:51.193854 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:42:51.367302 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b60973b0-e6bd-497f-ae82-bbc2472afaf9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.260176 Jun 16 14:42:51.377289 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 547/1091] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:42:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:42:51.382791 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a442f82e-acc7-4420-bbb0-e78c76b1a285 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:51.386472 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a442f82e-acc7-4420-bbb0-e78c76b1a285 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:51.406190 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a442f82e-acc7-4420-bbb0-e78c76b1a285 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:51.409366 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a442f82e-acc7-4420-bbb0-e78c76b1a285 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:51.410546 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a442f82e-acc7-4420-bbb0-e78c76b1a285 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:51.416764 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a442f82e-acc7-4420-bbb0-e78c76b1a285 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:52.157125 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a442f82e-acc7-4420-bbb0-e78c76b1a285 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:52.176699 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a442f82e-acc7-4420-bbb0-e78c76b1a285 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1474 microversion: 2.1 time: 0.797619 Jun 16 14:42:52.204007 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 548/1092] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:51 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1474 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:52.212067 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2e895584-107d-4be7-9359-f231722268ee tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:52.214859 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2e895584-107d-4be7-9359-f231722268ee tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:52.263981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-308947379", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "18b171e3-0f91-4866-a080-5bc9876d1718"}]}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:52.438525 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] validate_networks() for [('18b171e3-0f91-4866-a080-5bc9876d1718', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:42:53.192626 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2e895584-107d-4be7-9359-f231722268ee tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:53.220102 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2e895584-107d-4be7-9359-f231722268ee tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1216 microversion: 2.1 time: 1.025178 Jun 16 14:42:53.223656 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 549/1093] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:52 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1216 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:53.232277 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e0373eb6-0c28-47e2-be98-eda11a886486 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:53.235678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e0373eb6-0c28-47e2-be98-eda11a886486 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:53.256459 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e0373eb6-0c28-47e2-be98-eda11a886486 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:53.257240 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e0373eb6-0c28-47e2-be98-eda11a886486 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:53.258542 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e0373eb6-0c28-47e2-be98-eda11a886486 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:53.259208 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e0373eb6-0c28-47e2-be98-eda11a886486 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:53.459862 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:42:53.461457 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:42:53.462510 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:42:53.463508 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:42:53.464743 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:42:53.485843 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:53.486652 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e0373eb6-0c28-47e2-be98-eda11a886486 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:53.487562 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:53.489349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:53.490420 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:53.508192 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e0373eb6-0c28-47e2-be98-eda11a886486 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1469 microversion: 2.1 time: 0.282698 Jun 16 14:42:53.510345 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 550/1094] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:53 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1469 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:53.531761 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-498880a2-1355-4ff4-b949-98a8fdb47950 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:53.533652 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-498880a2-1355-4ff4-b949-98a8fdb47950 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:53.547088 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-498880a2-1355-4ff4-b949-98a8fdb47950 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:53.547333 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Getting quotas for project 2e7a1522e65c4da888c7823ce928a7b7. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:42:53.548334 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-498880a2-1355-4ff4-b949-98a8fdb47950 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:53.549801 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-498880a2-1355-4ff4-b949-98a8fdb47950 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:53.550694 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-498880a2-1355-4ff4-b949-98a8fdb47950 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:53.564270 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Getting quotas for user 0081c3e617394557a0eab45883186c09 and project 2e7a1522e65c4da888c7823ce928a7b7. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:42:53.597077 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:42:53.603464 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:42:53.622217 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-498880a2-1355-4ff4-b949-98a8fdb47950 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099491 Jun 16 14:42:53.623727 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 551/1095] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:42:53 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:53.634977 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f3f5dfb2-4e2d-4228-837b-bf62a8043279 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:53.637048 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f3f5dfb2-4e2d-4228-837b-bf62a8043279 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:53.654895 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f3f5dfb2-4e2d-4228-837b-bf62a8043279 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:53.655530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f3f5dfb2-4e2d-4228-837b-bf62a8043279 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:53.657109 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f3f5dfb2-4e2d-4228-837b-bf62a8043279 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:53.658075 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f3f5dfb2-4e2d-4228-837b-bf62a8043279 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:53.761829 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d1acc57f-fdd5-4cbe-87c1-beba6508ab18 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.572467 Jun 16 14:42:53.774639 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 545/1096] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:42:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:42:53.794258 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8b2d2f74-632b-4e1c-a386-766c01749f3c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:53.811257 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8b2d2f74-632b-4e1c-a386-766c01749f3c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:53.839028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8b2d2f74-632b-4e1c-a386-766c01749f3c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:53.840127 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8b2d2f74-632b-4e1c-a386-766c01749f3c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:53.841247 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8b2d2f74-632b-4e1c-a386-766c01749f3c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:53.842013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8b2d2f74-632b-4e1c-a386-766c01749f3c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:53.992893 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f3f5dfb2-4e2d-4228-837b-bf62a8043279 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:54.020393 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f3f5dfb2-4e2d-4228-837b-bf62a8043279 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1707 microversion: 2.1 time: 0.393193 Jun 16 14:42:54.034571 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 552/1097] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:53 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1707 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:54.052622 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-53f16ed9-3120-497b-be5e-d53f7f014fdc tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Calling method '.version_select at 0x7fdeffced820>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:54.068790 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8b2d2f74-632b-4e1c-a386-766c01749f3c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:54.079215 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8b2d2f74-632b-4e1c-a386-766c01749f3c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1471 microversion: 2.1 time: 0.302490 Jun 16 14:42:54.092488 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 546/1098] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:53 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:54.097739 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-79526327-35e0-4359-b3cc-a48fb6fc48ea tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:54.098407 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-79526327-35e0-4359-b3cc-a48fb6fc48ea tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:54.138792 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-53f16ed9-3120-497b-be5e-d53f7f014fdc tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "GET /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad" status: 200 len: 636 microversion: 2.1 time: 0.101005 Jun 16 14:42:54.143788 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 553/1099] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:42:54 2022] GET /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad => generated 636 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:54.150274 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-14e3dad4-890e-4776-b8b7-34d36d464658 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '.version_select at 0x7fdeffced4c0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:54.154948 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14e3dad4-890e-4776-b8b7-34d36d464658 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:54.163087 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14e3dad4-890e-4776-b8b7-34d36d464658 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:54.190278 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-14e3dad4-890e-4776-b8b7-34d36d464658 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 2719 microversion: 2.1 time: 0.044563 Jun 16 14:42:54.192089 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 554/1100] 10.222.0.57 () {58 vars in 1142 bytes} [Thu Jun 16 14:42:54 2022] GET /compute/v2.1/os-migrations => generated 2719 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:54.198858 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-684d9cb8-8460-43dd-a2b9-df168864835e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:54.201192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-684d9cb8-8460-43dd-a2b9-df168864835e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:54.213651 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-684d9cb8-8460-43dd-a2b9-df168864835e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:54.214714 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-684d9cb8-8460-43dd-a2b9-df168864835e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:54.216277 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-684d9cb8-8460-43dd-a2b9-df168864835e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:54.217217 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-684d9cb8-8460-43dd-a2b9-df168864835e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:54.273431 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-79526327-35e0-4359-b3cc-a48fb6fc48ea tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:54.281753 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-79526327-35e0-4359-b3cc-a48fb6fc48ea tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1231 microversion: 2.1 time: 0.187476 Jun 16 14:42:54.282392 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 547/1101] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:54 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1231 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:54.300013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d3840372-4915-4742-bbb3-7c1b239d7fdf tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Action: 'update_all', calling method: .version_select at 0x7fdeffedd0d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:54.365477 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-684d9cb8-8460-43dd-a2b9-df168864835e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "POST /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439/action" status: 204 len: 0 microversion: 2.1 time: 0.170115 Jun 16 14:42:54.367001 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 555/1102] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:42:54 2022] POST /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439/action => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:54.383618 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-06dd42c5-ab67-4c3a-a7a4-fa35823651eb tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:54.387826 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-06dd42c5-ab67-4c3a-a7a4-fa35823651eb tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:54.406400 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06dd42c5-ab67-4c3a-a7a4-fa35823651eb tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:54.414910 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06dd42c5-ab67-4c3a-a7a4-fa35823651eb tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:54.416385 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06dd42c5-ab67-4c3a-a7a4-fa35823651eb tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:54.417172 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-06dd42c5-ab67-4c3a-a7a4-fa35823651eb tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:54.457648 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-d3840372-4915-4742-bbb3-7c1b239d7fdf tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:42:54.469822 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-d3840372-4915-4742-bbb3-7c1b239d7fdf tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for user ee0918861278473899ea38acd4094b92 and project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:42:54.819058 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-06dd42c5-ab67-4c3a-a7a4-fa35823651eb tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1858 microversion: 2.1 time: 0.445570 Jun 16 14:42:54.830958 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 556/1103] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:54 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1858 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:54.841693 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d9a393d5-c712-485b-8ef1-7f1ba03f24b7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:54.841693 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d9a393d5-c712-485b-8ef1-7f1ba03f24b7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:54.856393 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d9a393d5-c712-485b-8ef1-7f1ba03f24b7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:54.864959 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d9a393d5-c712-485b-8ef1-7f1ba03f24b7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:54.866608 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d9a393d5-c712-485b-8ef1-7f1ba03f24b7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:54.867426 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d9a393d5-c712-485b-8ef1-7f1ba03f24b7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:54.969228 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d9a393d5-c712-485b-8ef1-7f1ba03f24b7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:54.977994 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d9a393d5-c712-485b-8ef1-7f1ba03f24b7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1268 microversion: 2.1 time: 0.145872 Jun 16 14:42:54.978643 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 557/1104] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:54 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:54.983880 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6045d828-9547-43ec-b485-e188e100b514 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:54.984519 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6045d828-9547-43ec-b485-e188e100b514 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:54.993419 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6045d828-9547-43ec-b485-e188e100b514 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:54.994513 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6045d828-9547-43ec-b485-e188e100b514 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:54.995425 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6045d828-9547-43ec-b485-e188e100b514 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:54.996342 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6045d828-9547-43ec-b485-e188e100b514 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:55.000022 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:55.093597 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d3840372-4915-4742-bbb3-7c1b239d7fdf tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata" status: 200 len: 61 microversion: 2.1 time: 0.805801 Jun 16 14:42:55.095298 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 548/1105] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 16 14:42:54 2022] PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata => generated 61 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:42:55.100165 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7f6a2a60-01a4-4034-b096-c8bb31cacc01 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:55.100831 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7f6a2a60-01a4-4034-b096-c8bb31cacc01 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:55.108548 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f6a2a60-01a4-4034-b096-c8bb31cacc01 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:55.109203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f6a2a60-01a4-4034-b096-c8bb31cacc01 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:55.110296 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f6a2a60-01a4-4034-b096-c8bb31cacc01 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:55.110813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f6a2a60-01a4-4034-b096-c8bb31cacc01 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:55.271172 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6045d828-9547-43ec-b485-e188e100b514 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:55.286530 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6045d828-9547-43ec-b485-e188e100b514 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1471 microversion: 2.1 time: 0.306724 Jun 16 14:42:55.287827 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 558/1106] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:54 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1471 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:55.293578 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c06ba4ad-6acf-4136-adae-d094c8ab277e tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:55.294942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c06ba4ad-6acf-4136-adae-d094c8ab277e tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:55.299874 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:55.307855 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c06ba4ad-6acf-4136-adae-d094c8ab277e tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:55.308660 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c06ba4ad-6acf-4136-adae-d094c8ab277e tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:55.309649 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c06ba4ad-6acf-4136-adae-d094c8ab277e tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:55.310278 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c06ba4ad-6acf-4136-adae-d094c8ab277e tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:55.371845 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c06ba4ad-6acf-4136-adae-d094c8ab277e tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082686 Jun 16 14:42:55.372735 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 559/1107] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:42:55 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:42:55.385701 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b809e514-8f18-4652-a091-0f781ce01afa tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:55.386801 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b809e514-8f18-4652-a091-0f781ce01afa tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:55.430861 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b809e514-8f18-4652-a091-0f781ce01afa tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:55.431770 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b809e514-8f18-4652-a091-0f781ce01afa tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:55.438983 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b809e514-8f18-4652-a091-0f781ce01afa tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:55.439797 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b809e514-8f18-4652-a091-0f781ce01afa tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:55.493373 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7f6a2a60-01a4-4034-b096-c8bb31cacc01 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:55.532814 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7f6a2a60-01a4-4034-b096-c8bb31cacc01 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1475 microversion: 2.1 time: 0.433872 Jun 16 14:42:55.544219 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 549/1108] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:55 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1475 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:55.568519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7e44c472-d9ae-4249-9089-049c0393b106 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Calling method '.version_select at 0x7fdeffedd820>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:55.948208 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b809e514-8f18-4652-a091-0f781ce01afa tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1858 microversion: 2.1 time: 0.573403 Jun 16 14:42:55.950772 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 560/1109] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:55 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1858 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:55.962238 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-49769158-8248-4337-af0c-6681e6a7dd52 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:56.005782 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-49769158-8248-4337-af0c-6681e6a7dd52 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:56.039196 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-49769158-8248-4337-af0c-6681e6a7dd52 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:56.043298 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-49769158-8248-4337-af0c-6681e6a7dd52 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:56.045039 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-49769158-8248-4337-af0c-6681e6a7dd52 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:56.045850 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-49769158-8248-4337-af0c-6681e6a7dd52 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:56.214112 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7e44c472-d9ae-4249-9089-049c0393b106 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "DELETE /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.668227 Jun 16 14:42:56.215426 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 550/1110] 10.222.0.57 () {58 vars in 1295 bytes} [Thu Jun 16 14:42:55 2022] DELETE /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata/os_version => generated 0 bytes in 671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:56.222217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-340767526", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "b3568ba0-4c94-455d-b4a9-861990b40618"}]}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:56.226942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-49769158-8248-4337-af0c-6681e6a7dd52 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:56.248231 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-49769158-8248-4337-af0c-6681e6a7dd52 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1227 microversion: 2.1 time: 0.293486 Jun 16 14:42:56.250736 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 561/1111] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:55 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1227 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:56.266461 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-5b0f6c05-6278-470f-a9be-2a80ed799734 req-41043870-4705-47f8-a70c-219440223b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2e2338-dec8-4753-a740-584fb8e9c439", "name": "network-vif-plugged", "status": "completed", "tag": "91c43310-3cd5-422d-9c57-aa5e15664ff8"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:56.292685 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-5b0f6c05-6278-470f-a9be-2a80ed799734 req-41043870-4705-47f8-a70c-219440223b23 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:56.293519 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-5b0f6c05-6278-470f-a9be-2a80ed799734 req-41043870-4705-47f8-a70c-219440223b23 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:56.306710 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] validate_networks() for [('b3568ba0-4c94-455d-b4a9-861990b40618', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:42:56.315545 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-5b0f6c05-6278-470f-a9be-2a80ed799734 req-41043870-4705-47f8-a70c-219440223b23 service nova] Creating event network-vif-plugged:91c43310-3cd5-422d-9c57-aa5e15664ff8 for instance 5b2e2338-dec8-4753-a740-584fb8e9c439 on n-h2-836830-4 Jun 16 14:42:56.322111 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [req-5b0f6c05-6278-470f-a9be-2a80ed799734 req-41043870-4705-47f8-a70c-219440223b23 service nova] Instance 5b2e2338-dec8-4753-a740-584fb8e9c439 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:42:56.336053 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-5b0f6c05-6278-470f-a9be-2a80ed799734 req-41043870-4705-47f8-a70c-219440223b23 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082584 Jun 16 14:42:56.337123 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 562/1112] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:56.343627 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7ca235cc-797f-452c-9ca5-dd7a6d0d3473 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:56.344884 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7ca235cc-797f-452c-9ca5-dd7a6d0d3473 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:56.352480 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ca235cc-797f-452c-9ca5-dd7a6d0d3473 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:56.353192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ca235cc-797f-452c-9ca5-dd7a6d0d3473 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:56.353990 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ca235cc-797f-452c-9ca5-dd7a6d0d3473 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:56.354694 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ca235cc-797f-452c-9ca5-dd7a6d0d3473 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:56.445087 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7ca235cc-797f-452c-9ca5-dd7a6d0d3473 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:56.456568 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7ca235cc-797f-452c-9ca5-dd7a6d0d3473 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1286 microversion: 2.1 time: 0.117749 Jun 16 14:42:56.457353 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 563/1113] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:56 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:56.462839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7427c1de-7f7a-40f9-a6e6-0b296f1ea9e2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:56.463434 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7427c1de-7f7a-40f9-a6e6-0b296f1ea9e2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:56.471112 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7427c1de-7f7a-40f9-a6e6-0b296f1ea9e2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:56.471575 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7427c1de-7f7a-40f9-a6e6-0b296f1ea9e2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:56.472468 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7427c1de-7f7a-40f9-a6e6-0b296f1ea9e2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:56.472986 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7427c1de-7f7a-40f9-a6e6-0b296f1ea9e2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:56.655828 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-7427c1de-7f7a-40f9-a6e6-0b296f1ea9e2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lazy-loading 'services' on Instance uuid e8cb64d6-b915-425c-aed2-442d3e2a1676 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:42:56.822274 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7427c1de-7f7a-40f9-a6e6-0b296f1ea9e2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments/6e5a7d9e-f40c-44c1-b05d-7e2a62ba5ab7" status: 202 len: 0 microversion: 2.1 time: 0.362896 Jun 16 14:42:56.823370 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 564/1114] 10.222.0.57 () {58 vars in 1415 bytes} [Thu Jun 16 14:42:56 2022] DELETE /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments/6e5a7d9e-f40c-44c1-b05d-7e2a62ba5ab7 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:42:56.832622 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0be7d225-dc6f-4e4e-b9da-a1b190368bc5 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Calling method '.version_select at 0x7fdeffceea60>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:56.897630 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0be7d225-dc6f-4e4e-b9da-a1b190368bc5 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "GET /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata" status: 200 len: 37 microversion: 2.1 time: 0.072310 Jun 16 14:42:56.902713 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 565/1115] 10.222.0.57 () {58 vars in 1259 bytes} [Thu Jun 16 14:42:56 2022] GET /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata => generated 37 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:42:56.906266 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0a427df1-4172-4b64-8705-114838c9a546 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:56.907314 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0a427df1-4172-4b64-8705-114838c9a546 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:56.918449 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0a427df1-4172-4b64-8705-114838c9a546 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:56.918929 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0a427df1-4172-4b64-8705-114838c9a546 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:56.919753 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0a427df1-4172-4b64-8705-114838c9a546 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:56.920232 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0a427df1-4172-4b64-8705-114838c9a546 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:56.949407 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:42:56.950484 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:42:56.951037 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:42:56.951530 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:42:56.952018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:42:56.968408 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:56.968582 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:56.969946 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:56.970811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:56.994852 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Getting quotas for project 1cb259849be2454ba564207db28025d4. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:42:57.002830 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Getting quotas for user 960ce02e58de4a02a547844c88034159 and project 1cb259849be2454ba564207db28025d4. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:42:57.019406 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:42:57.022301 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:42:57.103210 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-76bfb685-be89-4c91-9f50-18e8c1d93f46 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885666 Jun 16 14:42:57.106128 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 551/1116] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:42:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:42:57.114460 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-25877066-e271-4136-b4db-c28df82dae89 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:57.115608 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-25877066-e271-4136-b4db-c28df82dae89 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:57.126791 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25877066-e271-4136-b4db-c28df82dae89 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:57.127267 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25877066-e271-4136-b4db-c28df82dae89 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:57.128105 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25877066-e271-4136-b4db-c28df82dae89 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:57.128555 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25877066-e271-4136-b4db-c28df82dae89 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:57.153995 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0a427df1-4172-4b64-8705-114838c9a546 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:57.165541 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0a427df1-4172-4b64-8705-114838c9a546 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1471 microversion: 2.1 time: 0.266031 Jun 16 14:42:57.166360 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 566/1117] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:56 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1471 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:57.178987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4f26cddc-7b7c-4eda-9692-67da5540f517 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:57.181509 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4f26cddc-7b7c-4eda-9692-67da5540f517 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:57.192290 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f26cddc-7b7c-4eda-9692-67da5540f517 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:57.193213 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f26cddc-7b7c-4eda-9692-67da5540f517 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:57.194546 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f26cddc-7b7c-4eda-9692-67da5540f517 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:57.195560 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f26cddc-7b7c-4eda-9692-67da5540f517 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:57.245494 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4f26cddc-7b7c-4eda-9692-67da5540f517 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077213 Jun 16 14:42:57.246501 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 567/1118] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:42:57 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:57.255496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e0d29453-f912-4a9f-9c81-6212e811210a tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Action: 'update_all', calling method: .version_select at 0x7fdeffc82e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:57.347440 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-e0d29453-f912-4a9f-9c81-6212e811210a tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:42:57.355918 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-e0d29453-f912-4a9f-9c81-6212e811210a tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for user ee0918861278473899ea38acd4094b92 and project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:42:57.389408 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-25877066-e271-4136-b4db-c28df82dae89 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:57.408163 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-25877066-e271-4136-b4db-c28df82dae89 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1475 microversion: 2.1 time: 0.300046 Jun 16 14:42:57.409523 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 552/1119] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:57 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1475 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:57.419009 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b6f0ee5d-50c7-4fdf-bad8-a74a0b41171d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:57.420214 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b6f0ee5d-50c7-4fdf-bad8-a74a0b41171d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:57.439146 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:57.522440 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b6f0ee5d-50c7-4fdf-bad8-a74a0b41171d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:57.543805 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b6f0ee5d-50c7-4fdf-bad8-a74a0b41171d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1217 microversion: 2.1 time: 0.132722 Jun 16 14:42:57.544454 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 553/1120] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:57 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1217 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:57.551170 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1f15f677-370f-45d9-b8fa-ada8cd74cbc9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:57.551809 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1f15f677-370f-45d9-b8fa-ada8cd74cbc9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:57.560345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1f15f677-370f-45d9-b8fa-ada8cd74cbc9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:57.560891 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1f15f677-370f-45d9-b8fa-ada8cd74cbc9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:57.563168 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1f15f677-370f-45d9-b8fa-ada8cd74cbc9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:57.563702 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1f15f677-370f-45d9-b8fa-ada8cd74cbc9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:57.701468 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1f15f677-370f-45d9-b8fa-ada8cd74cbc9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:57.718079 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1f15f677-370f-45d9-b8fa-ada8cd74cbc9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1227 microversion: 2.1 time: 0.170713 Jun 16 14:42:57.719214 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 554/1121] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:57 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1227 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:57.730738 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-420a104b-f0cf-4009-aecb-4d95b458ebd0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:57.732426 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-420a104b-f0cf-4009-aecb-4d95b458ebd0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:57.744963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-420a104b-f0cf-4009-aecb-4d95b458ebd0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:57.746532 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-420a104b-f0cf-4009-aecb-4d95b458ebd0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:57.748417 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-420a104b-f0cf-4009-aecb-4d95b458ebd0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:57.750205 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-420a104b-f0cf-4009-aecb-4d95b458ebd0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:57.859887 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e0d29453-f912-4a9f-9c81-6212e811210a tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata" status: 200 len: 61 microversion: 2.1 time: 0.611497 Jun 16 14:42:57.861171 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 568/1122] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 16 14:42:57 2022] PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata => generated 61 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:42:57.873545 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-faac1c76-72e6-488e-9cea-bc6aca9a726e tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Calling method '.version_select at 0x7fdeffdbe670>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:57.911879 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-420a104b-f0cf-4009-aecb-4d95b458ebd0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:57.923037 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-420a104b-f0cf-4009-aecb-4d95b458ebd0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1286 microversion: 2.1 time: 0.200797 Jun 16 14:42:57.923851 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 555/1123] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:57 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1286 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:57.948908 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-faac1c76-72e6-488e-9cea-bc6aca9a726e tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "GET /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.079685 Jun 16 14:42:57.949820 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 569/1124] 10.222.0.57 () {58 vars in 1289 bytes} [Thu Jun 16 14:42:57 2022] GET /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata/os_distro => generated 33 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 14:42:57.964875 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4d5f826e-c453-4053-a435-378caa299b92 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Action: 'update_all', calling method: .version_select at 0x7fdf0c0d6550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:58.028868 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-4d5f826e-c453-4053-a435-378caa299b92 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:42:58.038849 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-4d5f826e-c453-4053-a435-378caa299b92 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for user ee0918861278473899ea38acd4094b92 and project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:42:58.206346 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-21b880f8-9125-4265-ada8-653224a7fc87 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:58.209611 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-21b880f8-9125-4265-ada8-653224a7fc87 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:58.254432 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-21b880f8-9125-4265-ada8-653224a7fc87 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:58.257591 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-21b880f8-9125-4265-ada8-653224a7fc87 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:58.259896 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-21b880f8-9125-4265-ada8-653224a7fc87 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:58.261554 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-21b880f8-9125-4265-ada8-653224a7fc87 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:58.736468 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4d5f826e-c453-4053-a435-378caa299b92 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata" status: 200 len: 61 microversion: 2.1 time: 0.776254 Jun 16 14:42:58.738133 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 556/1125] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 16 14:42:57 2022] PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata => generated 61 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 14:42:58.747603 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e778f157-64a5-43c2-a41f-b98a86719fcb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:58.759820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e778f157-64a5-43c2-a41f-b98a86719fcb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:58.772348 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e778f157-64a5-43c2-a41f-b98a86719fcb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:58.773145 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e778f157-64a5-43c2-a41f-b98a86719fcb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:58.775001 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e778f157-64a5-43c2-a41f-b98a86719fcb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:58.775829 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e778f157-64a5-43c2-a41f-b98a86719fcb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:58.898497 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e778f157-64a5-43c2-a41f-b98a86719fcb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157904 Jun 16 14:42:58.905638 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 557/1126] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:42:58 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:42:58.925956 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-98a10236-f47d-4496-b70c-d9bb092a3483 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:58.935349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-98a10236-f47d-4496-b70c-d9bb092a3483 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:58.988757 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-21b880f8-9125-4265-ada8-653224a7fc87 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:58.989858 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98a10236-f47d-4496-b70c-d9bb092a3483 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:58.990857 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98a10236-f47d-4496-b70c-d9bb092a3483 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:58.992010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98a10236-f47d-4496-b70c-d9bb092a3483 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:58.992568 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98a10236-f47d-4496-b70c-d9bb092a3483 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:59.017749 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-21b880f8-9125-4265-ada8-653224a7fc87 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1471 microversion: 2.1 time: 0.828309 Jun 16 14:42:59.019504 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 570/1127] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:58 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1471 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:59.030943 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-13f37b58-8c1f-4f89-8d18-208dd8bdbe34 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:59.032771 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-13f37b58-8c1f-4f89-8d18-208dd8bdbe34 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:59.063570 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13f37b58-8c1f-4f89-8d18-208dd8bdbe34 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:59.064937 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13f37b58-8c1f-4f89-8d18-208dd8bdbe34 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:59.066677 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13f37b58-8c1f-4f89-8d18-208dd8bdbe34 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:59.067627 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13f37b58-8c1f-4f89-8d18-208dd8bdbe34 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:59.262786 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-13f37b58-8c1f-4f89-8d18-208dd8bdbe34 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:59.289449 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-13f37b58-8c1f-4f89-8d18-208dd8bdbe34 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1269 microversion: 2.1 time: 0.267322 Jun 16 14:42:59.291525 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 571/1128] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:59 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1269 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:59.302974 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-960b2ef5-e5a4-448b-865e-7b90a3e1804e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:59.304527 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-960b2ef5-e5a4-448b-865e-7b90a3e1804e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:59.322810 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-960b2ef5-e5a4-448b-865e-7b90a3e1804e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:59.324072 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-960b2ef5-e5a4-448b-865e-7b90a3e1804e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:59.325717 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-960b2ef5-e5a4-448b-865e-7b90a3e1804e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:59.327374 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-960b2ef5-e5a4-448b-865e-7b90a3e1804e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:59.505817 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-98a10236-f47d-4496-b70c-d9bb092a3483 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:59.537009 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-98a10236-f47d-4496-b70c-d9bb092a3483 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1475 microversion: 2.1 time: 0.628695 Jun 16 14:42:59.538597 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 558/1129] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:58 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1475 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:59.543804 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-960b2ef5-e5a4-448b-865e-7b90a3e1804e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:42:59.558539 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1171dc15-f672-450b-92b2-1cf6755a1e9d tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Calling method '.version_select at 0x7fdeffeb7700>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:59.571109 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-960b2ef5-e5a4-448b-865e-7b90a3e1804e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1291 microversion: 2.1 time: 0.275450 Jun 16 14:42:59.578890 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 572/1130] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:59 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1291 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:59.590169 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-85525f03-0123-4643-98ff-846387ba9fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:42:59.599990 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-85525f03-0123-4643-98ff-846387ba9fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:42:59.636077 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85525f03-0123-4643-98ff-846387ba9fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:59.640625 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85525f03-0123-4643-98ff-846387ba9fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:59.645259 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85525f03-0123-4643-98ff-846387ba9fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:42:59.648238 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85525f03-0123-4643-98ff-846387ba9fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:42:59.719975 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1171dc15-f672-450b-92b2-1cf6755a1e9d tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "GET /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata" status: 200 len: 61 microversion: 2.1 time: 0.176366 Jun 16 14:42:59.727473 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 559/1131] 10.222.0.57 () {58 vars in 1259 bytes} [Thu Jun 16 14:42:59 2022] GET /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata => generated 61 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:42:59.733615 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b4bd99bf-4718-4392-b560-c05ed4986884 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Action: 'update_all', calling method: .version_select at 0x7fdeffe4d9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:42:59.886820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-b4bd99bf-4718-4392-b560-c05ed4986884 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:42:59.895695 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-b4bd99bf-4718-4392-b560-c05ed4986884 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for user ee0918861278473899ea38acd4094b92 and project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:43:00.020478 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-85525f03-0123-4643-98ff-846387ba9fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:00.098153 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-85525f03-0123-4643-98ff-846387ba9fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1274 microversion: 2.1 time: 0.517055 Jun 16 14:43:00.109488 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 573/1132] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:42:59 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1274 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:00.117129 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2ef67832-2d19-491b-9506-d835baba1e04 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:00.130123 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2ef67832-2d19-491b-9506-d835baba1e04 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:00.155905 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ef67832-2d19-491b-9506-d835baba1e04 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:00.156912 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ef67832-2d19-491b-9506-d835baba1e04 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:00.158360 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ef67832-2d19-491b-9506-d835baba1e04 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:00.159164 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ef67832-2d19-491b-9506-d835baba1e04 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:00.311711 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2ef67832-2d19-491b-9506-d835baba1e04 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199681 Jun 16 14:43:00.315509 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 574/1133] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:43:00 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:00.324532 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3b885aa9-d204-435a-9123-dc7db112f150 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:00.337997 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3b885aa9-d204-435a-9123-dc7db112f150 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:00.358649 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3b885aa9-d204-435a-9123-dc7db112f150 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:00.371555 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3b885aa9-d204-435a-9123-dc7db112f150 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:00.373913 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3b885aa9-d204-435a-9123-dc7db112f150 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:00.375039 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3b885aa9-d204-435a-9123-dc7db112f150 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:00.986121 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.011194 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b4bd99bf-4718-4392-b560-c05ed4986884 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata" status: 200 len: 61 microversion: 2.1 time: 1.281857 Jun 16 14:43:01.020546 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 560/1134] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 16 14:42:59 2022] PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata => generated 61 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:43:01.066311 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-aee875ab-d355-44b9-a63d-c0b85d602900 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:01.067408 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-aee875ab-d355-44b9-a63d-c0b85d602900 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:01.106948 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aee875ab-d355-44b9-a63d-c0b85d602900 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:01.112175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aee875ab-d355-44b9-a63d-c0b85d602900 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:01.115353 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aee875ab-d355-44b9-a63d-c0b85d602900 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:01.120371 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aee875ab-d355-44b9-a63d-c0b85d602900 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:01.463351 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3b885aa9-d204-435a-9123-dc7db112f150 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:01.474032 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3b885aa9-d204-435a-9123-dc7db112f150 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1471 microversion: 2.1 time: 1.156553 Jun 16 14:43:01.483926 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 575/1135] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:00 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1471 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:01.516870 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f1e4ca2c-2dea-4824-872c-507ed0f47f49 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:01.518113 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f1e4ca2c-2dea-4824-872c-507ed0f47f49 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:01.531079 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f1e4ca2c-2dea-4824-872c-507ed0f47f49 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:01.533080 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f1e4ca2c-2dea-4824-872c-507ed0f47f49 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:01.536648 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f1e4ca2c-2dea-4824-872c-507ed0f47f49 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:01.537578 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f1e4ca2c-2dea-4824-872c-507ed0f47f49 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:01.641445 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-aee875ab-d355-44b9-a63d-c0b85d602900 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:01.674844 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-aee875ab-d355-44b9-a63d-c0b85d602900 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1275 microversion: 2.1 time: 0.650775 Jun 16 14:43:01.676514 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 561/1136] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:01 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1275 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:01.700555 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-edd5f5e1-0d18-450f-8b75-9e27188f2743 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:01.703243 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-edd5f5e1-0d18-450f-8b75-9e27188f2743 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:01.731988 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-edd5f5e1-0d18-450f-8b75-9e27188f2743 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:01.733702 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-edd5f5e1-0d18-450f-8b75-9e27188f2743 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:01.735701 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-edd5f5e1-0d18-450f-8b75-9e27188f2743 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:01.737774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-edd5f5e1-0d18-450f-8b75-9e27188f2743 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:02.412411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-edd5f5e1-0d18-450f-8b75-9e27188f2743 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:02.414440 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f1e4ca2c-2dea-4824-872c-507ed0f47f49 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:02.431249 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f1e4ca2c-2dea-4824-872c-507ed0f47f49 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1475 microversion: 2.1 time: 0.935426 Jun 16 14:43:02.442551 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 576/1137] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:01 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1475 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:02.445531 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-edd5f5e1-0d18-450f-8b75-9e27188f2743 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1331 microversion: 2.1 time: 0.766467 Jun 16 14:43:02.447650 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-48d9b9c9-b442-44f3-acfa-b9d29d4586cd req-23740b0f-6e1f-40e2-a57b-b9c7863a99a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04e1cd2-656b-4de4-a784-ad2239f926bb", "name": "network-vif-unplugged", "status": "completed", "tag": "b1a39f33-a168-43db-ac7a-31811d74465c"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:02.450058 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 562/1138] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:01 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1331 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:02.473821 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-48d9b9c9-b442-44f3-acfa-b9d29d4586cd req-23740b0f-6e1f-40e2-a57b-b9c7863a99a4 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:02.474440 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8f5ffa96-dbc9-4536-8a34-c4d2e8327976 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Action: 'update_all', calling method: .version_select at 0x7fdeffe475e0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:02.474563 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-48d9b9c9-b442-44f3-acfa-b9d29d4586cd req-23740b0f-6e1f-40e2-a57b-b9c7863a99a4 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:02.507505 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-48d9b9c9-b442-44f3-acfa-b9d29d4586cd req-23740b0f-6e1f-40e2-a57b-b9c7863a99a4 service nova] Creating event network-vif-unplugged:b1a39f33-a168-43db-ac7a-31811d74465c for instance f04e1cd2-656b-4de4-a784-ad2239f926bb on n-h1-836830-4 Jun 16 14:43:02.528001 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-48d9b9c9-b442-44f3-acfa-b9d29d4586cd req-23740b0f-6e1f-40e2-a57b-b9c7863a99a4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083951 Jun 16 14:43:02.541841 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 577/1139] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:02.552476 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a1bc06d4-aa1b-4e67-ada0-236a0633333c tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:02.553319 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a1bc06d4-aa1b-4e67-ada0-236a0633333c tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:02.582218 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a1bc06d4-aa1b-4e67-ada0-236a0633333c tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:02.582711 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a1bc06d4-aa1b-4e67-ada0-236a0633333c tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:02.583533 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a1bc06d4-aa1b-4e67-ada0-236a0633333c tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:02.583987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a1bc06d4-aa1b-4e67-ada0-236a0633333c tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:02.598505 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-8f5ffa96-dbc9-4536-8a34-c4d2e8327976 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:43:02.598773 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.608854 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-8f5ffa96-dbc9-4536-8a34-c4d2e8327976 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for user ee0918861278473899ea38acd4094b92 and project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:43:03.370093 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8f5ffa96-dbc9-4536-8a34-c4d2e8327976 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata" status: 200 len: 64 microversion: 2.1 time: 0.918138 Jun 16 14:43:03.371213 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 563/1140] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 16 14:43:02 2022] PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata => generated 64 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:43:03.389546 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a136efe4-bfff-41e8-9b2e-86d40e123f9b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:03.391532 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a136efe4-bfff-41e8-9b2e-86d40e123f9b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:03.443968 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a136efe4-bfff-41e8-9b2e-86d40e123f9b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:03.445013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a136efe4-bfff-41e8-9b2e-86d40e123f9b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:03.446294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a136efe4-bfff-41e8-9b2e-86d40e123f9b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:03.447138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a136efe4-bfff-41e8-9b2e-86d40e123f9b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:03.553266 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a136efe4-bfff-41e8-9b2e-86d40e123f9b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181037 Jun 16 14:43:03.554934 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 564/1141] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:43:03 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:03.559114 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5d41d7eb-139a-422a-b9d0-fc2e09f22228 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:03.559746 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5d41d7eb-139a-422a-b9d0-fc2e09f22228 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:03.581241 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d41d7eb-139a-422a-b9d0-fc2e09f22228 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:03.581729 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d41d7eb-139a-422a-b9d0-fc2e09f22228 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:03.582543 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d41d7eb-139a-422a-b9d0-fc2e09f22228 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:03.583004 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d41d7eb-139a-422a-b9d0-fc2e09f22228 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:04.021654 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a1bc06d4-aa1b-4e67-ada0-236a0633333c tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:04.041063 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a1bc06d4-aa1b-4e67-ada0-236a0633333c tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1316 microversion: 2.1 time: 1.497307 Jun 16 14:43:04.042201 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 578/1142] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:02 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1316 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:04.066853 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5d41d7eb-139a-422a-b9d0-fc2e09f22228 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:04.081132 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4d772c4d-e819-4f8d-8d51-22a306c750cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:04.093452 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4d772c4d-e819-4f8d-8d51-22a306c750cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:04.105063 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5d41d7eb-139a-422a-b9d0-fc2e09f22228 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1463 microversion: 2.1 time: 0.549190 Jun 16 14:43:04.108518 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 565/1143] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:03 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1463 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:04.123664 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6cf9f9bd-9405-47e2-839c-5098c98bb505 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Calling method '.version_select at 0x7fdf0c0eca60>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:04.124548 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d772c4d-e819-4f8d-8d51-22a306c750cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:04.125715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d772c4d-e819-4f8d-8d51-22a306c750cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:04.127324 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d772c4d-e819-4f8d-8d51-22a306c750cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:04.128355 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d772c4d-e819-4f8d-8d51-22a306c750cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:04.200227 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6cf9f9bd-9405-47e2-839c-5098c98bb505 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "GET /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata" status: 200 len: 64 microversion: 2.1 time: 0.089409 Jun 16 14:43:04.201894 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 566/1144] 10.222.0.57 () {58 vars in 1259 bytes} [Thu Jun 16 14:43:04 2022] GET /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata => generated 64 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:43:04.213670 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-806a7969-e0bc-421b-9e03-09bc02a4b29e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:04.214557 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-806a7969-e0bc-421b-9e03-09bc02a4b29e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:04.224168 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-806a7969-e0bc-421b-9e03-09bc02a4b29e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:04.224763 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-806a7969-e0bc-421b-9e03-09bc02a4b29e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:04.225831 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-806a7969-e0bc-421b-9e03-09bc02a4b29e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:04.226423 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-806a7969-e0bc-421b-9e03-09bc02a4b29e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:04.724577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-806a7969-e0bc-421b-9e03-09bc02a4b29e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:04.759848 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-806a7969-e0bc-421b-9e03-09bc02a4b29e tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1475 microversion: 2.1 time: 0.549363 Jun 16 14:43:04.763820 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 567/1145] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:04 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1475 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:04.788132 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1a934250-5d74-42b9-afce-ac008b747879 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:04.792767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1a934250-5d74-42b9-afce-ac008b747879 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:04.824449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1a934250-5d74-42b9-afce-ac008b747879 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:04.837178 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1a934250-5d74-42b9-afce-ac008b747879 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:04.839513 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1a934250-5d74-42b9-afce-ac008b747879 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:04.848536 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1a934250-5d74-42b9-afce-ac008b747879 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:05.157153 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4d772c4d-e819-4f8d-8d51-22a306c750cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:05.204914 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4d772c4d-e819-4f8d-8d51-22a306c750cc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1317 microversion: 2.1 time: 1.134064 Jun 16 14:43:05.205949 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 579/1146] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:04 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1317 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:05.231381 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-37558701-d306-4f38-ad00-40db203a4b65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:05.233654 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-37558701-d306-4f38-ad00-40db203a4b65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:05.249160 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-37558701-d306-4f38-ad00-40db203a4b65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:05.249967 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-37558701-d306-4f38-ad00-40db203a4b65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:05.251041 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-37558701-d306-4f38-ad00-40db203a4b65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:05.251891 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-37558701-d306-4f38-ad00-40db203a4b65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:05.765525 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1a934250-5d74-42b9-afce-ac008b747879 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:05.822134 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1a934250-5d74-42b9-afce-ac008b747879 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1331 microversion: 2.1 time: 1.054486 Jun 16 14:43:05.835476 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 568/1147] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:04 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1331 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:05.854351 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e2adea5d-7139-4d59-a5a0-251407d795d9 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Action: 'update_all', calling method: .version_select at 0x7fdf0c4e1d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:05.960634 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-e2adea5d-7139-4d59-a5a0-251407d795d9 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:43:05.972313 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-e2adea5d-7139-4d59-a5a0-251407d795d9 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for user ee0918861278473899ea38acd4094b92 and project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:43:06.016236 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-37558701-d306-4f38-ad00-40db203a4b65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:06.054911 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-37558701-d306-4f38-ad00-40db203a4b65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1463 microversion: 2.1 time: 0.846217 Jun 16 14:43:06.082539 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 580/1148] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:05 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1463 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:06.082539 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-e15c9d4e-93a5-4fc2-8402-579c8824d9b7 req-fadd3d9f-b296-493a-9ad9-fefbbbfc608e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dce7bf2-76fb-41fc-b977-92c5ee0c31de", "tag": "59492a60-f926-414e-9a00-833130ddba76"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:06.095242 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-e15c9d4e-93a5-4fc2-8402-579c8824d9b7 req-fadd3d9f-b296-493a-9ad9-fefbbbfc608e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:06.096063 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-e15c9d4e-93a5-4fc2-8402-579c8824d9b7 req-fadd3d9f-b296-493a-9ad9-fefbbbfc608e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:06.135628 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-e15c9d4e-93a5-4fc2-8402-579c8824d9b7 req-fadd3d9f-b296-493a-9ad9-fefbbbfc608e service nova] Creating event network-changed:59492a60-f926-414e-9a00-833130ddba76 for instance 2dce7bf2-76fb-41fc-b977-92c5ee0c31de on n-h1-836830-4 Jun 16 14:43:06.161114 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-e15c9d4e-93a5-4fc2-8402-579c8824d9b7 req-fadd3d9f-b296-493a-9ad9-fefbbbfc608e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089525 Jun 16 14:43:06.162048 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 581/1149] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:06.177635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bb922178-1f60-44ec-853a-71f82a187d18 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:06.179181 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bb922178-1f60-44ec-853a-71f82a187d18 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:06.215490 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb922178-1f60-44ec-853a-71f82a187d18 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:06.224079 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb922178-1f60-44ec-853a-71f82a187d18 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:06.226846 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb922178-1f60-44ec-853a-71f82a187d18 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:06.227755 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb922178-1f60-44ec-853a-71f82a187d18 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:06.298734 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bb922178-1f60-44ec-853a-71f82a187d18 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135712 Jun 16 14:43:06.299622 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 582/1150] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:43:06 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:06.305890 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-0cc3562d-49f7-4f20-9456-a6de7c60929a req-22935ff6-e411-497a-b23a-d8b75a96c34b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04e1cd2-656b-4de4-a784-ad2239f926bb", "name": "network-vif-plugged", "status": "completed", "tag": "b1a39f33-a168-43db-ac7a-31811d74465c"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:06.320070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-0cc3562d-49f7-4f20-9456-a6de7c60929a req-22935ff6-e411-497a-b23a-d8b75a96c34b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:06.324166 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-0cc3562d-49f7-4f20-9456-a6de7c60929a req-22935ff6-e411-497a-b23a-d8b75a96c34b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:06.367212 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-0cc3562d-49f7-4f20-9456-a6de7c60929a req-22935ff6-e411-497a-b23a-d8b75a96c34b service nova] Creating event network-vif-plugged:b1a39f33-a168-43db-ac7a-31811d74465c for instance f04e1cd2-656b-4de4-a784-ad2239f926bb on n-h1-836830-4 Jun 16 14:43:06.392996 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-0cc3562d-49f7-4f20-9456-a6de7c60929a req-22935ff6-e411-497a-b23a-d8b75a96c34b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090956 Jun 16 14:43:06.394813 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 583/1151] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:06.409713 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-266b3e4d-45d2-48cc-b410-0bbf87c15380 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:06.411879 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-266b3e4d-45d2-48cc-b410-0bbf87c15380 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:06.434070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-266b3e4d-45d2-48cc-b410-0bbf87c15380 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:06.436180 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-266b3e4d-45d2-48cc-b410-0bbf87c15380 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:06.443718 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-266b3e4d-45d2-48cc-b410-0bbf87c15380 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:06.445084 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-266b3e4d-45d2-48cc-b410-0bbf87c15380 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:06.832514 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-266b3e4d-45d2-48cc-b410-0bbf87c15380 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:06.852142 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-266b3e4d-45d2-48cc-b410-0bbf87c15380 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1316 microversion: 2.1 time: 0.454171 Jun 16 14:43:06.853638 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 584/1152] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:06 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:06.865936 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-215cc0e7-2cce-4a61-9a82-51cf2464c847 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:06.867262 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-215cc0e7-2cce-4a61-9a82-51cf2464c847 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:06.880335 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-215cc0e7-2cce-4a61-9a82-51cf2464c847 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:06.881143 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-215cc0e7-2cce-4a61-9a82-51cf2464c847 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:06.882728 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-215cc0e7-2cce-4a61-9a82-51cf2464c847 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:06.883571 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-215cc0e7-2cce-4a61-9a82-51cf2464c847 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:06.890247 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e2adea5d-7139-4d59-a5a0-251407d795d9 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata" status: 200 len: 61 microversion: 2.1 time: 1.066045 Jun 16 14:43:06.891389 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 569/1153] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 16 14:43:05 2022] PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata => generated 61 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:43:06.900957 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6341a75e-e457-470b-87d6-ef56ee93409a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Action: 'create', calling method: .version_select at 0x7fdf0c4e1430>, body: {"keypair": {"name": "tempest-keypair-1116416210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuaO/6Jh8/H7fG7Vbt2tm2MoFD4e7yW0qLi6tuz1BCiaa0z7t68MsDraX0ofQezsaKH39ByT4m9DG2y0J6FfBQCNbaY01KKvsDQp6pJSGJ1t73M7Z0y/NmJ+NDu3irUYg=="}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:06.932370 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-6341a75e-e457-470b-87d6-ef56ee93409a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Getting quotas for project 414e3b792647435daa2ecce22a2c6132. Resources: {'key_pairs'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:43:06.944818 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-6341a75e-e457-470b-87d6-ef56ee93409a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Getting quotas for user 65cde69f3b52448c8b08297b548bb377 and project 414e3b792647435daa2ecce22a2c6132. Resources: {'key_pairs'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:43:06.983504 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:06.992496 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6341a75e-e457-470b-87d6-ef56ee93409a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098841 Jun 16 14:43:06.994677 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 570/1154] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:43:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:07.147324 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-9a2c9557-d1e3-4faa-b8a9-99bf02e774b2 req-4d99417c-02d1-4de6-9bff-854be2c23309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f83874-bfcd-4b80-a6c5-949bd8f341b9", "tag": "91b49d73-f169-45f2-8cf3-953aebec904e"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:07.163735 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-9a2c9557-d1e3-4faa-b8a9-99bf02e774b2 req-4d99417c-02d1-4de6-9bff-854be2c23309 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:07.164974 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-9a2c9557-d1e3-4faa-b8a9-99bf02e774b2 req-4d99417c-02d1-4de6-9bff-854be2c23309 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:07.188988 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-9a2c9557-d1e3-4faa-b8a9-99bf02e774b2 req-4d99417c-02d1-4de6-9bff-854be2c23309 service nova] Creating event network-changed:91b49d73-f169-45f2-8cf3-953aebec904e for instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 on n-h1-836830-4 Jun 16 14:43:07.207174 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-9a2c9557-d1e3-4faa-b8a9-99bf02e774b2 req-4d99417c-02d1-4de6-9bff-854be2c23309 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210038 Jun 16 14:43:07.209988 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 571/1155] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:07.223155 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5f3519d7-5d7e-4403-bc05-70e2e740035d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:07.225749 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5f3519d7-5d7e-4403-bc05-70e2e740035d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:07.239230 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5f3519d7-5d7e-4403-bc05-70e2e740035d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:07.240247 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5f3519d7-5d7e-4403-bc05-70e2e740035d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:07.243560 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5f3519d7-5d7e-4403-bc05-70e2e740035d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:07.245135 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5f3519d7-5d7e-4403-bc05-70e2e740035d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:07.269613 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-215cc0e7-2cce-4a61-9a82-51cf2464c847 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:07.289566 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-215cc0e7-2cce-4a61-9a82-51cf2464c847 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1475 microversion: 2.1 time: 0.434104 Jun 16 14:43:07.290172 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 585/1156] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:06 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1475 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:07.292646 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:07.295763 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1f30f5ed-8428-42fa-9e96-385975c3fb2c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:07.296401 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1f30f5ed-8428-42fa-9e96-385975c3fb2c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:07.320639 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1f30f5ed-8428-42fa-9e96-385975c3fb2c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:07.321441 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1f30f5ed-8428-42fa-9e96-385975c3fb2c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:07.322523 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1f30f5ed-8428-42fa-9e96-385975c3fb2c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:07.323185 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1f30f5ed-8428-42fa-9e96-385975c3fb2c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:07.388771 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=12 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:07.539892 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5f3519d7-5d7e-4403-bc05-70e2e740035d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:07.552585 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5f3519d7-5d7e-4403-bc05-70e2e740035d tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1317 microversion: 2.1 time: 0.339745 Jun 16 14:43:07.554540 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 572/1157] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:07 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:07.568763 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c6910a81-7e59-44ad-bde7-2237ebb108b0 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Action: 'update', calling method: .version_select at 0x7fdefffe8430>, body: {"meta": {"os_version": "alt"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:07.645155 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c6910a81-7e59-44ad-bde7-2237ebb108b0 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:43:07.652870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c6910a81-7e59-44ad-bde7-2237ebb108b0 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for user ee0918861278473899ea38acd4094b92 and project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:43:08.100671 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c6910a81-7e59-44ad-bde7-2237ebb108b0 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.543676 Jun 16 14:43:08.102032 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 573/1158] 10.222.0.57 () {60 vars in 1312 bytes} [Thu Jun 16 14:43:07 2022] PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata/os_version => generated 31 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:43:08.112362 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-da8d9ba8-b114-4232-a216-e8aa88f23c16 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:08.114104 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-da8d9ba8-b114-4232-a216-e8aa88f23c16 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:08.123380 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1f30f5ed-8428-42fa-9e96-385975c3fb2c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:08.127541 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-da8d9ba8-b114-4232-a216-e8aa88f23c16 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:08.128367 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-da8d9ba8-b114-4232-a216-e8aa88f23c16 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:08.129798 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-da8d9ba8-b114-4232-a216-e8aa88f23c16 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:08.130915 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-da8d9ba8-b114-4232-a216-e8aa88f23c16 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:08.136167 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1f30f5ed-8428-42fa-9e96-385975c3fb2c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1331 microversion: 2.1 time: 0.844423 Jun 16 14:43:08.137845 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 586/1159] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:07 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1331 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:08.154583 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1cc7c4c2-9792-49ec-8552-9924bc4216a4 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:08.156885 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1cc7c4c2-9792-49ec-8552-9924bc4216a4 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:08.167471 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1cc7c4c2-9792-49ec-8552-9924bc4216a4 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:08.168280 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1cc7c4c2-9792-49ec-8552-9924bc4216a4 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:08.170496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1cc7c4c2-9792-49ec-8552-9924bc4216a4 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:08.171556 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1cc7c4c2-9792-49ec-8552-9924bc4216a4 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:08.206922 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-da8d9ba8-b114-4232-a216-e8aa88f23c16 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102633 Jun 16 14:43:08.208619 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 574/1160] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:43:08 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:43:08.224690 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2187838c-d21e-4dc4-a163-4cf0aa0544de tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Calling method '.version_select at 0x7fdeffe4dca0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:08.312045 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2187838c-d21e-4dc4-a163-4cf0aa0544de tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "GET /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata" status: 200 len: 58 microversion: 2.1 time: 0.101253 Jun 16 14:43:08.313489 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 575/1161] 10.222.0.57 () {58 vars in 1259 bytes} [Thu Jun 16 14:43:08 2022] GET /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata => generated 58 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:43:08.324588 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-846e6f67-e836-4f71-93b1-9efec7c5bf76 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '.version_select at 0x7fdeffeb7a60>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:08.357886 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-846e6f67-e836-4f71-93b1-9efec7c5bf76 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-107457352" status: 202 len: 0 microversion: 2.1 time: 0.042216 Jun 16 14:43:08.359034 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 576/1162] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jun 16 14:43:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-107457352 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:43:08.371088 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cac8dccc-da28-4730-97d3-9c2960da9cb3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:08.373624 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cac8dccc-da28-4730-97d3-9c2960da9cb3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:08.386874 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cac8dccc-da28-4730-97d3-9c2960da9cb3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:08.388282 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cac8dccc-da28-4730-97d3-9c2960da9cb3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:08.390271 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cac8dccc-da28-4730-97d3-9c2960da9cb3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:08.391406 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cac8dccc-da28-4730-97d3-9c2960da9cb3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:08.428785 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1cc7c4c2-9792-49ec-8552-9924bc4216a4 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:08.451384 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1cc7c4c2-9792-49ec-8552-9924bc4216a4 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1316 microversion: 2.1 time: 0.308342 Jun 16 14:43:08.453092 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 587/1163] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:08 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:08.470957 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d693d7f5-b2ab-4d84-818c-bb9ed94b44ca tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Action: 'update_all', calling method: .version_select at 0x7fdeffbe1af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:08.620183 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-d693d7f5-b2ab-4d84-818c-bb9ed94b44ca tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:43:08.651931 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-d693d7f5-b2ab-4d84-818c-bb9ed94b44ca tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for user ee0918861278473899ea38acd4094b92 and project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:43:08.856070 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cac8dccc-da28-4730-97d3-9c2960da9cb3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:08.892474 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cac8dccc-da28-4730-97d3-9c2960da9cb3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1475 microversion: 2.1 time: 0.529924 Jun 16 14:43:08.894313 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 577/1164] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:08 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1475 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:08.907360 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2395088c-6756-4ebf-a78c-e8bed102e46c tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:08.910920 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2395088c-6756-4ebf-a78c-e8bed102e46c tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:08.928044 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2395088c-6756-4ebf-a78c-e8bed102e46c tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:08.929021 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2395088c-6756-4ebf-a78c-e8bed102e46c tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:08.931848 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2395088c-6756-4ebf-a78c-e8bed102e46c tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:08.933633 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2395088c-6756-4ebf-a78c-e8bed102e46c tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:09.495329 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d693d7f5-b2ab-4d84-818c-bb9ed94b44ca tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata" status: 200 len: 61 microversion: 2.1 time: 1.034416 Jun 16 14:43:09.501736 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 588/1165] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 16 14:43:08 2022] PUT /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata => generated 61 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:43:09.509420 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-79782938-db10-4287-88e2-c934d87e658b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:09.510267 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-79782938-db10-4287-88e2-c934d87e658b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:09.523893 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2395088c-6756-4ebf-a78c-e8bed102e46c tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:09.525963 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-79782938-db10-4287-88e2-c934d87e658b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:09.526886 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-79782938-db10-4287-88e2-c934d87e658b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:09.529964 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-79782938-db10-4287-88e2-c934d87e658b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:09.531808 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-79782938-db10-4287-88e2-c934d87e658b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:09.536887 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2395088c-6756-4ebf-a78c-e8bed102e46c tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1317 microversion: 2.1 time: 0.640520 Jun 16 14:43:09.537954 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 578/1166] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:08 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:09.562295 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-a29c1f49-5356-42af-a129-f97e1bb9ce75 req-ebb3ffea-8b42-476d-ac82-33ddd9630ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d332fa7-1e7c-4195-9270-4a0183b48bfd", "tag": "f1a65e7b-fc75-44fa-9938-510653a14181"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:09.577284 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-a29c1f49-5356-42af-a129-f97e1bb9ce75 req-ebb3ffea-8b42-476d-ac82-33ddd9630ac7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:09.578020 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-a29c1f49-5356-42af-a129-f97e1bb9ce75 req-ebb3ffea-8b42-476d-ac82-33ddd9630ac7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:09.611196 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-a29c1f49-5356-42af-a129-f97e1bb9ce75 req-ebb3ffea-8b42-476d-ac82-33ddd9630ac7 service nova] Creating event network-changed:f1a65e7b-fc75-44fa-9938-510653a14181 for instance 0d332fa7-1e7c-4195-9270-4a0183b48bfd on n-h1-836830-4 Jun 16 14:43:09.621089 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-a29c1f49-5356-42af-a129-f97e1bb9ce75 req-ebb3ffea-8b42-476d-ac82-33ddd9630ac7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070457 Jun 16 14:43:09.623349 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 579/1167] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:09.633015 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-02dfe9da-9128-4dbb-ae90-181da016aa3d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:09.634345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-02dfe9da-9128-4dbb-ae90-181da016aa3d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:09.647055 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02dfe9da-9128-4dbb-ae90-181da016aa3d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:09.647686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02dfe9da-9128-4dbb-ae90-181da016aa3d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:09.649137 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02dfe9da-9128-4dbb-ae90-181da016aa3d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:09.649870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02dfe9da-9128-4dbb-ae90-181da016aa3d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:09.907525 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-02dfe9da-9128-4dbb-ae90-181da016aa3d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:09.925150 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-02dfe9da-9128-4dbb-ae90-181da016aa3d tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1316 microversion: 2.1 time: 0.299764 Jun 16 14:43:09.936388 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 580/1168] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:09 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:09.936620 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-04bf779e-48f2-44de-bf92-1eef0703193e tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Action: 'create', calling method: .version_select at 0x7fdeffedd820>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:10.008255 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-79782938-db10-4287-88e2-c934d87e658b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:10.019321 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-79782938-db10-4287-88e2-c934d87e658b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1331 microversion: 2.1 time: 0.520226 Jun 16 14:43:10.020194 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 589/1169] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:09 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1331 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:10.025179 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-68bff4e6-6cb8-49c5-9532-f6d505d30e9d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:10.025809 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-68bff4e6-6cb8-49c5-9532-f6d505d30e9d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:10.033243 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-68bff4e6-6cb8-49c5-9532-f6d505d30e9d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:10.033967 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-68bff4e6-6cb8-49c5-9532-f6d505d30e9d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:10.035037 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-68bff4e6-6cb8-49c5-9532-f6d505d30e9d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:10.035664 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-68bff4e6-6cb8-49c5-9532-f6d505d30e9d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:10.044808 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-04bf779e-48f2-44de-bf92-1eef0703193e tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:43:10.057763 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-04bf779e-48f2-44de-bf92-1eef0703193e tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Getting quotas for user ee0918861278473899ea38acd4094b92 and project 1e37747e7f954d3f823afe49271b817d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:43:10.410044 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-68bff4e6-6cb8-49c5-9532-f6d505d30e9d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:10.445802 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-68bff4e6-6cb8-49c5-9532-f6d505d30e9d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1475 microversion: 2.1 time: 0.423773 Jun 16 14:43:10.453169 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 590/1170] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:10 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1475 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:10.520746 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4f8fd51f-af18-426e-9b77-770636ec6e97 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:10.530153 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4f8fd51f-af18-426e-9b77-770636ec6e97 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:10.572209 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f8fd51f-af18-426e-9b77-770636ec6e97 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:10.581522 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f8fd51f-af18-426e-9b77-770636ec6e97 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:10.585065 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f8fd51f-af18-426e-9b77-770636ec6e97 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:10.586866 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f8fd51f-af18-426e-9b77-770636ec6e97 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:10.671154 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-04bf779e-48f2-44de-bf92-1eef0703193e tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "POST /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata" status: 200 len: 85 microversion: 2.1 time: 0.742992 Jun 16 14:43:10.671967 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 581/1171] 10.222.0.57 () {60 vars in 1280 bytes} [Thu Jun 16 14:43:09 2022] POST /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata => generated 85 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:43:10.679757 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-96b51081-7992-473d-be9e-7fe777104c03 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:10.680120 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-96b51081-7992-473d-be9e-7fe777104c03 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:10.685198 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:10.690074 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-96b51081-7992-473d-be9e-7fe777104c03 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:10.690605 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-96b51081-7992-473d-be9e-7fe777104c03 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:10.691993 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-96b51081-7992-473d-be9e-7fe777104c03 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:10.692417 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-96b51081-7992-473d-be9e-7fe777104c03 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:10.908964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-96b51081-7992-473d-be9e-7fe777104c03 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:10.920229 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-96b51081-7992-473d-be9e-7fe777104c03 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1317 microversion: 2.1 time: 0.245979 Jun 16 14:43:10.921496 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 582/1172] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:10 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:10.931119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-efa796b3-facd-4e0c-9acc-0a8077b4e6b3 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] Calling method '.version_select at 0x7fdeffe4db80>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:11.000719 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-efa796b3-facd-4e0c-9acc-0a8077b4e6b3 tempest-ImagesMetadataTestJSON-966506057 tempest-ImagesMetadataTestJSON-966506057-project] 10.222.0.57 "GET /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata" status: 200 len: 85 microversion: 2.1 time: 0.077524 Jun 16 14:43:11.001890 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 583/1173] 10.222.0.57 () {58 vars in 1259 bytes} [Thu Jun 16 14:43:10 2022] GET /compute/v2.1/images/28772496-c775-4152-bc68-4818c142bcad/metadata => generated 85 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:43:11.020482 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b2512d51-050f-4853-8423-f57bfa37c255 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:11.021119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b2512d51-050f-4853-8423-f57bfa37c255 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:11.032264 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2512d51-050f-4853-8423-f57bfa37c255 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:11.033100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2512d51-050f-4853-8423-f57bfa37c255 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:11.034356 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2512d51-050f-4853-8423-f57bfa37c255 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:11.034851 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2512d51-050f-4853-8423-f57bfa37c255 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:11.183370 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-4f8fd51f-af18-426e-9b77-770636ec6e97 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'services' on Instance uuid e4855363-724b-4eff-a76e-915e440af995 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:43:11.210010 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4f8fd51f-af18-426e-9b77-770636ec6e97 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 2344 microversion: 2.25 time: 0.716638 Jun 16 14:43:11.211092 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 591/1174] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:43:10 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 2344 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:43:11.223796 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4b079a4f-1194-43c6-a9cb-e29217c0904e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:11.224736 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4b079a4f-1194-43c6-a9cb-e29217c0904e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:11.253451 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b079a4f-1194-43c6-a9cb-e29217c0904e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:11.255860 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b079a4f-1194-43c6-a9cb-e29217c0904e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:11.257687 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b079a4f-1194-43c6-a9cb-e29217c0904e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:11.258793 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b079a4f-1194-43c6-a9cb-e29217c0904e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:11.311056 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b2512d51-050f-4853-8423-f57bfa37c255 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:11.327405 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b2512d51-050f-4853-8423-f57bfa37c255 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1316 microversion: 2.1 time: 0.324104 Jun 16 14:43:11.328374 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 584/1175] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:11 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:11.334368 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-400bd56e-a134-4f3f-9e1a-7d7615cc46a5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:11.336215 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:43:11.336215 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:43:11.338550 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-400bd56e-a134-4f3f-9e1a-7d7615cc46a5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:11.339288 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-400bd56e-a134-4f3f-9e1a-7d7615cc46a5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:11.340517 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-400bd56e-a134-4f3f-9e1a-7d7615cc46a5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:11.341198 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-400bd56e-a134-4f3f-9e1a-7d7615cc46a5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:11.379676 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-400bd56e-a134-4f3f-9e1a-7d7615cc46a5 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.049911 Jun 16 14:43:11.380612 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 585/1176] 10.222.0.57 () {60 vars in 1216 bytes} [Thu Jun 16 14:43:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:43:11.478811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-79d655a2-e883-4013-bd1c-f0ae4c467018 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:11.480090 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-79d655a2-e883-4013-bd1c-f0ae4c467018 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:11.495167 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-79d655a2-e883-4013-bd1c-f0ae4c467018 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:11.497510 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-79d655a2-e883-4013-bd1c-f0ae4c467018 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:11.500899 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-79d655a2-e883-4013-bd1c-f0ae4c467018 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:11.503633 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-79d655a2-e883-4013-bd1c-f0ae4c467018 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:11.785203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-79d655a2-e883-4013-bd1c-f0ae4c467018 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:11.802614 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-79d655a2-e883-4013-bd1c-f0ae4c467018 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1475 microversion: 2.1 time: 0.328710 Jun 16 14:43:11.818437 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 586/1177] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:11 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1475 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:43:11.947034 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-70cebabd-9796-4dbb-a12d-5a1a1bc11b7b tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:11.950099 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-70cebabd-9796-4dbb-a12d-5a1a1bc11b7b tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:12.006879 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-70cebabd-9796-4dbb-a12d-5a1a1bc11b7b tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:12.007746 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-70cebabd-9796-4dbb-a12d-5a1a1bc11b7b tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:12.009197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-70cebabd-9796-4dbb-a12d-5a1a1bc11b7b tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:12.014969 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-70cebabd-9796-4dbb-a12d-5a1a1bc11b7b tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:12.146241 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4b079a4f-1194-43c6-a9cb-e29217c0904e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:12.163448 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4b079a4f-1194-43c6-a9cb-e29217c0904e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1331 microversion: 2.1 time: 0.950680 Jun 16 14:43:12.174890 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 592/1178] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:11 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1331 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:12.332951 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-70cebabd-9796-4dbb-a12d-5a1a1bc11b7b tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:12.357491 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bcf508cb-bca5-4fc6-86c8-106ec4efeb01 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:12.357760 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-70cebabd-9796-4dbb-a12d-5a1a1bc11b7b tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1317 microversion: 2.1 time: 0.420809 Jun 16 14:43:12.358656 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bcf508cb-bca5-4fc6-86c8-106ec4efeb01 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:12.360127 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 587/1179] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:11 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:12.373147 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bcf508cb-bca5-4fc6-86c8-106ec4efeb01 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:12.373725 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bcf508cb-bca5-4fc6-86c8-106ec4efeb01 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:12.374907 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bcf508cb-bca5-4fc6-86c8-106ec4efeb01 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:12.375609 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bcf508cb-bca5-4fc6-86c8-106ec4efeb01 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:12.502144 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2417b229-f3c2-4de9-aca8-4b53f8fb8ff3 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Calling method '.version_select at 0x7fdeffea7820>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:12.505358 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2417b229-f3c2-4de9-aca8-4b53f8fb8ff3 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:12.508196 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2417b229-f3c2-4de9-aca8-4b53f8fb8ff3 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:12.540880 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2417b229-f3c2-4de9-aca8-4b53f8fb8ff3 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 2722 microversion: 2.1 time: 0.043893 Jun 16 14:43:12.547505 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 588/1180] 10.222.0.57 () {58 vars in 1142 bytes} [Thu Jun 16 14:43:12 2022] GET /compute/v2.1/os-migrations => generated 2722 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:12.567401 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-202d5178-c2f4-4757-a17f-b6db929725d6 req-b9964fb6-46f9-4b1e-9299-13749926afd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cb64d6-b915-425c-aed2-442d3e2a1676", "tag": "dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:12.603409 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-202d5178-c2f4-4757-a17f-b6db929725d6 req-b9964fb6-46f9-4b1e-9299-13749926afd5 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:12.604294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-202d5178-c2f4-4757-a17f-b6db929725d6 req-b9964fb6-46f9-4b1e-9299-13749926afd5 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:12.636180 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-202d5178-c2f4-4757-a17f-b6db929725d6 req-b9964fb6-46f9-4b1e-9299-13749926afd5 service nova] Creating event network-changed:dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a for instance e8cb64d6-b915-425c-aed2-442d3e2a1676 on n-h2-836830-4 Jun 16 14:43:12.656895 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-202d5178-c2f4-4757-a17f-b6db929725d6 req-b9964fb6-46f9-4b1e-9299-13749926afd5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106644 Jun 16 14:43:12.661458 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 589/1181] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:12.678959 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4bea46fc-aa02-43bc-8da9-d38c9f60676e tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:12.692591 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4bea46fc-aa02-43bc-8da9-d38c9f60676e tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027706 Jun 16 14:43:12.704100 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 590/1182] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:43:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:12.726592 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a22fe1ed-4f5d-4d5a-af28-87527754dd52 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-488429914", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:12.733488 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bcf508cb-bca5-4fc6-86c8-106ec4efeb01 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:12.736527 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:43:12.736527 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:43:12.765690 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bcf508cb-bca5-4fc6-86c8-106ec4efeb01 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1316 microversion: 2.1 time: 0.410826 Jun 16 14:43:12.783169 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 593/1183] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:12 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:43:12.791833 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a22fe1ed-4f5d-4d5a-af28-87527754dd52 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.083046 Jun 16 14:43:12.798946 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 591/1184] 10.222.0.57 () {60 vars in 1145 bytes} [Thu Jun 16 14:43:12 2022] POST /compute/v2.1/flavors => generated 498 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:12.811206 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e7c9e2e2-068a-4823-a072-be51aa108f19 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:12.827312 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e7c9e2e2-068a-4823-a072-be51aa108f19 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025137 Jun 16 14:43:12.836836 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4ebe02b7-96bc-4518-8c6f-99f7d43164f8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:12.837612 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4ebe02b7-96bc-4518-8c6f-99f7d43164f8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:12.838947 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 594/1185] 10.222.0.57 () {58 vars in 1181 bytes} [Thu Jun 16 14:43:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:43:12.853717 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4ebe02b7-96bc-4518-8c6f-99f7d43164f8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:12.854185 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4ebe02b7-96bc-4518-8c6f-99f7d43164f8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:12.855030 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4ebe02b7-96bc-4518-8c6f-99f7d43164f8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:12.855514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4ebe02b7-96bc-4518-8c6f-99f7d43164f8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:13.172328 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1215508241", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "e9e21919-a01a-42b3-957e-76b9e7ce107e"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:13.315715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:43:13.880694 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-4ebe02b7-96bc-4518-8c6f-99f7d43164f8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:13.905762 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4ebe02b7-96bc-4518-8c6f-99f7d43164f8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1475 microversion: 2.1 time: 1.075078 Jun 16 14:43:13.909873 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 592/1186] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:12 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1475 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:13.928754 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cf887787-9768-40e7-80bd-b79390f317db tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:13.929829 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cf887787-9768-40e7-80bd-b79390f317db tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:13.958908 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf887787-9768-40e7-80bd-b79390f317db tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:13.959692 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf887787-9768-40e7-80bd-b79390f317db tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:13.961079 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf887787-9768-40e7-80bd-b79390f317db tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:13.961863 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf887787-9768-40e7-80bd-b79390f317db tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:14.335549 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cf887787-9768-40e7-80bd-b79390f317db tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:14.350851 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cf887787-9768-40e7-80bd-b79390f317db tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1331 microversion: 2.1 time: 0.437293 Jun 16 14:43:14.351594 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 593/1187] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:13 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1331 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:14.361519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3966afa0-d6b1-441f-9363-c60c065f8894 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:14.367182 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3966afa0-d6b1-441f-9363-c60c065f8894 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:14.389164 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3966afa0-d6b1-441f-9363-c60c065f8894 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:14.389700 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3966afa0-d6b1-441f-9363-c60c065f8894 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:14.393607 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3966afa0-d6b1-441f-9363-c60c065f8894 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:14.394182 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3966afa0-d6b1-441f-9363-c60c065f8894 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:14.665300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:43:14.665918 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:43:14.666210 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:43:14.666666 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:43:14.667088 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:43:14.681667 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:14.682673 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:14.684178 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:14.685048 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:14.723699 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Getting quotas for project 414e3b792647435daa2ecce22a2c6132. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:43:14.733686 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Getting quotas for user 65cde69f3b52448c8b08297b548bb377 and project 414e3b792647435daa2ecce22a2c6132. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:43:14.761307 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3966afa0-d6b1-441f-9363-c60c065f8894 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:14.766803 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:43:14.769570 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:43:14.779094 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3966afa0-d6b1-441f-9363-c60c065f8894 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1317 microversion: 2.1 time: 0.425719 Jun 16 14:43:14.792006 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 594/1188] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:14 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:14.792700 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-11bfd123-2200-40be-9c8c-b65b5e5d4241 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:14.794063 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-11bfd123-2200-40be-9c8c-b65b5e5d4241 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:14.814242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11bfd123-2200-40be-9c8c-b65b5e5d4241 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:14.818293 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11bfd123-2200-40be-9c8c-b65b5e5d4241 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:14.824959 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11bfd123-2200-40be-9c8c-b65b5e5d4241 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:14.825413 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11bfd123-2200-40be-9c8c-b65b5e5d4241 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:14.908190 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-792ff263-44e9-4b95-8705-40f8696106c0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.742143 Jun 16 14:43:14.911683 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 595/1189] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:43:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:43:14.929933 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-148cb49b-9fe2-431c-9536-782eb79e5a2d req-b64b1eef-2a83-4c28-bba9-2674467c1fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dce7bf2-76fb-41fc-b977-92c5ee0c31de", "name": "network-vif-plugged", "status": "completed", "tag": "59492a60-f926-414e-9a00-833130ddba76"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:14.970673 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-148cb49b-9fe2-431c-9536-782eb79e5a2d req-b64b1eef-2a83-4c28-bba9-2674467c1fbe service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:14.971905 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-148cb49b-9fe2-431c-9536-782eb79e5a2d req-b64b1eef-2a83-4c28-bba9-2674467c1fbe service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:14.997899 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-148cb49b-9fe2-431c-9536-782eb79e5a2d req-b64b1eef-2a83-4c28-bba9-2674467c1fbe service nova] Creating event network-vif-plugged:59492a60-f926-414e-9a00-833130ddba76 for instance 2dce7bf2-76fb-41fc-b977-92c5ee0c31de on n-h1-836830-4 Jun 16 14:43:15.009403 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-148cb49b-9fe2-431c-9536-782eb79e5a2d req-b64b1eef-2a83-4c28-bba9-2674467c1fbe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092743 Jun 16 14:43:15.011398 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 596/1190] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:15.026039 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1bcec109-0fda-4426-8c7b-bd53e4c1cc7f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:15.037708 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1bcec109-0fda-4426-8c7b-bd53e4c1cc7f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:15.068948 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.321445 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-11bfd123-2200-40be-9c8c-b65b5e5d4241 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:15.330965 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1bcec109-0fda-4426-8c7b-bd53e4c1cc7f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:15.348045 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-11bfd123-2200-40be-9c8c-b65b5e5d4241 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1316 microversion: 2.1 time: 0.558636 Jun 16 14:43:15.356461 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 595/1191] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:14 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1316 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:15.364188 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1bcec109-0fda-4426-8c7b-bd53e4c1cc7f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1279 microversion: 2.1 time: 0.348710 Jun 16 14:43:15.371224 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 597/1192] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:15 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1279 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:15.379053 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9e56669b-11fc-4baa-a7a7-93d2823b913a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:15.380055 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9e56669b-11fc-4baa-a7a7-93d2823b913a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:15.399698 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9e56669b-11fc-4baa-a7a7-93d2823b913a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:15.399970 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9e56669b-11fc-4baa-a7a7-93d2823b913a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:15.401114 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-45a26010-22c3-4389-b5d5-0c3e8be8922c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:15.408239 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9e56669b-11fc-4baa-a7a7-93d2823b913a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:15.408897 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9e56669b-11fc-4baa-a7a7-93d2823b913a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:15.412671 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-45a26010-22c3-4389-b5d5-0c3e8be8922c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:15.459509 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-45a26010-22c3-4389-b5d5-0c3e8be8922c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:15.460696 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-45a26010-22c3-4389-b5d5-0c3e8be8922c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:15.463677 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-45a26010-22c3-4389-b5d5-0c3e8be8922c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:15.468159 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-45a26010-22c3-4389-b5d5-0c3e8be8922c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:16.284175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9e56669b-11fc-4baa-a7a7-93d2823b913a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:16.356518 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9e56669b-11fc-4baa-a7a7-93d2823b913a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1461 microversion: 2.1 time: 0.988389 Jun 16 14:43:16.362709 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 596/1193] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:15 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1461 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:16.385409 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-18a2f69e-2c19-4bf9-952f-51ff1351425f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:16.391069 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-18a2f69e-2c19-4bf9-952f-51ff1351425f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:16.415413 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18a2f69e-2c19-4bf9-952f-51ff1351425f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:16.418671 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18a2f69e-2c19-4bf9-952f-51ff1351425f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:16.435819 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18a2f69e-2c19-4bf9-952f-51ff1351425f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:16.445597 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18a2f69e-2c19-4bf9-952f-51ff1351425f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:16.911628 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-45a26010-22c3-4389-b5d5-0c3e8be8922c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:16.927081 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-45a26010-22c3-4389-b5d5-0c3e8be8922c tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1331 microversion: 2.1 time: 1.547729 Jun 16 14:43:16.927727 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 598/1194] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:15 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1331 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:16.949186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5abdf82b-775d-448b-bacb-ab306a947d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afe2a9db-4f95-450e-a15f-c1856c09cc15", "device": "/dev/xvdb"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:16.954443 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5abdf82b-775d-448b-bacb-ab306a947d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:16.975796 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5abdf82b-775d-448b-bacb-ab306a947d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:16.977410 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5abdf82b-775d-448b-bacb-ab306a947d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:16.980119 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5abdf82b-775d-448b-bacb-ab306a947d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:16.981094 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5abdf82b-775d-448b-bacb-ab306a947d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:17.207926 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-18a2f69e-2c19-4bf9-952f-51ff1351425f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:17.242489 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-18a2f69e-2c19-4bf9-952f-51ff1351425f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1317 microversion: 2.1 time: 0.876555 Jun 16 14:43:17.269642 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 597/1195] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:16 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1317 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:17.284884 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bebf311c-94ce-4cd9-8bfa-3da5532746ac tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:17.286018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bebf311c-94ce-4cd9-8bfa-3da5532746ac tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:17.329168 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bebf311c-94ce-4cd9-8bfa-3da5532746ac tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:17.329991 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bebf311c-94ce-4cd9-8bfa-3da5532746ac tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:17.331574 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bebf311c-94ce-4cd9-8bfa-3da5532746ac tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:17.340758 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bebf311c-94ce-4cd9-8bfa-3da5532746ac tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:17.485727 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:17.745061 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5abdf82b-775d-448b-bacb-ab306a947d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "POST /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.811669 Jun 16 14:43:17.758677 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 599/1196] 10.222.0.57 () {62 vars in 1363 bytes} [Thu Jun 16 14:43:16 2022] POST /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments => generated 194 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:43:17.763070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f7c500dc-7ae1-404f-9238-a981b1a6e1ea tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:17.784507 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f7c500dc-7ae1-404f-9238-a981b1a6e1ea tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:17.819670 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f7c500dc-7ae1-404f-9238-a981b1a6e1ea tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:17.825224 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f7c500dc-7ae1-404f-9238-a981b1a6e1ea tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:17.826987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f7c500dc-7ae1-404f-9238-a981b1a6e1ea tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:17.831184 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f7c500dc-7ae1-404f-9238-a981b1a6e1ea tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:17.862791 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bebf311c-94ce-4cd9-8bfa-3da5532746ac tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:17.869210 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:17.891097 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bebf311c-94ce-4cd9-8bfa-3da5532746ac tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1316 microversion: 2.1 time: 0.618557 Jun 16 14:43:17.892758 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 598/1197] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:17 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1316 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:17.921574 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-eb4f1aa7-7d80-4546-bf93-a7db9c292395 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:17.937322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-eb4f1aa7-7d80-4546-bf93-a7db9c292395 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:17.959708 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb4f1aa7-7d80-4546-bf93-a7db9c292395 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:17.966015 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb4f1aa7-7d80-4546-bf93-a7db9c292395 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:17.967900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb4f1aa7-7d80-4546-bf93-a7db9c292395 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:17.969547 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb4f1aa7-7d80-4546-bf93-a7db9c292395 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:18.334232 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-eb4f1aa7-7d80-4546-bf93-a7db9c292395 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:18.376948 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-eb4f1aa7-7d80-4546-bf93-a7db9c292395 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1349 microversion: 2.1 time: 0.471584 Jun 16 14:43:18.396024 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 599/1198] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:17 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1349 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:18.415727 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e16526ec-d663-4402-a979-2d22755d97cf tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:18.419203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e16526ec-d663-4402-a979-2d22755d97cf tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:18.435968 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e16526ec-d663-4402-a979-2d22755d97cf tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:18.438917 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e16526ec-d663-4402-a979-2d22755d97cf tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:18.440085 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e16526ec-d663-4402-a979-2d22755d97cf tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:18.442314 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e16526ec-d663-4402-a979-2d22755d97cf tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:18.790139 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f7c500dc-7ae1-404f-9238-a981b1a6e1ea tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:18.812609 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f7c500dc-7ae1-404f-9238-a981b1a6e1ea tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1461 microversion: 2.1 time: 1.057160 Jun 16 14:43:18.813231 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 600/1199] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:17 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1461 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:18.822645 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8e3ea1d2-3184-405d-b188-71b7113de816 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:18.823498 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8e3ea1d2-3184-405d-b188-71b7113de816 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:18.836586 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8e3ea1d2-3184-405d-b188-71b7113de816 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:18.843785 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8e3ea1d2-3184-405d-b188-71b7113de816 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:18.844681 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8e3ea1d2-3184-405d-b188-71b7113de816 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:18.845152 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8e3ea1d2-3184-405d-b188-71b7113de816 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:19.170201 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e16526ec-d663-4402-a979-2d22755d97cf tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:19.189739 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e16526ec-d663-4402-a979-2d22755d97cf tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1331 microversion: 2.1 time: 0.790047 Jun 16 14:43:19.202975 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 600/1200] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:18 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1331 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:19.209512 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:19.211529 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:19.219941 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:19.220720 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:19.221840 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:19.222758 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:19.415785 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:43:19.421179 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:43:19.421745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:43:19.422454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:43:19.431563 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:43:19.632293 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:19.646527 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:19.647952 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:19.649921 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:19.651369 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:19.723153 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-85738cbb-81ab-4965-97fe-2f3e5582b424 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "POST /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb/action" status: 202 len: 1065 microversion: 2.1 time: 0.517923 Jun 16 14:43:19.725468 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 601/1201] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:43:19 2022] POST /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb/action => generated 1065 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 16 14:43:19.746965 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-953e8c37-5f04-489b-bf54-855fe02ab788 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:19.748672 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-953e8c37-5f04-489b-bf54-855fe02ab788 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:19.785262 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-953e8c37-5f04-489b-bf54-855fe02ab788 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:19.786281 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-953e8c37-5f04-489b-bf54-855fe02ab788 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:19.790412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-953e8c37-5f04-489b-bf54-855fe02ab788 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:19.791115 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-953e8c37-5f04-489b-bf54-855fe02ab788 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:19.897890 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8e3ea1d2-3184-405d-b188-71b7113de816 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:19.920109 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8e3ea1d2-3184-405d-b188-71b7113de816 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1317 microversion: 2.1 time: 1.098841 Jun 16 14:43:19.920829 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 601/1202] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:18 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1317 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:19.935176 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-367994eb-d9fb-4c20-9dd6-2dc6c60df41a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:19.936124 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-367994eb-d9fb-4c20-9dd6-2dc6c60df41a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:19.963625 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-367994eb-d9fb-4c20-9dd6-2dc6c60df41a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:19.970053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-367994eb-d9fb-4c20-9dd6-2dc6c60df41a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:19.974405 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-367994eb-d9fb-4c20-9dd6-2dc6c60df41a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:19.976879 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-367994eb-d9fb-4c20-9dd6-2dc6c60df41a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:20.064317 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-953e8c37-5f04-489b-bf54-855fe02ab788 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:20.074077 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=48 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:20.080965 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-953e8c37-5f04-489b-bf54-855fe02ab788 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1316 microversion: 2.1 time: 0.351798 Jun 16 14:43:20.081190 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 602/1203] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:19 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:20.088350 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f66aa452-fcd7-46d2-800d-ecabbfbb9ef6 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:20.089116 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f66aa452-fcd7-46d2-800d-ecabbfbb9ef6 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:20.109231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f66aa452-fcd7-46d2-800d-ecabbfbb9ef6 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:20.109913 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f66aa452-fcd7-46d2-800d-ecabbfbb9ef6 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:20.111022 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f66aa452-fcd7-46d2-800d-ecabbfbb9ef6 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:20.112087 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f66aa452-fcd7-46d2-800d-ecabbfbb9ef6 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:20.359261 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f66aa452-fcd7-46d2-800d-ecabbfbb9ef6 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:20.371835 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f66aa452-fcd7-46d2-800d-ecabbfbb9ef6 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1470 microversion: 2.1 time: 0.288525 Jun 16 14:43:20.373791 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 603/1204] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:20 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1470 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:20.388541 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-ec13ecc8-4c82-4d69-b788-c7d1f62fb2d9 req-a32a0bd4-14a4-46ad-9809-eeeccccf5c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f83874-bfcd-4b80-a6c5-949bd8f341b9", "name": "network-vif-plugged", "status": "completed", "tag": "91b49d73-f169-45f2-8cf3-953aebec904e"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:20.400657 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-ec13ecc8-4c82-4d69-b788-c7d1f62fb2d9 req-a32a0bd4-14a4-46ad-9809-eeeccccf5c7c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:20.401466 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-ec13ecc8-4c82-4d69-b788-c7d1f62fb2d9 req-a32a0bd4-14a4-46ad-9809-eeeccccf5c7c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:20.421002 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-ec13ecc8-4c82-4d69-b788-c7d1f62fb2d9 req-a32a0bd4-14a4-46ad-9809-eeeccccf5c7c service nova] Creating event network-vif-plugged:91b49d73-f169-45f2-8cf3-953aebec904e for instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 on n-h1-836830-4 Jun 16 14:43:20.435982 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-ec13ecc8-4c82-4d69-b788-c7d1f62fb2d9 req-a32a0bd4-14a4-46ad-9809-eeeccccf5c7c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060533 Jun 16 14:43:20.438475 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 604/1205] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:20.446275 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-54f24886-f469-4c6f-b7a1-cf8ab30fef24 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:20.447322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-54f24886-f469-4c6f-b7a1-cf8ab30fef24 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:20.468561 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54f24886-f469-4c6f-b7a1-cf8ab30fef24 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:20.469454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54f24886-f469-4c6f-b7a1-cf8ab30fef24 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:20.470777 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54f24886-f469-4c6f-b7a1-cf8ab30fef24 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:20.471520 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54f24886-f469-4c6f-b7a1-cf8ab30fef24 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:20.907427 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-54f24886-f469-4c6f-b7a1-cf8ab30fef24 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:20.934090 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-54f24886-f469-4c6f-b7a1-cf8ab30fef24 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1535 microversion: 2.1 time: 0.492456 Jun 16 14:43:20.936322 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 605/1206] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:20 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1535 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:20.954944 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-acf72a96-9f64-4b36-871e-ffe4e8752cfd tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:20.955599 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-acf72a96-9f64-4b36-871e-ffe4e8752cfd tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:20.963344 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-acf72a96-9f64-4b36-871e-ffe4e8752cfd tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:20.964800 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-acf72a96-9f64-4b36-871e-ffe4e8752cfd tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:20.965908 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-acf72a96-9f64-4b36-871e-ffe4e8752cfd tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:20.966364 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-acf72a96-9f64-4b36-871e-ffe4e8752cfd tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:21.203025 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-367994eb-d9fb-4c20-9dd6-2dc6c60df41a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:21.227523 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-367994eb-d9fb-4c20-9dd6-2dc6c60df41a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1337 microversion: 2.1 time: 1.302334 Jun 16 14:43:21.229090 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 602/1207] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:19 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1337 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:21.240457 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b2477394-e2e1-4ddc-adc7-2e9b7895da82 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Action: 'create', calling method: .version_select at 0x7fdeffb51430>, body: {"pool": "32dbc124-f3c2-4202-ae2b-8955b562fec8"} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:21.285390 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-acf72a96-9f64-4b36-871e-ffe4e8752cfd tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:21.301843 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-acf72a96-9f64-4b36-871e-ffe4e8752cfd tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1317 microversion: 2.1 time: 0.353204 Jun 16 14:43:21.304422 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 606/1208] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:20 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:21.323849 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-78d52567-0af7-484c-8fb3-89b93c63d3e1 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:21.326945 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-78d52567-0af7-484c-8fb3-89b93c63d3e1 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:21.352075 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78d52567-0af7-484c-8fb3-89b93c63d3e1 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:21.352597 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78d52567-0af7-484c-8fb3-89b93c63d3e1 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:21.358109 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78d52567-0af7-484c-8fb3-89b93c63d3e1 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:21.359648 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78d52567-0af7-484c-8fb3-89b93c63d3e1 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:21.360774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:21.628833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-78d52567-0af7-484c-8fb3-89b93c63d3e1 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:21.641710 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-78d52567-0af7-484c-8fb3-89b93c63d3e1 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1316 microversion: 2.1 time: 0.335115 Jun 16 14:43:21.643089 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 607/1209] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:21 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1316 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:21.648353 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fe46254b-d44c-4fd5-9b1a-43ea98375068 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:21.649085 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fe46254b-d44c-4fd5-9b1a-43ea98375068 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:21.657075 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fe46254b-d44c-4fd5-9b1a-43ea98375068 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:21.657636 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fe46254b-d44c-4fd5-9b1a-43ea98375068 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:21.658595 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fe46254b-d44c-4fd5-9b1a-43ea98375068 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:21.659137 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fe46254b-d44c-4fd5-9b1a-43ea98375068 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:21.917548 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fe46254b-d44c-4fd5-9b1a-43ea98375068 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:21.928738 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fe46254b-d44c-4fd5-9b1a-43ea98375068 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1470 microversion: 2.1 time: 0.284263 Jun 16 14:43:21.929354 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 608/1210] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:21 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1470 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:22.261189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9f2282ae-dca5-4b07-b3f7-58910679bd37 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:22.261189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9f2282ae-dca5-4b07-b3f7-58910679bd37 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:22.269127 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9f2282ae-dca5-4b07-b3f7-58910679bd37 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:22.269512 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9f2282ae-dca5-4b07-b3f7-58910679bd37 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:22.270510 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9f2282ae-dca5-4b07-b3f7-58910679bd37 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:22.270993 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9f2282ae-dca5-4b07-b3f7-58910679bd37 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:22.427092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9f2282ae-dca5-4b07-b3f7-58910679bd37 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:22.438756 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9f2282ae-dca5-4b07-b3f7-58910679bd37 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1337 microversion: 2.1 time: 0.182710 Jun 16 14:43:22.453087 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 609/1211] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:22 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1337 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:43:22.458861 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-731ceedb-a2e0-4955-82d6-ce8582b7de20 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:22.459502 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-731ceedb-a2e0-4955-82d6-ce8582b7de20 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:22.483621 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-731ceedb-a2e0-4955-82d6-ce8582b7de20 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:22.484481 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-731ceedb-a2e0-4955-82d6-ce8582b7de20 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:22.485642 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-731ceedb-a2e0-4955-82d6-ce8582b7de20 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:22.486339 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-731ceedb-a2e0-4955-82d6-ce8582b7de20 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:22.966259 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-731ceedb-a2e0-4955-82d6-ce8582b7de20 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:23.047057 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-731ceedb-a2e0-4955-82d6-ce8582b7de20 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1317 microversion: 2.1 time: 0.587626 Jun 16 14:43:23.062280 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 610/1212] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:22 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1317 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:23.098979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-a6b864a9-084f-4f2d-8253-2fb8b1991abe req-0711f67f-fa0f-426a-989b-fa3ff08883a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d332fa7-1e7c-4195-9270-4a0183b48bfd", "name": "network-vif-plugged", "status": "completed", "tag": "f1a65e7b-fc75-44fa-9938-510653a14181"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:23.138686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-a6b864a9-084f-4f2d-8253-2fb8b1991abe req-0711f67f-fa0f-426a-989b-fa3ff08883a6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:23.139322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-a6b864a9-084f-4f2d-8253-2fb8b1991abe req-0711f67f-fa0f-426a-989b-fa3ff08883a6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:23.184820 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-a6b864a9-084f-4f2d-8253-2fb8b1991abe req-0711f67f-fa0f-426a-989b-fa3ff08883a6 service nova] Creating event network-vif-plugged:f1a65e7b-fc75-44fa-9938-510653a14181 for instance 0d332fa7-1e7c-4195-9270-4a0183b48bfd on n-h1-836830-4 Jun 16 14:43:23.205444 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-a6b864a9-084f-4f2d-8253-2fb8b1991abe req-0711f67f-fa0f-426a-989b-fa3ff08883a6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147722 Jun 16 14:43:23.206263 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 611/1213] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:23.226229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-62ba2822-ed2e-4c99-863d-c3c687b95e66 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:23.243549 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-62ba2822-ed2e-4c99-863d-c3c687b95e66 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:23.285216 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-62ba2822-ed2e-4c99-863d-c3c687b95e66 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:23.285833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-62ba2822-ed2e-4c99-863d-c3c687b95e66 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:23.286963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-62ba2822-ed2e-4c99-863d-c3c687b95e66 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:23.287521 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-62ba2822-ed2e-4c99-863d-c3c687b95e66 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:24.468898 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-62ba2822-ed2e-4c99-863d-c3c687b95e66 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:24.511861 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-62ba2822-ed2e-4c99-863d-c3c687b95e66 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1316 microversion: 2.1 time: 1.303648 Jun 16 14:43:24.513701 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 612/1214] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:23 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1316 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:24.549509 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5463e18a-379d-453f-a354-a596b4c51182 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:24.554714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5463e18a-379d-453f-a354-a596b4c51182 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:24.592820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5463e18a-379d-453f-a354-a596b4c51182 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:24.593814 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5463e18a-379d-453f-a354-a596b4c51182 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:24.595442 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5463e18a-379d-453f-a354-a596b4c51182 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:24.596403 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5463e18a-379d-453f-a354-a596b4c51182 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:24.706730 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.167756 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5463e18a-379d-453f-a354-a596b4c51182 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:25.200110 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5463e18a-379d-453f-a354-a596b4c51182 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1470 microversion: 2.1 time: 0.681945 Jun 16 14:43:25.204331 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 613/1215] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:24 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1470 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:25.234301 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3320fc3b-6bfd-4e28-86cd-2bc6908b90dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:25.260098 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3320fc3b-6bfd-4e28-86cd-2bc6908b90dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:25.280949 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3320fc3b-6bfd-4e28-86cd-2bc6908b90dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:25.282657 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3320fc3b-6bfd-4e28-86cd-2bc6908b90dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:25.285229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3320fc3b-6bfd-4e28-86cd-2bc6908b90dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:25.286519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3320fc3b-6bfd-4e28-86cd-2bc6908b90dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:25.363001 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=12 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.981991 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3320fc3b-6bfd-4e28-86cd-2bc6908b90dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:26.014926 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:26.019688 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3320fc3b-6bfd-4e28-86cd-2bc6908b90dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1379 microversion: 2.1 time: 0.810791 Jun 16 14:43:26.040063 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 614/1216] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:25 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1379 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:26.092416 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-93f54d56-85fe-471e-b368-9ddef82e098f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:26.093082 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-93f54d56-85fe-471e-b368-9ddef82e098f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:26.127388 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-93f54d56-85fe-471e-b368-9ddef82e098f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:26.128741 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-93f54d56-85fe-471e-b368-9ddef82e098f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:26.131146 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-93f54d56-85fe-471e-b368-9ddef82e098f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:26.132633 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-93f54d56-85fe-471e-b368-9ddef82e098f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:26.912653 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-93f54d56-85fe-471e-b368-9ddef82e098f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:26.957547 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-93f54d56-85fe-471e-b368-9ddef82e098f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1508 microversion: 2.1 time: 0.914834 Jun 16 14:43:26.958675 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 615/1217] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:26 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1508 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:26.984888 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-da9c231f-3d22-4318-939f-4decb0248647 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:26.985827 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-da9c231f-3d22-4318-939f-4decb0248647 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:27.011007 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-da9c231f-3d22-4318-939f-4decb0248647 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:27.011843 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-da9c231f-3d22-4318-939f-4decb0248647 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:27.013189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-da9c231f-3d22-4318-939f-4decb0248647 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:27.013938 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-da9c231f-3d22-4318-939f-4decb0248647 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:27.485926 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b2477394-e2e1-4ddc-adc7-2e9b7895da82 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.254259 Jun 16 14:43:27.496426 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 603/1218] 10.222.0.57 () {60 vars in 1169 bytes} [Thu Jun 16 14:43:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:27.503943 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e1de6308-be8c-4445-8640-39fd1f0ce6d3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:27.506951 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e1de6308-be8c-4445-8640-39fd1f0ce6d3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:27.532292 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e1de6308-be8c-4445-8640-39fd1f0ce6d3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:27.532754 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e1de6308-be8c-4445-8640-39fd1f0ce6d3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:27.533567 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e1de6308-be8c-4445-8640-39fd1f0ce6d3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:27.539936 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e1de6308-be8c-4445-8640-39fd1f0ce6d3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:27.960002 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-da9c231f-3d22-4318-939f-4decb0248647 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:28.025520 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-da9c231f-3d22-4318-939f-4decb0248647 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1504 microversion: 2.1 time: 1.056558 Jun 16 14:43:28.041787 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 616/1219] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:26 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1504 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:28.065318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-75127120-8d75-409c-bd4d-34e1220293b7 req-6a6146da-c4db-4226-a550-d72b50827a09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b628388b-e782-439f-b76a-ab248b22404a", "tag": "8bb810a3-e086-4b58-bef2-f3a96202f1cd"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:28.156076 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-75127120-8d75-409c-bd4d-34e1220293b7 req-6a6146da-c4db-4226-a550-d72b50827a09 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:28.156885 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-75127120-8d75-409c-bd4d-34e1220293b7 req-6a6146da-c4db-4226-a550-d72b50827a09 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:28.226084 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-75127120-8d75-409c-bd4d-34e1220293b7 req-6a6146da-c4db-4226-a550-d72b50827a09 service nova] Creating event network-changed:8bb810a3-e086-4b58-bef2-f3a96202f1cd for instance b628388b-e782-439f-b76a-ab248b22404a on n-h2-836830-4 Jun 16 14:43:28.262970 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-75127120-8d75-409c-bd4d-34e1220293b7 req-6a6146da-c4db-4226-a550-d72b50827a09 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218824 Jun 16 14:43:28.292287 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 617/1220] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:28.323025 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2f8cbcc0-ed15-4c3a-9519-80e5047f7601 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:28.324545 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2f8cbcc0-ed15-4c3a-9519-80e5047f7601 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:28.360614 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2f8cbcc0-ed15-4c3a-9519-80e5047f7601 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:28.361417 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2f8cbcc0-ed15-4c3a-9519-80e5047f7601 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:28.362939 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2f8cbcc0-ed15-4c3a-9519-80e5047f7601 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:28.363751 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2f8cbcc0-ed15-4c3a-9519-80e5047f7601 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:28.394013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e1de6308-be8c-4445-8640-39fd1f0ce6d3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:28.428955 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e1de6308-be8c-4445-8640-39fd1f0ce6d3 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1470 microversion: 2.1 time: 0.930967 Jun 16 14:43:28.438315 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 604/1221] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:27 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1470 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:28.492469 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9833b955-4e40-4887-af28-da762a3f60a4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Action: 'action', calling method: .version_select at 0x7fdf0eb0f790>, body: {"addFloatingIp": {"address": "172.25.7.229"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:28.499140 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9833b955-4e40-4887-af28-da762a3f60a4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:28.529879 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9833b955-4e40-4887-af28-da762a3f60a4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:28.530709 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9833b955-4e40-4887-af28-da762a3f60a4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:28.532142 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9833b955-4e40-4887-af28-da762a3f60a4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:28.533748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9833b955-4e40-4887-af28-da762a3f60a4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:28.890964 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9833b955-4e40-4887-af28-da762a3f60a4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Acquired lock "refresh_cache-2dce7bf2-76fb-41fc-b977-92c5ee0c31de" {{(pid=125863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 14:43:29.073250 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2f8cbcc0-ed15-4c3a-9519-80e5047f7601 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:29.106148 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2f8cbcc0-ed15-4c3a-9519-80e5047f7601 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1379 microversion: 2.1 time: 0.810149 Jun 16 14:43:29.112831 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 618/1222] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:28 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1379 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:29.130614 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0eaaf786-4f4f-4ccf-9b2c-b0227968af21 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-497807136"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:29.131535 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0eaaf786-4f4f-4ccf-9b2c-b0227968af21 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:29.153415 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0eaaf786-4f4f-4ccf-9b2c-b0227968af21 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:29.154690 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0eaaf786-4f4f-4ccf-9b2c-b0227968af21 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:29.156483 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0eaaf786-4f4f-4ccf-9b2c-b0227968af21 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:29.157460 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0eaaf786-4f4f-4ccf-9b2c-b0227968af21 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:29.887274 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.network.security_group_api [None req-0eaaf786-4f4f-4ccf-9b2c-b0227968af21 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Adding security group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 to port 91b49d73-f169-45f2-8cf3-953aebec904e Jun 16 14:43:32.114048 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0eaaf786-4f4f-4ccf-9b2c-b0227968af21 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9/action" status: 202 len: 0 microversion: 2.1 time: 2.997885 Jun 16 14:43:32.115354 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 619/1223] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:43:29 2022] POST /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9/action => generated 0 bytes in 3000 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:43:32.129679 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-36daaf29-4543-4144-af68-cbaa4c63cff7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:32.132065 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-36daaf29-4543-4144-af68-cbaa4c63cff7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:32.159095 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-36daaf29-4543-4144-af68-cbaa4c63cff7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:32.167725 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-36daaf29-4543-4144-af68-cbaa4c63cff7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:32.175663 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-36daaf29-4543-4144-af68-cbaa4c63cff7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:32.176567 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-36daaf29-4543-4144-af68-cbaa4c63cff7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:32.854647 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-36daaf29-4543-4144-af68-cbaa4c63cff7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:32.898864 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-36daaf29-4543-4144-af68-cbaa4c63cff7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1470 microversion: 2.1 time: 0.772256 Jun 16 14:43:32.899592 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 620/1224] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:32 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1470 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:32.905979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-49c9c84a-fed8-4a73-b536-2580139604c5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:32.912230 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-49c9c84a-fed8-4a73-b536-2580139604c5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:32.953169 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49c9c84a-fed8-4a73-b536-2580139604c5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:32.953842 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49c9c84a-fed8-4a73-b536-2580139604c5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:32.955400 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49c9c84a-fed8-4a73-b536-2580139604c5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:32.956175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49c9c84a-fed8-4a73-b536-2580139604c5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:33.562847 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-49c9c84a-fed8-4a73-b536-2580139604c5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:33.589264 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-49c9c84a-fed8-4a73-b536-2580139604c5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1379 microversion: 2.1 time: 0.686492 Jun 16 14:43:33.607444 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 621/1225] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:32 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1379 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:33.623431 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7310bcb6-2e88-4947-a511-02456fb6a133 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdeffe0a4c0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:34.197104 n-d-836830-4 devstack@n-api.service[125862]: DEBUG neutronclient.v2_0.client [None req-7310bcb6-2e88-4947-a511-02456fb6a133 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 in use.", "detail": ""}} {{(pid=125862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:43:34.198948 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-7310bcb6-2e88-4947-a511-02456fb6a133 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Security Group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 in use. Jun 16 14:43:34.198948 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-1d658808-39a4-4018-976b-3fa41fc44432'] Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7310bcb6-2e88-4947-a511-02456fb6a133 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/os-security-groups/ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 HTTP/1.1 Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:43:34.203360 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:43:34.206090 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:43:34.206090 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:43:34.206090 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:43:34.206090 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:43:34.206090 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:43:34.206090 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:43:34.206090 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:43:34.206090 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:43:34.206090 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:43:34.206090 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:43:34.206090 n-d-836830-4 devstack@n-api.service[125862]: exception: Security Group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 in use. Jun 16 14:43:34.206090 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-1d658808-39a4-4018-976b-3fa41fc44432'] Jun 16 14:43:34.206090 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'ae8e4cb7-22b4-4984-b62d-924c60b7fcd4'} Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:34.207943 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 in use. Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d658808-39a4-4018-976b-3fa41fc44432'] Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 in use. Jun 16 14:43:34.210212 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d658808-39a4-4018-976b-3fa41fc44432'] Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 in use. Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d658808-39a4-4018-976b-3fa41fc44432'] Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:34.213130 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:43:34.215876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:43:34.215876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:43:34.215876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:43:34.215876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 in use. Jun 16 14:43:34.215876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d658808-39a4-4018-976b-3fa41fc44432'] Jun 16 14:43:34.215876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:34.223432 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7310bcb6-2e88-4947-a511-02456fb6a133 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 400 to user: Security Group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 in use. Jun 16 14:43:34.223432 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-1d658808-39a4-4018-976b-3fa41fc44432'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:43:34.229859 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7310bcb6-2e88-4947-a511-02456fb6a133 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/ae8e4cb7-22b4-4984-b62d-924c60b7fcd4" status: 400 len: 185 microversion: 2.1 time: 0.611143 Jun 16 14:43:34.243781 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 622/1226] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:43:33 2022] DELETE /compute/v2.1/os-security-groups/ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 => generated 185 bytes in 634 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:43:34.268769 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-25431258-645a-45e8-a72a-fe15cd3c59c9 req-72227f98-5448-4a17-bfa6-31a466516084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f83874-bfcd-4b80-a6c5-949bd8f341b9", "tag": "91b49d73-f169-45f2-8cf3-953aebec904e"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:34.306774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-25431258-645a-45e8-a72a-fe15cd3c59c9 req-72227f98-5448-4a17-bfa6-31a466516084 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:34.306774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-25431258-645a-45e8-a72a-fe15cd3c59c9 req-72227f98-5448-4a17-bfa6-31a466516084 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:34.321729 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-25431258-645a-45e8-a72a-fe15cd3c59c9 req-72227f98-5448-4a17-bfa6-31a466516084 service nova] Creating event network-changed:91b49d73-f169-45f2-8cf3-953aebec904e for instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 on n-h1-836830-4 Jun 16 14:43:34.330962 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-25431258-645a-45e8-a72a-fe15cd3c59c9 req-72227f98-5448-4a17-bfa6-31a466516084 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084715 Jun 16 14:43:34.331968 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 623/1227] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:34.338352 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6841775a-6692-4ca2-8994-12dc56424adb tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2806e5a7-ec15-4f03-b591-aec61cb234ad"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:34.339690 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6841775a-6692-4ca2-8994-12dc56424adb tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:34.349251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6841775a-6692-4ca2-8994-12dc56424adb tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:34.349650 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6841775a-6692-4ca2-8994-12dc56424adb tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:34.350927 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6841775a-6692-4ca2-8994-12dc56424adb tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:34.351905 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6841775a-6692-4ca2-8994-12dc56424adb tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:34.449368 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-6841775a-6692-4ca2-8994-12dc56424adb tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] HTTP exception thrown: Volume e79bfb05-e4f0-4aba-ac3f-377dd5da28c6 could not be found. Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6841775a-6692-4ca2-8994-12dc56424adb tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] Request method failure captured: Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: request: PUT /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd/os-volume_attachments/e79bfb05-e4f0-4aba-ac3f-377dd5da28c6 HTTP/1.1 Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 74 Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0Dc41l-zrBSgjtO9Bd-jaUO8mZ2fss_gcE9CDo4V348tU7xIYxjZ-SlkRtb2to47iD59-lhKUhK5F_fF5R3j3GlFtHzwLuKV6aVhzt11w0Eun5iCuQDSOFBX-1St1w7xGL67zp6I-rLBiMiAkv2Vyn7zKnL8HWIB3X0-fXkDDaQKWw Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 922b9d07f9b0461a95beabbac86674ff Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-VolumesAdminNegativeTest-1506851913 Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:43:34.453827 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:43:34.455593 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_922b9d07f9b0461a95beabbac86674ff", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/922b9d07f9b0461a95beabbac86674ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/922b9d07f9b0461a95beabbac86674ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/922b9d07f9b0461a95beabbac86674ff"}]}] Jun 16 14:43:34.455593 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-VolumesAdminNegativeTest-1506851913 Jun 16 14:43:34.455593 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 922b9d07f9b0461a95beabbac86674ff Jun 16 14:43:34.455593 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1506851913 Jun 16 14:43:34.455593 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-VolumesAdminNegativeTest-1506851913-project-admin Jun 16 14:43:34.455593 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:43:34.455593 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:43:34.455593 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 41601ca682e349f7b916a6f3e57e9aa6 Jun 16 14:43:34.455593 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-VolumesAdminNegativeTest-1506851913-project-admin Jun 16 14:43:34.455593 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:43:34.455593 n-d-836830-4 devstack@n-api.service[125862]: {"volumeAttachment": {"volumeId": "2806e5a7-ec15-4f03-b591-aec61cb234ad"}} Jun 16 14:43:34.455593 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:43:34.455593 n-d-836830-4 devstack@n-api.service[125862]: exception: Volume e79bfb05-e4f0-4aba-ac3f-377dd5da28c6 could not be found. Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'server_id': '0d332fa7-1e7c-4195-9270-4a0183b48bfd', 'id': 'e79bfb05-e4f0-4aba-ac3f-377dd5da28c6', 'body': {'volumeAttachment': {'volumeId': '2806e5a7-ec15-4f03-b591-aec61cb234ad'}}} Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:43:34.456687 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e79bfb05-e4f0-4aba-ac3f-377dd5da28c6 could not be found. (HTTP 404) (Request-ID: req-7509b09a-afae-4ae2-95d1-23a64ee69b3a) Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:43:34.457804 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e79bfb05-e4f0-4aba-ac3f-377dd5da28c6 could not be found. Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:43:34.459352 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e79bfb05-e4f0-4aba-ac3f-377dd5da28c6 could not be found. Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e79bfb05-e4f0-4aba-ac3f-377dd5da28c6 could not be found. Jun 16 14:43:34.461479 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:34.473071 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6841775a-6692-4ca2-8994-12dc56424adb tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] Returning 404 to user: Volume e79bfb05-e4f0-4aba-ac3f-377dd5da28c6 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:43:34.473071 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6841775a-6692-4ca2-8994-12dc56424adb tempest-VolumesAdminNegativeTest-1506851913 tempest-VolumesAdminNegativeTest-1506851913-project-admin] 10.222.0.57 "PUT /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd/os-volume_attachments/e79bfb05-e4f0-4aba-ac3f-377dd5da28c6" status: 404 len: 109 microversion: 2.1 time: 0.132371 Jun 16 14:43:34.487164 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 624/1228] 10.222.0.57 () {60 vars in 1432 bytes} [Thu Jun 16 14:43:34 2022] PUT /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd/os-volume_attachments/e79bfb05-e4f0-4aba-ac3f-377dd5da28c6 => generated 109 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:43:34.495688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-61c5c022-cb0d-47c4-b5ad-cd92dca6c525 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:34.500671 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-61c5c022-cb0d-47c4-b5ad-cd92dca6c525 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:34.515767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-61c5c022-cb0d-47c4-b5ad-cd92dca6c525 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:34.519866 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-61c5c022-cb0d-47c4-b5ad-cd92dca6c525 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:34.522198 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-61c5c022-cb0d-47c4-b5ad-cd92dca6c525 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:34.525606 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-61c5c022-cb0d-47c4-b5ad-cd92dca6c525 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:35.167968 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-61c5c022-cb0d-47c4-b5ad-cd92dca6c525 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:35.182865 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-61c5c022-cb0d-47c4-b5ad-cd92dca6c525 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1470 microversion: 2.1 time: 0.690622 Jun 16 14:43:35.184010 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 625/1229] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:34 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1470 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:35.192074 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e2a115a4-5c92-4d4e-bed9-7411425d23e1 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:35.201691 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e2a115a4-5c92-4d4e-bed9-7411425d23e1 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:35.225527 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e2a115a4-5c92-4d4e-bed9-7411425d23e1 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:35.230501 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e2a115a4-5c92-4d4e-bed9-7411425d23e1 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:35.234686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e2a115a4-5c92-4d4e-bed9-7411425d23e1 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:35.235809 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e2a115a4-5c92-4d4e-bed9-7411425d23e1 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:35.497005 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-9833b955-4e40-4887-af28-da762a3f60a4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Building network info cache for instance {{(pid=125863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 16 14:43:35.531968 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e2a115a4-5c92-4d4e-bed9-7411425d23e1 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9/action" status: 202 len: 0 microversion: 2.1 time: 0.343024 Jun 16 14:43:35.538405 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 626/1230] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:43:35 2022] POST /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:43:35.575503 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-385818f6-77bc-4f08-8723-aaa56bc11cd6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:35.576932 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-385818f6-77bc-4f08-8723-aaa56bc11cd6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:35.621939 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-385818f6-77bc-4f08-8723-aaa56bc11cd6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:35.627507 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-385818f6-77bc-4f08-8723-aaa56bc11cd6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:35.631165 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-385818f6-77bc-4f08-8723-aaa56bc11cd6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:35.634180 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-385818f6-77bc-4f08-8723-aaa56bc11cd6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:36.263958 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-385818f6-77bc-4f08-8723-aaa56bc11cd6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:36.298627 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-385818f6-77bc-4f08-8723-aaa56bc11cd6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1379 microversion: 2.1 time: 0.752999 Jun 16 14:43:36.299741 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 627/1231] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:35 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1379 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:36.314717 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a02cbca8-6fc8-4a0e-8c19-3e7d521398fe tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:36.316059 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a02cbca8-6fc8-4a0e-8c19-3e7d521398fe tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:36.328965 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a02cbca8-6fc8-4a0e-8c19-3e7d521398fe tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:36.329740 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a02cbca8-6fc8-4a0e-8c19-3e7d521398fe tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:36.331275 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a02cbca8-6fc8-4a0e-8c19-3e7d521398fe tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:36.332424 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a02cbca8-6fc8-4a0e-8c19-3e7d521398fe tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:36.866732 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a02cbca8-6fc8-4a0e-8c19-3e7d521398fe tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:36.901442 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a02cbca8-6fc8-4a0e-8c19-3e7d521398fe tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1574 microversion: 2.1 time: 0.598279 Jun 16 14:43:36.913111 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 628/1232] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:36 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1574 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:36.919324 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-90b017b4-d769-4004-bff0-c177aaa193a6 req-9498a545-3b96-4dfc-8f53-c83f9f5344a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dce7bf2-76fb-41fc-b977-92c5ee0c31de", "tag": "59492a60-f926-414e-9a00-833130ddba76"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:36.937612 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-90b017b4-d769-4004-bff0-c177aaa193a6 req-9498a545-3b96-4dfc-8f53-c83f9f5344a7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:36.938962 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-90b017b4-d769-4004-bff0-c177aaa193a6 req-9498a545-3b96-4dfc-8f53-c83f9f5344a7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:36.967963 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-90b017b4-d769-4004-bff0-c177aaa193a6 req-9498a545-3b96-4dfc-8f53-c83f9f5344a7 service nova] Creating event network-changed:59492a60-f926-414e-9a00-833130ddba76 for instance 2dce7bf2-76fb-41fc-b977-92c5ee0c31de on n-h1-836830-4 Jun 16 14:43:36.989341 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-90b017b4-d769-4004-bff0-c177aaa193a6 req-9498a545-3b96-4dfc-8f53-c83f9f5344a7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080290 Jun 16 14:43:36.991115 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 629/1233] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:37.010363 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-df7b8d71-cb0a-490e-873d-e0ce7d4fcb9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:37.011178 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-df7b8d71-cb0a-490e-873d-e0ce7d4fcb9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:37.026878 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-df7b8d71-cb0a-490e-873d-e0ce7d4fcb9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:37.054048 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-df7b8d71-cb0a-490e-873d-e0ce7d4fcb9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:37.055117 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-df7b8d71-cb0a-490e-873d-e0ce7d4fcb9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:37.058970 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-df7b8d71-cb0a-490e-873d-e0ce7d4fcb9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:38.518431 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=14 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:38.577357 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-9833b955-4e40-4887-af28-da762a3f60a4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Updating instance_info_cache with network_info: [{"id": "59492a60-f926-414e-9a00-833130ddba76", "address": "fa:16:3e:3f:7a:91", "network": {"id": "18b171e3-0f91-4866-a080-5bc9876d1718", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1319682769-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2e7a1522e65c4da888c7823ce928a7b7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap59492a60-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 14:43:38.658009 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9833b955-4e40-4887-af28-da762a3f60a4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Releasing lock "refresh_cache-2dce7bf2-76fb-41fc-b977-92c5ee0c31de" {{(pid=125863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 14:43:38.658979 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9833b955-4e40-4887-af28-da762a3f60a4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action" status: 202 len: 0 microversion: 2.1 time: 10.194430 Jun 16 14:43:38.667840 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 605/1234] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:43:28 2022] POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action => generated 0 bytes in 10210 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 16 14:43:38.788566 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-df7b8d71-cb0a-490e-873d-e0ce7d4fcb9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:38.824882 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-df7b8d71-cb0a-490e-873d-e0ce7d4fcb9a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1470 microversion: 2.1 time: 1.831208 Jun 16 14:43:38.830730 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 630/1235] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:36 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1470 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:38.864793 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d51f37fc-8358-4d1e-b2b3-50f998dd83c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:38.866356 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d51f37fc-8358-4d1e-b2b3-50f998dd83c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:38.899698 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:38.902877 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d51f37fc-8358-4d1e-b2b3-50f998dd83c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:38.915544 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d51f37fc-8358-4d1e-b2b3-50f998dd83c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:38.919412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d51f37fc-8358-4d1e-b2b3-50f998dd83c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:38.922628 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d51f37fc-8358-4d1e-b2b3-50f998dd83c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:38.952934 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-660291012", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "3140785d-f673-4aae-abcb-d2ef972abb5e"}]}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:39.113512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] validate_networks() for [('3140785d-f673-4aae-abcb-d2ef972abb5e', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:43:39.464312 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d51f37fc-8358-4d1e-b2b3-50f998dd83c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:39.500704 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d51f37fc-8358-4d1e-b2b3-50f998dd83c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1379 microversion: 2.1 time: 0.660166 Jun 16 14:43:39.503228 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 631/1236] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:38 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1379 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:39.521447 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-eb193cbd-5fbe-4316-9052-8146092ac532 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:39.530859 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-eb193cbd-5fbe-4316-9052-8146092ac532 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:39.555603 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb193cbd-5fbe-4316-9052-8146092ac532 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:39.557149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb193cbd-5fbe-4316-9052-8146092ac532 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:39.562842 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb193cbd-5fbe-4316-9052-8146092ac532 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:39.564333 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb193cbd-5fbe-4316-9052-8146092ac532 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:39.947724 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-eb193cbd-5fbe-4316-9052-8146092ac532 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:39.963376 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-eb193cbd-5fbe-4316-9052-8146092ac532 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1574 microversion: 2.1 time: 0.458220 Jun 16 14:43:39.964320 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 632/1237] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:39 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1574 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:39.970011 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fce5b206-a793-4e9f-ad40-43cc1a7f87f4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:39.971186 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fce5b206-a793-4e9f-ad40-43cc1a7f87f4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:39.980361 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fce5b206-a793-4e9f-ad40-43cc1a7f87f4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:39.981116 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fce5b206-a793-4e9f-ad40-43cc1a7f87f4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:39.982229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fce5b206-a793-4e9f-ad40-43cc1a7f87f4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:39.982963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fce5b206-a793-4e9f-ad40-43cc1a7f87f4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:40.387157 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-fce5b206-a793-4e9f-ad40-43cc1a7f87f4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'services' on Instance uuid e4855363-724b-4eff-a76e-915e440af995 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:43:40.390566 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:40.430987 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fce5b206-a793-4e9f-ad40-43cc1a7f87f4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 2422 microversion: 2.25 time: 0.465047 Jun 16 14:43:40.434324 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 633/1238] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:43:39 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 2422 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:43:40.449380 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ab5792bb-c36a-4801-9553-7b715536f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Action: 'create', calling method: .version_select at 0x7fdeffe14280>, body: {"pool": "32dbc124-f3c2-4202-ae2b-8955b562fec8"} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:40.753424 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:43:40.754165 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:43:40.754165 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:43:40.754738 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:43:40.755110 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:43:40.822679 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:40.823374 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:40.824354 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:40.825695 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:40.859483 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Getting quotas for project 1ac65ee04fbf47608c18c173900ad8f7. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:43:40.879174 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Getting quotas for user f91d14d5fb884048a0b12279c62e963d and project 1ac65ee04fbf47608c18c173900ad8f7. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:43:40.914899 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:43:40.921992 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 044b8b3a-db26-450b-b770-6134060ded1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:43:41.059174 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d9a3f321-b1ef-4da3-80d1-3994220401af tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.389396 Jun 16 14:43:41.063032 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 606/1239] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:43:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:43:41.074411 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-d38226ac-817e-42ee-a0f5-e398c719b296 req-74f8faec-2e0d-477d-820a-1cda4ee7e22d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b628388b-e782-439f-b76a-ab248b22404a", "name": "network-vif-plugged", "status": "completed", "tag": "8bb810a3-e086-4b58-bef2-f3a96202f1cd"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:41.108101 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-d38226ac-817e-42ee-a0f5-e398c719b296 req-74f8faec-2e0d-477d-820a-1cda4ee7e22d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:41.116012 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-d38226ac-817e-42ee-a0f5-e398c719b296 req-74f8faec-2e0d-477d-820a-1cda4ee7e22d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:41.171945 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-d38226ac-817e-42ee-a0f5-e398c719b296 req-74f8faec-2e0d-477d-820a-1cda4ee7e22d service nova] Creating event network-vif-plugged:8bb810a3-e086-4b58-bef2-f3a96202f1cd for instance b628388b-e782-439f-b76a-ab248b22404a on n-h2-836830-4 Jun 16 14:43:41.178852 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-d38226ac-817e-42ee-a0f5-e398c719b296 req-74f8faec-2e0d-477d-820a-1cda4ee7e22d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113178 Jun 16 14:43:41.185971 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 607/1240] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:41.233108 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c3d1cdb1-66ac-4e8f-b270-c54fe6ca66d7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:41.237080 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c3d1cdb1-66ac-4e8f-b270-c54fe6ca66d7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:41.349707 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c3d1cdb1-66ac-4e8f-b270-c54fe6ca66d7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:41.354003 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c3d1cdb1-66ac-4e8f-b270-c54fe6ca66d7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:41.369468 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c3d1cdb1-66ac-4e8f-b270-c54fe6ca66d7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:41.371493 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c3d1cdb1-66ac-4e8f-b270-c54fe6ca66d7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:41.963719 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c3d1cdb1-66ac-4e8f-b270-c54fe6ca66d7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:41.973401 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c3d1cdb1-66ac-4e8f-b270-c54fe6ca66d7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1470 microversion: 2.1 time: 0.782624 Jun 16 14:43:41.977571 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 608/1241] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:41 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1470 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:41.989834 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fa8cb5f4-266c-4006-832e-0621a10eefb4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-4", "block_migration": "auto"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:41.991713 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fa8cb5f4-266c-4006-832e-0621a10eefb4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:42.012240 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fa8cb5f4-266c-4006-832e-0621a10eefb4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:42.014648 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fa8cb5f4-266c-4006-832e-0621a10eefb4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:42.016321 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fa8cb5f4-266c-4006-832e-0621a10eefb4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:42.017096 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fa8cb5f4-266c-4006-832e-0621a10eefb4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:42.355824 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-fa8cb5f4-266c-4006-832e-0621a10eefb4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'flavor' on Instance uuid e4855363-724b-4eff-a76e-915e440af995 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:43:42.373373 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fa8cb5f4-266c-4006-832e-0621a10eefb4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: e4855363-724b-4eff-a76e-915e440af995] Going to try to live migrate instance to n-h1-836830-4 {{(pid=125863) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 14:43:43.823758 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ab5792bb-c36a-4801-9553-7b715536f6b6 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.384370 Jun 16 14:43:43.823758 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 634/1242] 10.222.0.57 () {60 vars in 1169 bytes} [Thu Jun 16 14:43:40 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:43.841670 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2ee4d0e2-deb5-40fe-9d06-9e946c41d0bf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:43.843530 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2ee4d0e2-deb5-40fe-9d06-9e946c41d0bf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:43.870205 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2ee4d0e2-deb5-40fe-9d06-9e946c41d0bf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:43.870965 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2ee4d0e2-deb5-40fe-9d06-9e946c41d0bf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:43.872006 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2ee4d0e2-deb5-40fe-9d06-9e946c41d0bf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:43.876699 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2ee4d0e2-deb5-40fe-9d06-9e946c41d0bf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:44.349729 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2ee4d0e2-deb5-40fe-9d06-9e946c41d0bf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:44.365045 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2ee4d0e2-deb5-40fe-9d06-9e946c41d0bf tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1528 microversion: 2.1 time: 0.539678 Jun 16 14:43:44.368054 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 635/1243] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:43 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1528 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:44.378676 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1180fc1e-93ba-4bff-8938-8fa609c9b33b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:44.386190 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1180fc1e-93ba-4bff-8938-8fa609c9b33b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:44.409548 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1180fc1e-93ba-4bff-8938-8fa609c9b33b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:44.413120 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1180fc1e-93ba-4bff-8938-8fa609c9b33b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:44.417364 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1180fc1e-93ba-4bff-8938-8fa609c9b33b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:44.422039 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1180fc1e-93ba-4bff-8938-8fa609c9b33b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:44.924852 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1180fc1e-93ba-4bff-8938-8fa609c9b33b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:44.950732 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1180fc1e-93ba-4bff-8938-8fa609c9b33b tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1572 microversion: 2.1 time: 0.580837 Jun 16 14:43:44.967806 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 636/1244] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:44 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1572 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:44.977603 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1907cd0d-fc5c-4926-a882-55c116b841fa tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:44.982931 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1907cd0d-fc5c-4926-a882-55c116b841fa tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 044b8b3a-db26-450b-b770-6134060ded1c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:44.996594 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1907cd0d-fc5c-4926-a882-55c116b841fa tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:44.998596 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1907cd0d-fc5c-4926-a882-55c116b841fa tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:44.999718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1907cd0d-fc5c-4926-a882-55c116b841fa tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:45.002320 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1907cd0d-fc5c-4926-a882-55c116b841fa tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:45.153938 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1907cd0d-fc5c-4926-a882-55c116b841fa tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:45.169818 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1907cd0d-fc5c-4926-a882-55c116b841fa tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c" status: 200 len: 1265 microversion: 2.1 time: 0.200178 Jun 16 14:43:45.180692 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 637/1245] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:44 2022] GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:45.190645 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e4914cd2-ac7b-4e89-bcec-7b71de1b62ca tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:45.191489 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e4914cd2-ac7b-4e89-bcec-7b71de1b62ca tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:45.204089 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e4914cd2-ac7b-4e89-bcec-7b71de1b62ca tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:45.207654 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e4914cd2-ac7b-4e89-bcec-7b71de1b62ca tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:45.211697 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e4914cd2-ac7b-4e89-bcec-7b71de1b62ca tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:45.212438 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e4914cd2-ac7b-4e89-bcec-7b71de1b62ca tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:45.250572 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e4914cd2-ac7b-4e89-bcec-7b71de1b62ca tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:43:45.358720 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e4914cd2-ac7b-4e89-bcec-7b71de1b62ca tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 204 len: 0 microversion: 2.1 time: 0.175905 Jun 16 14:43:45.362874 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 638/1246] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:43:45 2022] DELETE /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:45.365943 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b5933f0e-3d08-491b-82ea-1f5e8b13bbf4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:45.367996 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b5933f0e-3d08-491b-82ea-1f5e8b13bbf4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:45.374997 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b5933f0e-3d08-491b-82ea-1f5e8b13bbf4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:45.375590 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b5933f0e-3d08-491b-82ea-1f5e8b13bbf4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:45.376573 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b5933f0e-3d08-491b-82ea-1f5e8b13bbf4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:45.377035 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b5933f0e-3d08-491b-82ea-1f5e8b13bbf4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:45.555025 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b5933f0e-3d08-491b-82ea-1f5e8b13bbf4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:45.567383 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b5933f0e-3d08-491b-82ea-1f5e8b13bbf4 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1476 microversion: 2.1 time: 0.206465 Jun 16 14:43:45.581459 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 639/1247] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:45 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:45.588013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-571dea9a-b63b-4a5e-b7cf-4a6ae79f76bb tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Action: 'action', calling method: .version_select at 0x7fdf0ea4a3a0>, body: {"addFloatingIp": {"address": "172.25.7.246"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:45.589446 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-571dea9a-b63b-4a5e-b7cf-4a6ae79f76bb tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:45.607910 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-571dea9a-b63b-4a5e-b7cf-4a6ae79f76bb tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:45.608644 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-571dea9a-b63b-4a5e-b7cf-4a6ae79f76bb tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:45.610131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-571dea9a-b63b-4a5e-b7cf-4a6ae79f76bb tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:45.610976 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-571dea9a-b63b-4a5e-b7cf-4a6ae79f76bb tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:45.740864 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-571dea9a-b63b-4a5e-b7cf-4a6ae79f76bb tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Acquired lock "refresh_cache-2dce7bf2-76fb-41fc-b977-92c5ee0c31de" {{(pid=125862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 14:43:46.446607 n-d-836830-4 devstack@n-api.service[125862]: DEBUG neutronclient.v2_0.client [None req-571dea9a-b63b-4a5e-b7cf-4a6ae79f76bb tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.7.246 (ca20ac43-bc49-4fb0-9a05-fa130a53c81a) with port 59492a60-f926-414e-9a00-833130ddba76 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 32dbc124-f3c2-4202-ae2b-8955b562fec8.", "detail": ""}} {{(pid=125862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:43:46.447599 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-571dea9a-b63b-4a5e-b7cf-4a6ae79f76bb tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Releasing lock "refresh_cache-2dce7bf2-76fb-41fc-b977-92c5ee0c31de" {{(pid=125862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 14:43:46.447779 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-571dea9a-b63b-4a5e-b7cf-4a6ae79f76bb tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] HTTP exception thrown: Cannot associate floating IP 172.25.7.246 (ca20ac43-bc49-4fb0-9a05-fa130a53c81a) with port 59492a60-f926-414e-9a00-833130ddba76 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 32dbc124-f3c2-4202-ae2b-8955b562fec8. Jun 16 14:43:46.447779 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-faa6efd8-52b7-49d7-b750-94d741bb939a'] Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-571dea9a-b63b-4a5e-b7cf-4a6ae79f76bb tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Request method failure captured: Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action HTTP/1.1 Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 46 Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0FqxZwOqV9pFM5xjuOTxjAK7HFJ6UqhHqwGUPJVF2mDSymRNTEA-AIrTAT9gdfI_37HQt_ZOjNG2CIlkbX9XxOjBDr51nBFTNusWdRAdQjRW1Pt8oBTrbTUB8ElV9ZXscdfi-T3RkcagYLxulu9G2YsPERE-0MjpFtURyqqRplkBR0 Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 2e7a1522e65c4da888c7823ce928a7b7 Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-838742123 Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:43:46.450687 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:43:46.454217 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e7a1522e65c4da888c7823ce928a7b7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e7a1522e65c4da888c7823ce928a7b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e7a1522e65c4da888c7823ce928a7b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e7a1522e65c4da888c7823ce928a7b7"}]}] Jun 16 14:43:46.454217 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-838742123 Jun 16 14:43:46.454217 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 2e7a1522e65c4da888c7823ce928a7b7 Jun 16 14:43:46.454217 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-838742123 Jun 16 14:43:46.454217 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project Jun 16 14:43:46.454217 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:43:46.454217 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:43:46.454217 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 0081c3e617394557a0eab45883186c09 Jun 16 14:43:46.454217 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project Jun 16 14:43:46.454217 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:43:46.454217 n-d-836830-4 devstack@n-api.service[125862]: {"addFloatingIp": {"address": "172.25.7.246"}} Jun 16 14:43:46.454217 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: exception: Cannot associate floating IP 172.25.7.246 (ca20ac43-bc49-4fb0-9a05-fa130a53c81a) with port 59492a60-f926-414e-9a00-833130ddba76 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 32dbc124-f3c2-4202-ae2b-8955b562fec8. Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-faa6efd8-52b7-49d7-b750-94d741bb939a'] Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '2dce7bf2-76fb-41fc-b977-92c5ee0c31de', 'body': {'addFloatingIp': {'address': '172.25.7.246'}}} Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:46.456189 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:43:46.460738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.7.246 (ca20ac43-bc49-4fb0-9a05-fa130a53c81a) with port 59492a60-f926-414e-9a00-833130ddba76 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 32dbc124-f3c2-4202-ae2b-8955b562fec8. Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-faa6efd8-52b7-49d7-b750-94d741bb939a'] Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.7.246 (ca20ac43-bc49-4fb0-9a05-fa130a53c81a) with port 59492a60-f926-414e-9a00-833130ddba76 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 32dbc124-f3c2-4202-ae2b-8955b562fec8. Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-faa6efd8-52b7-49d7-b750-94d741bb939a'] Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:46.466177 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.7.246 (ca20ac43-bc49-4fb0-9a05-fa130a53c81a) with port 59492a60-f926-414e-9a00-833130ddba76 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 32dbc124-f3c2-4202-ae2b-8955b562fec8. Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-faa6efd8-52b7-49d7-b750-94d741bb939a'] Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:46.470108 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:43:46.474654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:46.474654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:46.474654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:43:46.474654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:43:46.474654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:43:46.474654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:43:46.474654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.7.246 (ca20ac43-bc49-4fb0-9a05-fa130a53c81a) with port 59492a60-f926-414e-9a00-833130ddba76 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 32dbc124-f3c2-4202-ae2b-8955b562fec8. Jun 16 14:43:46.474654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-faa6efd8-52b7-49d7-b750-94d741bb939a'] Jun 16 14:43:46.474654 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:46.474654 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-571dea9a-b63b-4a5e-b7cf-4a6ae79f76bb tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Returning 400 to user: Cannot associate floating IP 172.25.7.246 (ca20ac43-bc49-4fb0-9a05-fa130a53c81a) with port 59492a60-f926-414e-9a00-833130ddba76 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 32dbc124-f3c2-4202-ae2b-8955b562fec8. Jun 16 14:43:46.474654 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-faa6efd8-52b7-49d7-b750-94d741bb939a'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:43:46.478215 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-571dea9a-b63b-4a5e-b7cf-4a6ae79f76bb tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action" status: 400 len: 381 microversion: 2.1 time: 0.869526 Jun 16 14:43:46.478215 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 640/1248] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:43:45 2022] POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action => generated 381 bytes in 871 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:43:46.478215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6708c9ad-448c-462d-a193-bb3fe02ff393 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:46.478215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6708c9ad-448c-462d-a193-bb3fe02ff393 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:46.478215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6708c9ad-448c-462d-a193-bb3fe02ff393 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:46.479524 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6708c9ad-448c-462d-a193-bb3fe02ff393 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:46.479524 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6708c9ad-448c-462d-a193-bb3fe02ff393 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:46.479524 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6708c9ad-448c-462d-a193-bb3fe02ff393 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:46.659180 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6708c9ad-448c-462d-a193-bb3fe02ff393 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:46.670151 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6708c9ad-448c-462d-a193-bb3fe02ff393 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1528 microversion: 2.1 time: 0.212933 Jun 16 14:43:46.678589 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 641/1249] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:46 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1528 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:46.690054 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e0b74f0d-dadf-4fc1-bd1d-2d15bc23e3ef tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1603273681"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:46.691792 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e0b74f0d-dadf-4fc1-bd1d-2d15bc23e3ef tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:46.707755 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0b74f0d-dadf-4fc1-bd1d-2d15bc23e3ef tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:46.709022 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0b74f0d-dadf-4fc1-bd1d-2d15bc23e3ef tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:46.711570 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0b74f0d-dadf-4fc1-bd1d-2d15bc23e3ef tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:46.712744 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0b74f0d-dadf-4fc1-bd1d-2d15bc23e3ef tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:47.052028 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.network.security_group_api [None req-e0b74f0d-dadf-4fc1-bd1d-2d15bc23e3ef tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Adding security group 67950362-e320-4f68-b90b-8070abbcb35b to port 91b49d73-f169-45f2-8cf3-953aebec904e Jun 16 14:43:47.649676 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e0b74f0d-dadf-4fc1-bd1d-2d15bc23e3ef tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9/action" status: 202 len: 0 microversion: 2.1 time: 0.968727 Jun 16 14:43:47.655784 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 642/1250] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:43:46 2022] POST /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9/action => generated 0 bytes in 976 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:43:47.663047 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-27f339f6-b684-464c-b813-84f21f452626 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:47.664005 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-27f339f6-b684-464c-b813-84f21f452626 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:47.671744 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-27f339f6-b684-464c-b813-84f21f452626 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:47.672208 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-27f339f6-b684-464c-b813-84f21f452626 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:47.673019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-27f339f6-b684-464c-b813-84f21f452626 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:47.673463 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-27f339f6-b684-464c-b813-84f21f452626 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:47.941071 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-27f339f6-b684-464c-b813-84f21f452626 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:47.960015 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-27f339f6-b684-464c-b813-84f21f452626 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1514 microversion: 2.1 time: 0.302383 Jun 16 14:43:47.960942 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 643/1251] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:47 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1514 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:47.966551 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2fc7b65f-69a4-4327-b163-5422391db521 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:47.967381 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2fc7b65f-69a4-4327-b163-5422391db521 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 044b8b3a-db26-450b-b770-6134060ded1c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:47.977142 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2fc7b65f-69a4-4327-b163-5422391db521 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:47.978122 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2fc7b65f-69a4-4327-b163-5422391db521 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:47.979632 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2fc7b65f-69a4-4327-b163-5422391db521 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:47.980687 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2fc7b65f-69a4-4327-b163-5422391db521 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:48.186824 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2fc7b65f-69a4-4327-b163-5422391db521 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:48.207720 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2fc7b65f-69a4-4327-b163-5422391db521 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c" status: 200 len: 1307 microversion: 2.1 time: 0.244998 Jun 16 14:43:48.223580 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 644/1252] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:47 2022] GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c => generated 1307 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:48.232190 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-af49a7d4-3223-4ac6-be3c-7f0d92c91fb7 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '.version_select at 0x7fdeffe62430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:49.779693 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-af49a7d4-3223-4ac6-be3c-7f0d92c91fb7 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/ca20ac43-bc49-4fb0-9a05-fa130a53c81a" status: 202 len: 0 microversion: 2.1 time: 1.554051 Jun 16 14:43:49.791231 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 645/1253] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jun 16 14:43:48 2022] DELETE /compute/v2.1/os-floating-ips/ca20ac43-bc49-4fb0-9a05-fa130a53c81a => generated 0 bytes in 1566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:43:49.803003 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fe2bd78b-6f17-45a9-892f-65a40681cf24 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:49.804635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fe2bd78b-6f17-45a9-892f-65a40681cf24 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:49.817967 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fe2bd78b-6f17-45a9-892f-65a40681cf24 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:49.819658 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fe2bd78b-6f17-45a9-892f-65a40681cf24 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:49.821468 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fe2bd78b-6f17-45a9-892f-65a40681cf24 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:49.822833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fe2bd78b-6f17-45a9-892f-65a40681cf24 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:50.013634 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fa8cb5f4-266c-4006-832e-0621a10eefb4 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/action" status: 202 len: 0 microversion: 2.25 time: 8.034120 Jun 16 14:43:50.015564 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 609/1254] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jun 16 14:43:41 2022] POST /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/action => generated 0 bytes in 8037 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:50.024200 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c935183c-c3c4-40fa-8591-0f65bd6c7435 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:50.027449 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:43:50.027449 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:43:50.084510 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c935183c-c3c4-40fa-8591-0f65bd6c7435 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/e9e21919-a01a-42b3-957e-76b9e7ce107e" status: 202 len: 0 microversion: 2.1 time: 0.067089 Jun 16 14:43:50.086341 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 610/1255] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:43:50 2022] DELETE /compute/v2.1/flavors/e9e21919-a01a-42b3-957e-76b9e7ce107e => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:43:50.117215 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-d1be562d-f8e7-4498-bc6d-1068f67b9516 req-a110e9db-f200-476c-933c-9b6fcea348fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "044b8b3a-db26-450b-b770-6134060ded1c", "tag": "ed657ed2-678a-4297-b198-f02f59e7a238"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:50.170118 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-d1be562d-f8e7-4498-bc6d-1068f67b9516 req-a110e9db-f200-476c-933c-9b6fcea348fc service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:50.171467 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-d1be562d-f8e7-4498-bc6d-1068f67b9516 req-a110e9db-f200-476c-933c-9b6fcea348fc service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:50.200198 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=62,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:50.205640 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-d1be562d-f8e7-4498-bc6d-1068f67b9516 req-a110e9db-f200-476c-933c-9b6fcea348fc service nova] Creating event network-changed:ed657ed2-678a-4297-b198-f02f59e7a238 for instance 044b8b3a-db26-450b-b770-6134060ded1c on n-h2-836830-4 Jun 16 14:43:50.219465 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-d1be562d-f8e7-4498-bc6d-1068f67b9516 req-a110e9db-f200-476c-933c-9b6fcea348fc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128676 Jun 16 14:43:50.222219 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 611/1256] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:50.262017 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fe2bd78b-6f17-45a9-892f-65a40681cf24 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:50.294603 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-a054252d-ce5a-4943-baaa-e5d7a0b3b053 req-1d6642fd-ab43-4dbd-abba-12e74e862a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f83874-bfcd-4b80-a6c5-949bd8f341b9", "tag": "91b49d73-f169-45f2-8cf3-953aebec904e"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:50.305180 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fe2bd78b-6f17-45a9-892f-65a40681cf24 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1476 microversion: 2.1 time: 0.511341 Jun 16 14:43:50.316595 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 646/1257] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:49 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1476 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:50.349422 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ac1e431e-c0c8-4fad-8f66-e57bbd1fb02a tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdeffe620d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:50.354981 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-a054252d-ce5a-4943-baaa-e5d7a0b3b053 req-1d6642fd-ab43-4dbd-abba-12e74e862a47 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:50.360324 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-a054252d-ce5a-4943-baaa-e5d7a0b3b053 req-1d6642fd-ab43-4dbd-abba-12e74e862a47 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:50.407998 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-a054252d-ce5a-4943-baaa-e5d7a0b3b053 req-1d6642fd-ab43-4dbd-abba-12e74e862a47 service nova] Creating event network-changed:91b49d73-f169-45f2-8cf3-953aebec904e for instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 on n-h1-836830-4 Jun 16 14:43:50.421193 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-a054252d-ce5a-4943-baaa-e5d7a0b3b053 req-1d6642fd-ab43-4dbd-abba-12e74e862a47 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175818 Jun 16 14:43:50.422704 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 612/1258] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:50.435585 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0eb55d98-f0f9-4310-8180-efe061b54600 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:50.437348 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0eb55d98-f0f9-4310-8180-efe061b54600 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:50.478544 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0eb55d98-f0f9-4310-8180-efe061b54600 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:50.479327 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0eb55d98-f0f9-4310-8180-efe061b54600 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:50.480375 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0eb55d98-f0f9-4310-8180-efe061b54600 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:50.480957 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0eb55d98-f0f9-4310-8180-efe061b54600 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:50.842247 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:50.892323 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=6 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:51.013296 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0eb55d98-f0f9-4310-8180-efe061b54600 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:51.029310 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0eb55d98-f0f9-4310-8180-efe061b54600 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 200 len: 1514 microversion: 2.1 time: 0.604438 Jun 16 14:43:51.046854 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 613/1259] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:50 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 1514 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:51.052368 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-7be5c96e-e01a-466d-953a-7f0206833e0f req-94bbc50e-cc23-4696-b3f2-8ac2f834ca5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04e1cd2-656b-4de4-a784-ad2239f926bb", "name": "network-vif-unplugged", "status": "completed", "tag": "b1a39f33-a168-43db-ac7a-31811d74465c"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:51.089937 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-7be5c96e-e01a-466d-953a-7f0206833e0f req-94bbc50e-cc23-4696-b3f2-8ac2f834ca5b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:51.095122 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-7be5c96e-e01a-466d-953a-7f0206833e0f req-94bbc50e-cc23-4696-b3f2-8ac2f834ca5b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:51.136022 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-7be5c96e-e01a-466d-953a-7f0206833e0f req-94bbc50e-cc23-4696-b3f2-8ac2f834ca5b service nova] Creating event network-vif-unplugged:b1a39f33-a168-43db-ac7a-31811d74465c for instance f04e1cd2-656b-4de4-a784-ad2239f926bb on n-h1-836830-4 Jun 16 14:43:51.152359 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-7be5c96e-e01a-466d-953a-7f0206833e0f req-94bbc50e-cc23-4696-b3f2-8ac2f834ca5b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103685 Jun 16 14:43:51.158677 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 614/1260] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:51.182973 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c42c5fec-3d99-4cb5-93b6-7528d4b1235b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:51.184211 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c42c5fec-3d99-4cb5-93b6-7528d4b1235b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 044b8b3a-db26-450b-b770-6134060ded1c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:51.223406 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c42c5fec-3d99-4cb5-93b6-7528d4b1235b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:51.224060 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c42c5fec-3d99-4cb5-93b6-7528d4b1235b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:51.225893 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c42c5fec-3d99-4cb5-93b6-7528d4b1235b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:51.233814 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c42c5fec-3d99-4cb5-93b6-7528d4b1235b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:51.379170 n-d-836830-4 devstack@n-api.service[125862]: DEBUG neutronclient.v2_0.client [None req-ac1e431e-c0c8-4fad-8f66-e57bbd1fb02a tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 67950362-e320-4f68-b90b-8070abbcb35b in use.", "detail": ""}} {{(pid=125862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:43:51.380315 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-ac1e431e-c0c8-4fad-8f66-e57bbd1fb02a tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Security Group 67950362-e320-4f68-b90b-8070abbcb35b in use. Jun 16 14:43:51.380315 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-d967caba-1a58-428d-be64-641c188cc4e8'] Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ac1e431e-c0c8-4fad-8f66-e57bbd1fb02a tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/os-security-groups/67950362-e320-4f68-b90b-8070abbcb35b HTTP/1.1 Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:43:51.384835 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:43:51.387977 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:43:51.387977 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:43:51.387977 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:43:51.387977 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:43:51.387977 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:43:51.387977 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:43:51.387977 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:43:51.387977 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:43:51.387977 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:43:51.387977 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:43:51.387977 n-d-836830-4 devstack@n-api.service[125862]: exception: Security Group 67950362-e320-4f68-b90b-8070abbcb35b in use. Jun 16 14:43:51.387977 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-d967caba-1a58-428d-be64-641c188cc4e8'] Jun 16 14:43:51.387977 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '67950362-e320-4f68-b90b-8070abbcb35b'} Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:51.389777 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 67950362-e320-4f68-b90b-8070abbcb35b in use. Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d967caba-1a58-428d-be64-641c188cc4e8'] Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 67950362-e320-4f68-b90b-8070abbcb35b in use. Jun 16 14:43:51.392339 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d967caba-1a58-428d-be64-641c188cc4e8'] Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 67950362-e320-4f68-b90b-8070abbcb35b in use. Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d967caba-1a58-428d-be64-641c188cc4e8'] Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:51.398268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:43:51.401482 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:43:51.401482 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:43:51.401482 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:43:51.401482 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 67950362-e320-4f68-b90b-8070abbcb35b in use. Jun 16 14:43:51.401482 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d967caba-1a58-428d-be64-641c188cc4e8'] Jun 16 14:43:51.401482 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:43:51.402991 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ac1e431e-c0c8-4fad-8f66-e57bbd1fb02a tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 400 to user: Security Group 67950362-e320-4f68-b90b-8070abbcb35b in use. Jun 16 14:43:51.402991 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-d967caba-1a58-428d-be64-641c188cc4e8'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:43:51.405053 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ac1e431e-c0c8-4fad-8f66-e57bbd1fb02a tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/67950362-e320-4f68-b90b-8070abbcb35b" status: 400 len: 185 microversion: 2.1 time: 1.085873 Jun 16 14:43:51.406045 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 647/1261] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:43:50 2022] DELETE /compute/v2.1/os-security-groups/67950362-e320-4f68-b90b-8070abbcb35b => generated 185 bytes in 1089 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:43:51.416171 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9d458fb6-cafb-4a42-87c9-1df203ff1eb9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Action: 'action', calling method: .version_select at 0x7fdf0ea4a430>, body: {"removeFloatingIp": {"address": "172.25.7.229"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:51.632698 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c42c5fec-3d99-4cb5-93b6-7528d4b1235b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:51.654819 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c42c5fec-3d99-4cb5-93b6-7528d4b1235b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c" status: 200 len: 1307 microversion: 2.1 time: 0.493891 Jun 16 14:43:51.666262 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 615/1262] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:51 2022] GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c => generated 1307 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:51.671262 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-92e13ed4-4a29-42f4-8afd-e965011a4409 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:51.671262 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-92e13ed4-4a29-42f4-8afd-e965011a4409 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:51.706681 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-92e13ed4-4a29-42f4-8afd-e965011a4409 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:51.708443 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-92e13ed4-4a29-42f4-8afd-e965011a4409 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:51.713293 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-92e13ed4-4a29-42f4-8afd-e965011a4409 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:51.714171 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-92e13ed4-4a29-42f4-8afd-e965011a4409 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:52.073912 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-92e13ed4-4a29-42f4-8afd-e965011a4409 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:52.096586 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-92e13ed4-4a29-42f4-8afd-e965011a4409 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:52.102427 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-92e13ed4-4a29-42f4-8afd-e965011a4409 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:52.107431 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-92e13ed4-4a29-42f4-8afd-e965011a4409 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.447843 Jun 16 14:43:52.109952 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 616/1263] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:43:51 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:43:52.123246 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7b51319e-ea52-4ec5-9401-6d3460ee2c4a tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:52.154815 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7b51319e-ea52-4ec5-9401-6d3460ee2c4a tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042817 Jun 16 14:43:52.156371 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 617/1264] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:43:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:52.162289 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5dbaeef6-2438-4149-b999-b94e89f0af7c tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:52.164147 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5dbaeef6-2438-4149-b999-b94e89f0af7c tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:52.188538 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5dbaeef6-2438-4149-b999-b94e89f0af7c tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:52.189002 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5dbaeef6-2438-4149-b999-b94e89f0af7c tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:52.189820 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5dbaeef6-2438-4149-b999-b94e89f0af7c tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:52.190515 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5dbaeef6-2438-4149-b999-b94e89f0af7c tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:52.294531 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9d458fb6-cafb-4a42-87c9-1df203ff1eb9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:52.325123 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d458fb6-cafb-4a42-87c9-1df203ff1eb9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:52.326048 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d458fb6-cafb-4a42-87c9-1df203ff1eb9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:52.341185 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d458fb6-cafb-4a42-87c9-1df203ff1eb9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:52.342295 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d458fb6-cafb-4a42-87c9-1df203ff1eb9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:52.423541 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5dbaeef6-2438-4149-b999-b94e89f0af7c tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:52.449227 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5dbaeef6-2438-4149-b999-b94e89f0af7c tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1476 microversion: 2.1 time: 0.291466 Jun 16 14:43:52.451359 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 618/1265] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:52 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1476 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:52.463843 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ec1ef28d-05d4-4d0c-98b0-d860d22440d9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:52.464420 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ec1ef28d-05d4-4d0c-98b0-d860d22440d9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:52.472960 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ec1ef28d-05d4-4d0c-98b0-d860d22440d9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:52.473452 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ec1ef28d-05d4-4d0c-98b0-d860d22440d9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:52.474435 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ec1ef28d-05d4-4d0c-98b0-d860d22440d9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:52.475097 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ec1ef28d-05d4-4d0c-98b0-d860d22440d9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:52.520423 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ec1ef28d-05d4-4d0c-98b0-d860d22440d9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:43:52.708029 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ec1ef28d-05d4-4d0c-98b0-d860d22440d9 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 204 len: 0 microversion: 2.1 time: 0.254847 Jun 16 14:43:52.710596 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 619/1266] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:43:52 2022] DELETE /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:52.724912 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3c685b2b-528e-4747-953b-5c047033f4f0 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:52.726224 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3c685b2b-528e-4747-953b-5c047033f4f0 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: 0d332fa7-1e7c-4195-9270-4a0183b48bfd] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:52.737183 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3c685b2b-528e-4747-953b-5c047033f4f0 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:52.737849 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3c685b2b-528e-4747-953b-5c047033f4f0 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:52.739693 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3c685b2b-528e-4747-953b-5c047033f4f0 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:52.740316 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3c685b2b-528e-4747-953b-5c047033f4f0 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:52.768357 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-3c685b2b-528e-4747-953b-5c047033f4f0 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] HTTP exception thrown: Instance 0d332fa7-1e7c-4195-9270-4a0183b48bfd could not be found. Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3c685b2b-528e-4747-953b-5c047033f4f0 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Request method failure captured: Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd HTTP/1.1 Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0C-MxugC5mLskBuQHWRxFCv-6lkiTYWT99BiCixj9U4TfzoZPLRUE9TOmR0XwSd0K0g9A72e8HClzvxLGlCNthuTmTNH7j2UDHYVnmiBjg530wjneK6KEwYJVVEjby3zenWl60edpp736WYU6464genNWmzhBnk6lUPcmpkREqPi_M Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 1cb259849be2454ba564207db28025d4 Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-VolumesAdminNegativeTest-1430161518 Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:43:52.771531 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:43:52.773481 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1cb259849be2454ba564207db28025d4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1cb259849be2454ba564207db28025d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1cb259849be2454ba564207db28025d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1cb259849be2454ba564207db28025d4"}]}] Jun 16 14:43:52.773481 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-VolumesAdminNegativeTest-1430161518 Jun 16 14:43:52.773481 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 1cb259849be2454ba564207db28025d4 Jun 16 14:43:52.773481 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1430161518 Jun 16 14:43:52.773481 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-VolumesAdminNegativeTest-1430161518-project Jun 16 14:43:52.773481 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:43:52.773481 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:43:52.773481 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 960ce02e58de4a02a547844c88034159 Jun 16 14:43:52.773481 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-VolumesAdminNegativeTest-1430161518-project Jun 16 14:43:52.773481 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:43:52.773481 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 0d332fa7-1e7c-4195-9270-4a0183b48bfd could not be found. Jun 16 14:43:52.773481 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '0d332fa7-1e7c-4195-9270-4a0183b48bfd'} Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d332fa7-1e7c-4195-9270-4a0183b48bfd could not be found. Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:43:52.774543 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d332fa7-1e7c-4195-9270-4a0183b48bfd could not be found. Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d332fa7-1e7c-4195-9270-4a0183b48bfd could not be found. Jun 16 14:43:52.777453 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:43:52.779097 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3c685b2b-528e-4747-953b-5c047033f4f0 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Returning 404 to user: Instance 0d332fa7-1e7c-4195-9270-4a0183b48bfd could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:43:52.779097 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3c685b2b-528e-4747-953b-5c047033f4f0 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd" status: 404 len: 111 microversion: 2.1 time: 0.062739 Jun 16 14:43:52.782833 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 620/1267] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:52 2022] GET /compute/v2.1/servers/0d332fa7-1e7c-4195-9270-4a0183b48bfd => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:43:52.790369 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-69ea2800-65c3-4358-a071-a3076df83440 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:52.791734 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-69ea2800-65c3-4358-a071-a3076df83440 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:52.800629 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-69ea2800-65c3-4358-a071-a3076df83440 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:52.801258 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-69ea2800-65c3-4358-a071-a3076df83440 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:52.802211 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-69ea2800-65c3-4358-a071-a3076df83440 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:52.803155 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-69ea2800-65c3-4358-a071-a3076df83440 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:52.929370 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-69ea2800-65c3-4358-a071-a3076df83440 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:52.938679 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-69ea2800-65c3-4358-a071-a3076df83440 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Old instance type tempest-test_resize_flavor_-488429914, new instance type m1.heat {{(pid=125863) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 14:43:52.953191 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-69ea2800-65c3-4358-a071-a3076df83440 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:43:52.953630 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-69ea2800-65c3-4358-a071-a3076df83440 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:43:52.955281 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-69ea2800-65c3-4358-a071-a3076df83440 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:43:52.956284 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-69ea2800-65c3-4358-a071-a3076df83440 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:43:52.957191 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-69ea2800-65c3-4358-a071-a3076df83440 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:43:53.206041 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-69ea2800-65c3-4358-a071-a3076df83440 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "POST /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a/action" status: 202 len: 0 microversion: 2.1 time: 0.421541 Jun 16 14:43:53.212901 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 621/1268] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:43:52 2022] POST /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:43:53.219596 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-c232d08f-1450-47c3-b2b2-2b95b6901475 req-70cd20a7-6bb3-4eb5-9c5c-d65431220d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d332fa7-1e7c-4195-9270-4a0183b48bfd", "name": "network-vif-deleted", "tag": "f1a65e7b-fc75-44fa-9938-510653a14181"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:53.236139 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-c232d08f-1450-47c3-b2b2-2b95b6901475 req-70cd20a7-6bb3-4eb5-9c5c-d65431220d0d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:53.246313 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-c232d08f-1450-47c3-b2b2-2b95b6901475 req-70cd20a7-6bb3-4eb5-9c5c-d65431220d0d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:53.266130 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-c232d08f-1450-47c3-b2b2-2b95b6901475 req-70cd20a7-6bb3-4eb5-9c5c-d65431220d0d service nova] Creating event network-vif-deleted:f1a65e7b-fc75-44fa-9938-510653a14181 for instance 0d332fa7-1e7c-4195-9270-4a0183b48bfd on n-h1-836830-4 Jun 16 14:43:53.272680 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-c232d08f-1450-47c3-b2b2-2b95b6901475 req-70cd20a7-6bb3-4eb5-9c5c-d65431220d0d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057203 Jun 16 14:43:53.280287 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 622/1269] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:53.290765 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3a16d32d-d1dc-4975-b38f-26ae88aee3c0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:53.294935 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3a16d32d-d1dc-4975-b38f-26ae88aee3c0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 044b8b3a-db26-450b-b770-6134060ded1c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:53.309774 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3a16d32d-d1dc-4975-b38f-26ae88aee3c0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:53.313470 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3a16d32d-d1dc-4975-b38f-26ae88aee3c0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:53.325381 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3a16d32d-d1dc-4975-b38f-26ae88aee3c0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:53.325807 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3a16d32d-d1dc-4975-b38f-26ae88aee3c0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:53.507805 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d458fb6-cafb-4a42-87c9-1df203ff1eb9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Acquired lock "refresh_cache-2dce7bf2-76fb-41fc-b977-92c5ee0c31de" {{(pid=125862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 14:43:53.659667 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3a16d32d-d1dc-4975-b38f-26ae88aee3c0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:53.695249 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3a16d32d-d1dc-4975-b38f-26ae88aee3c0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c" status: 200 len: 1307 microversion: 2.1 time: 0.410830 Jun 16 14:43:53.696267 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 623/1270] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:53 2022] GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c => generated 1307 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:53.725925 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c974c07e-e9c3-4069-93ad-85cd3032eea8 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:53.726934 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c974c07e-e9c3-4069-93ad-85cd3032eea8 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:53.742083 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c974c07e-e9c3-4069-93ad-85cd3032eea8 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:53.742727 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c974c07e-e9c3-4069-93ad-85cd3032eea8 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:53.745538 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c974c07e-e9c3-4069-93ad-85cd3032eea8 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:53.745538 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c974c07e-e9c3-4069-93ad-85cd3032eea8 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:54.122372 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c974c07e-e9c3-4069-93ad-85cd3032eea8 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:54.135893 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c974c07e-e9c3-4069-93ad-85cd3032eea8 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1647 microversion: 2.1 time: 0.424525 Jun 16 14:43:54.137266 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 624/1271] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:53 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1647 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:54.154007 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1152a516-9e37-43b6-92f4-9e1b5bd5548b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:54.154672 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1152a516-9e37-43b6-92f4-9e1b5bd5548b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:54.164604 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1152a516-9e37-43b6-92f4-9e1b5bd5548b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:54.164604 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1152a516-9e37-43b6-92f4-9e1b5bd5548b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:54.165218 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1152a516-9e37-43b6-92f4-9e1b5bd5548b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:54.165673 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1152a516-9e37-43b6-92f4-9e1b5bd5548b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:54.377892 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1152a516-9e37-43b6-92f4-9e1b5bd5548b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:54.396092 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1152a516-9e37-43b6-92f4-9e1b5bd5548b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:54.400164 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1152a516-9e37-43b6-92f4-9e1b5bd5548b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:54.402642 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1152a516-9e37-43b6-92f4-9e1b5bd5548b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.257574 Jun 16 14:43:54.430421 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 625/1272] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:43:54 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:43:54.448317 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-622488a1-b5f1-4d56-8065-c97f21280f45 req-94a7cd22-114d-4f89-8ee4-237793c3600e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04e1cd2-656b-4de4-a784-ad2239f926bb", "name": "network-vif-plugged", "status": "completed", "tag": "b1a39f33-a168-43db-ac7a-31811d74465c"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:54.470628 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-622488a1-b5f1-4d56-8065-c97f21280f45 req-94a7cd22-114d-4f89-8ee4-237793c3600e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:54.487678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-622488a1-b5f1-4d56-8065-c97f21280f45 req-94a7cd22-114d-4f89-8ee4-237793c3600e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:54.523442 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-622488a1-b5f1-4d56-8065-c97f21280f45 req-94a7cd22-114d-4f89-8ee4-237793c3600e service nova] Creating event network-vif-plugged:b1a39f33-a168-43db-ac7a-31811d74465c for instance f04e1cd2-656b-4de4-a784-ad2239f926bb on n-h1-836830-4 Jun 16 14:43:54.534392 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-622488a1-b5f1-4d56-8065-c97f21280f45 req-94a7cd22-114d-4f89-8ee4-237793c3600e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100942 Jun 16 14:43:54.535788 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 626/1273] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:54.547071 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2f0dd068-8ef6-4629-b322-ebe33f690998 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:54.548455 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2f0dd068-8ef6-4629-b322-ebe33f690998 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:54.561221 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2f0dd068-8ef6-4629-b322-ebe33f690998 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:54.562164 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2f0dd068-8ef6-4629-b322-ebe33f690998 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:54.564833 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2f0dd068-8ef6-4629-b322-ebe33f690998 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:54.565858 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2f0dd068-8ef6-4629-b322-ebe33f690998 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:55.656815 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-9d458fb6-cafb-4a42-87c9-1df203ff1eb9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Building network info cache for instance {{(pid=125862) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 16 14:43:55.804470 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2f0dd068-8ef6-4629-b322-ebe33f690998 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:55.848546 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2f0dd068-8ef6-4629-b322-ebe33f690998 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1537 microversion: 2.1 time: 1.310297 Jun 16 14:43:55.851951 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 627/1274] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:54 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1537 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:55.863851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-acbc69ac-1a45-4223-be48-71fa4f44002a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:55.867262 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-acbc69ac-1a45-4223-be48-71fa4f44002a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:55.880678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-acbc69ac-1a45-4223-be48-71fa4f44002a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:55.882212 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-acbc69ac-1a45-4223-be48-71fa4f44002a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:55.884078 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-acbc69ac-1a45-4223-be48-71fa4f44002a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:55.885594 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-acbc69ac-1a45-4223-be48-71fa4f44002a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:56.400074 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-acbc69ac-1a45-4223-be48-71fa4f44002a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:56.422941 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-acbc69ac-1a45-4223-be48-71fa4f44002a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1476 microversion: 2.1 time: 0.566750 Jun 16 14:43:56.430238 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 628/1275] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:55 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1476 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:56.453652 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e4b37d93-8355-4b94-8b15-381fcde45afd tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:56.454886 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e4b37d93-8355-4b94-8b15-381fcde45afd tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 044b8b3a-db26-450b-b770-6134060ded1c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:56.476622 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4b37d93-8355-4b94-8b15-381fcde45afd tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:56.477429 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4b37d93-8355-4b94-8b15-381fcde45afd tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:56.478930 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4b37d93-8355-4b94-8b15-381fcde45afd tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:56.479751 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4b37d93-8355-4b94-8b15-381fcde45afd tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:57.157273 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e4b37d93-8355-4b94-8b15-381fcde45afd tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:57.162988 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:57.204597 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e4b37d93-8355-4b94-8b15-381fcde45afd tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c" status: 200 len: 1307 microversion: 2.1 time: 0.772078 Jun 16 14:43:57.219279 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 629/1276] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:56 2022] GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c => generated 1307 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:57.235644 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-15a22fa0-5138-445d-ba92-14011b9c41df tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:57.239660 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-15a22fa0-5138-445d-ba92-14011b9c41df tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:57.261421 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15a22fa0-5138-445d-ba92-14011b9c41df tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:57.264928 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15a22fa0-5138-445d-ba92-14011b9c41df tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:57.266262 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15a22fa0-5138-445d-ba92-14011b9c41df tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:57.269436 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15a22fa0-5138-445d-ba92-14011b9c41df tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:57.398809 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-9d458fb6-cafb-4a42-87c9-1df203ff1eb9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Updating instance_info_cache with network_info: [{"id": "59492a60-f926-414e-9a00-833130ddba76", "address": "fa:16:3e:3f:7a:91", "network": {"id": "18b171e3-0f91-4866-a080-5bc9876d1718", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1319682769-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2e7a1522e65c4da888c7823ce928a7b7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap59492a60-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125862) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 16 14:43:57.423152 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-15a22fa0-5138-445d-ba92-14011b9c41df tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:57.441275 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-15a22fa0-5138-445d-ba92-14011b9c41df tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 200 len: 1301 microversion: 2.1 time: 0.220526 Jun 16 14:43:57.444199 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 630/1277] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:57 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 1301 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:57.447122 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d458fb6-cafb-4a42-87c9-1df203ff1eb9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Releasing lock "refresh_cache-2dce7bf2-76fb-41fc-b977-92c5ee0c31de" {{(pid=125862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 14:43:57.448480 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9d458fb6-cafb-4a42-87c9-1df203ff1eb9 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action" status: 202 len: 0 microversion: 2.1 time: 6.040727 Jun 16 14:43:57.449324 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 648/1278] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:43:51 2022] POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action => generated 0 bytes in 6042 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 16 14:43:57.462788 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-57ef1657-bcb9-4e6e-b6a3-19cd88488a61 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:57.464592 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-57ef1657-bcb9-4e6e-b6a3-19cd88488a61 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:57.465901 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-560252968", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f57fcde4-c3c0-449f-9871-02a5578b92d2"}], "block_device_mapping_v2": [{"uuid": "2d32267b-696f-4ffe-a45e-22c41b40ba41", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:57.483655 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-57ef1657-bcb9-4e6e-b6a3-19cd88488a61 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:57.487157 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-57ef1657-bcb9-4e6e-b6a3-19cd88488a61 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:57.488832 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-57ef1657-bcb9-4e6e-b6a3-19cd88488a61 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:57.490729 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-57ef1657-bcb9-4e6e-b6a3-19cd88488a61 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:57.692370 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] validate_networks() for [('f57fcde4-c3c0-449f-9871-02a5578b92d2', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:43:57.750695 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-57ef1657-bcb9-4e6e-b6a3-19cd88488a61 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:57.768859 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-57ef1657-bcb9-4e6e-b6a3-19cd88488a61 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:57.771898 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-57ef1657-bcb9-4e6e-b6a3-19cd88488a61 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:57.774316 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-57ef1657-bcb9-4e6e-b6a3-19cd88488a61 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.323606 Jun 16 14:43:57.775244 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 649/1279] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:43:57 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:43:57.793877 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-a735c21e-611f-482e-ad46-6e9a04aa6df8 req-97dad705-c73e-4549-b18b-98495d353adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dce7bf2-76fb-41fc-b977-92c5ee0c31de", "tag": "59492a60-f926-414e-9a00-833130ddba76"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:57.807292 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-a735c21e-611f-482e-ad46-6e9a04aa6df8 req-97dad705-c73e-4549-b18b-98495d353adb service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:57.810831 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-a735c21e-611f-482e-ad46-6e9a04aa6df8 req-97dad705-c73e-4549-b18b-98495d353adb service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:57.848829 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-a735c21e-611f-482e-ad46-6e9a04aa6df8 req-97dad705-c73e-4549-b18b-98495d353adb service nova] Creating event network-changed:59492a60-f926-414e-9a00-833130ddba76 for instance 2dce7bf2-76fb-41fc-b977-92c5ee0c31de on n-h1-836830-4 Jun 16 14:43:57.871181 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-a735c21e-611f-482e-ad46-6e9a04aa6df8 req-97dad705-c73e-4549-b18b-98495d353adb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080875 Jun 16 14:43:57.875259 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 650/1280] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:57.886084 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-9ebc48e8-026f-488d-b295-a8c1ecf6a9fe req-a0448df7-db36-4d40-86a8-031db897e191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "044b8b3a-db26-450b-b770-6134060ded1c", "name": "network-vif-plugged", "status": "completed", "tag": "ed657ed2-678a-4297-b198-f02f59e7a238"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:57.905686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-9ebc48e8-026f-488d-b295-a8c1ecf6a9fe req-a0448df7-db36-4d40-86a8-031db897e191 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:57.906133 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-9ebc48e8-026f-488d-b295-a8c1ecf6a9fe req-a0448df7-db36-4d40-86a8-031db897e191 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:57.937968 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-9ebc48e8-026f-488d-b295-a8c1ecf6a9fe req-a0448df7-db36-4d40-86a8-031db897e191 service nova] Creating event network-vif-plugged:ed657ed2-678a-4297-b198-f02f59e7a238 for instance 044b8b3a-db26-450b-b770-6134060ded1c on n-h2-836830-4 Jun 16 14:43:57.945150 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-9ebc48e8-026f-488d-b295-a8c1ecf6a9fe req-a0448df7-db36-4d40-86a8-031db897e191 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067815 Jun 16 14:43:57.946210 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 651/1281] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:57.952268 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f9a78a00-df27-4627-87fc-98e5db543256 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:57.953072 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f9a78a00-df27-4627-87fc-98e5db543256 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:57.962182 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f9a78a00-df27-4627-87fc-98e5db543256 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:57.963208 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f9a78a00-df27-4627-87fc-98e5db543256 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:57.963856 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f9a78a00-df27-4627-87fc-98e5db543256 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:57.964715 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f9a78a00-df27-4627-87fc-98e5db543256 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:58.393300 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f9a78a00-df27-4627-87fc-98e5db543256 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:58.399227 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:58.410706 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f9a78a00-df27-4627-87fc-98e5db543256 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1537 microversion: 2.1 time: 0.463011 Jun 16 14:43:58.421679 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 652/1282] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:57 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1537 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:58.421679 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-d5ffffd3-bda6-4c65-936d-370079c524cb req-9b73977d-4949-47c5-8be5-61a105a65534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f83874-bfcd-4b80-a6c5-949bd8f341b9", "name": "network-vif-deleted", "tag": "91b49d73-f169-45f2-8cf3-953aebec904e"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:43:58.429919 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-d5ffffd3-bda6-4c65-936d-370079c524cb req-9b73977d-4949-47c5-8be5-61a105a65534 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:58.430622 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-d5ffffd3-bda6-4c65-936d-370079c524cb req-9b73977d-4949-47c5-8be5-61a105a65534 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:58.446780 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-d5ffffd3-bda6-4c65-936d-370079c524cb req-9b73977d-4949-47c5-8be5-61a105a65534 service nova] Creating event network-vif-deleted:91b49d73-f169-45f2-8cf3-953aebec904e for instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 on n-h1-836830-4 Jun 16 14:43:58.452664 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-d5ffffd3-bda6-4c65-936d-370079c524cb req-9b73977d-4949-47c5-8be5-61a105a65534 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038964 Jun 16 14:43:58.453335 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 653/1283] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:43:58.461408 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e8ba7cd2-2e0a-417b-a511-9efb10e603da tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:43:58.462142 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e8ba7cd2-2e0a-417b-a511-9efb10e603da tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:43:58.469425 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e8ba7cd2-2e0a-417b-a511-9efb10e603da tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:58.469896 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e8ba7cd2-2e0a-417b-a511-9efb10e603da tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:58.471160 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e8ba7cd2-2e0a-417b-a511-9efb10e603da tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:43:58.471629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e8ba7cd2-2e0a-417b-a511-9efb10e603da tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:43:58.840590 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e8ba7cd2-2e0a-417b-a511-9efb10e603da tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:43:58.858754 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e8ba7cd2-2e0a-417b-a511-9efb10e603da tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1461 microversion: 2.1 time: 0.403275 Jun 16 14:43:58.870835 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 654/1284] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:43:58 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1461 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:58.888189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-07c87d08-56b7-4ce2-bd3c-7936f8791917 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '.version_select at 0x7fdeffdbe820>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:00.542075 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-07c87d08-56b7-4ce2-bd3c-7936f8791917 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/66db0383-a7fe-4ccc-9b1c-571b4dec306b" status: 202 len: 0 microversion: 2.1 time: 1.669311 Jun 16 14:44:00.543566 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 655/1285] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jun 16 14:43:58 2022] DELETE /compute/v2.1/os-floating-ips/66db0383-a7fe-4ccc-9b1c-571b4dec306b => generated 0 bytes in 1672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:44:00.548850 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-052daf9d-cdc3-476f-9da9-d425dc8611eb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:00.549731 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-052daf9d-cdc3-476f-9da9-d425dc8611eb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 044b8b3a-db26-450b-b770-6134060ded1c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:00.558188 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-052daf9d-cdc3-476f-9da9-d425dc8611eb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:00.559225 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-052daf9d-cdc3-476f-9da9-d425dc8611eb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:00.560757 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-052daf9d-cdc3-476f-9da9-d425dc8611eb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:00.561441 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-052daf9d-cdc3-476f-9da9-d425dc8611eb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:00.800209 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-052daf9d-cdc3-476f-9da9-d425dc8611eb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:00.810037 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-052daf9d-cdc3-476f-9da9-d425dc8611eb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c" status: 200 len: 1487 microversion: 2.1 time: 0.265402 Jun 16 14:44:00.821981 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 656/1286] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:00 2022] GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c => generated 1487 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:00.821981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cf98a41b-c350-4dc5-bae1-f26e44cdbfc3 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:00.821981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cf98a41b-c350-4dc5-bae1-f26e44cdbfc3 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:00.827127 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf98a41b-c350-4dc5-bae1-f26e44cdbfc3 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:00.827662 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf98a41b-c350-4dc5-bae1-f26e44cdbfc3 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:00.828486 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf98a41b-c350-4dc5-bae1-f26e44cdbfc3 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:00.828968 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf98a41b-c350-4dc5-bae1-f26e44cdbfc3 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:00.847746 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-cf98a41b-c350-4dc5-bae1-f26e44cdbfc3 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cf98a41b-c350-4dc5-bae1-f26e44cdbfc3 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 HTTP/1.1 Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:44:00.850307 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:44:00.851765 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:44:00.851765 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:00.851765 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:00.851765 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:00.851765 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:00.851765 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:44:00.851765 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:44:00.851765 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:44:00.851765 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:00.851765 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:44:00.851765 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. Jun 16 14:44:00.851765 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '58f83874-bfcd-4b80-a6c5-949bd8f341b9'} Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:00.852588 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. Jun 16 14:44:00.854536 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:00.857322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cf98a41b-c350-4dc5-bae1-f26e44cdbfc3 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 404 to user: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:00.857322 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cf98a41b-c350-4dc5-bae1-f26e44cdbfc3 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 404 len: 111 microversion: 2.1 time: 0.039164 Jun 16 14:44:00.857322 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 657/1287] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:00 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:44:00.861865 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2cee0c28-a476-4ac1-bde1-2aab7b0f9a9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:00.862686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2cee0c28-a476-4ac1-bde1-2aab7b0f9a9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:00.870121 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2cee0c28-a476-4ac1-bde1-2aab7b0f9a9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:00.870894 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2cee0c28-a476-4ac1-bde1-2aab7b0f9a9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:00.871822 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2cee0c28-a476-4ac1-bde1-2aab7b0f9a9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:00.872380 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2cee0c28-a476-4ac1-bde1-2aab7b0f9a9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:00.977797 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:44:00.979783 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:44:00.980966 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:44:00.982028 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:44:00.982946 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:44:01.014482 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:01.020585 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:01.022039 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:01.024303 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:01.102836 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Getting quotas for project b0484f4c1c304b84a88b7d2be3b9483c. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:44:01.119565 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Getting quotas for user 96fb5660c35642ad9da6d8bb34e393f4 and project b0484f4c1c304b84a88b7d2be3b9483c. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:44:01.147171 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2cee0c28-a476-4ac1-bde1-2aab7b0f9a9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:01.157532 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2cee0c28-a476-4ac1-bde1-2aab7b0f9a9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:01.159626 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2cee0c28-a476-4ac1-bde1-2aab7b0f9a9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:01.161149 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2cee0c28-a476-4ac1-bde1-2aab7b0f9a9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.306194 Jun 16 14:44:01.173745 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 658/1288] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:00 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:01.180091 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-af27a85b-8415-4789-abe3-ac71d0071edc tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:01.181446 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-af27a85b-8415-4789-abe3-ac71d0071edc tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:01.204513 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af27a85b-8415-4789-abe3-ac71d0071edc tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:01.213557 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af27a85b-8415-4789-abe3-ac71d0071edc tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:01.215045 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af27a85b-8415-4789-abe3-ac71d0071edc tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:01.215693 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af27a85b-8415-4789-abe3-ac71d0071edc tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:01.282466 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:44:01.289044 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d32267b-696f-4ffe-a45e-22c41b40ba41',volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:44:01.369336 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-af27a85b-8415-4789-abe3-ac71d0071edc tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb/action" status: 202 len: 0 microversion: 2.1 time: 0.193681 Jun 16 14:44:01.370551 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 659/1289] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:44:01 2022] POST /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:44:01.379801 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9482e6b0-94e8-48ef-8145-365195c6e003 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:01.381373 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9482e6b0-94e8-48ef-8145-365195c6e003 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:01.392808 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9482e6b0-94e8-48ef-8145-365195c6e003 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:01.393678 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9482e6b0-94e8-48ef-8145-365195c6e003 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:01.395244 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9482e6b0-94e8-48ef-8145-365195c6e003 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:01.396564 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9482e6b0-94e8-48ef-8145-365195c6e003 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:01.604174 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4f02cd78-6e6e-446a-85b8-e3c5a0e0ef3b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.151741 Jun 16 14:44:01.606362 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 631/1290] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:43:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:44:01.618416 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0609f5bd-186d-41d2-989e-7301b34d72a6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:01.619822 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0609f5bd-186d-41d2-989e-7301b34d72a6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:01.642159 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0609f5bd-186d-41d2-989e-7301b34d72a6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:01.642159 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0609f5bd-186d-41d2-989e-7301b34d72a6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:01.643639 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0609f5bd-186d-41d2-989e-7301b34d72a6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:01.644591 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0609f5bd-186d-41d2-989e-7301b34d72a6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:01.664942 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9482e6b0-94e8-48ef-8145-365195c6e003 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:01.675824 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9482e6b0-94e8-48ef-8145-365195c6e003 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1542 microversion: 2.1 time: 0.303473 Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 660/1291] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:01 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1542 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b22ebdbc-e3d2-4f2b-8a06-930cc726fa5b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b22ebdbc-e3d2-4f2b-8a06-930cc726fa5b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Request method failure captured: Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action HTTP/1.1 Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 34 Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0FqxZwOqV9pFM5xjuOTxjAK7HFJ6UqhHqwGUPJVF2mDSymRNTEA-AIrTAT9gdfI_37HQt_ZOjNG2CIlkbX9XxOjBDr51nBFTNusWdRAdQjRW1Pt8oBTrbTUB8ElV9ZXscdfi-T3RkcagYLxulu9G2YsPERE-0MjpFtURyqqRplkBR0 Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 2e7a1522e65c4da888c7823ce928a7b7 Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-838742123 Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:44:01.698914 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:44:01.700799 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e7a1522e65c4da888c7823ce928a7b7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e7a1522e65c4da888c7823ce928a7b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e7a1522e65c4da888c7823ce928a7b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e7a1522e65c4da888c7823ce928a7b7"}]}] Jun 16 14:44:01.700799 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-838742123 Jun 16 14:44:01.700799 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 2e7a1522e65c4da888c7823ce928a7b7 Jun 16 14:44:01.700799 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-838742123 Jun 16 14:44:01.700799 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project Jun 16 14:44:01.700799 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:44:01.700799 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:44:01.700799 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 0081c3e617394557a0eab45883186c09 Jun 16 14:44:01.700799 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project Jun 16 14:44:01.700799 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:44:01.700799 n-d-836830-4 devstack@n-api.service[125862]: {"addFloatingIp": {"address": ""}} Jun 16 14:44:01.700799 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:44:01.700799 n-d-836830-4 devstack@n-api.service[125862]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '2dce7bf2-76fb-41fc-b977-92c5ee0c31de', 'body': {'addFloatingIp': {'address': ''}}} Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi '' Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:01.701807 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:44:01.703528 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:44:01.705015 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 16 14:44:01.705015 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:01.705015 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b22ebdbc-e3d2-4f2b-8a06-930cc726fa5b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:01.705015 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b22ebdbc-e3d2-4f2b-8a06-930cc726fa5b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action" status: 400 len: 142 microversion: 2.1 time: 0.009874 Jun 16 14:44:01.705015 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 661/1292] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:44:01 2022] POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action => generated 142 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:44:01.705015 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e28227fd-4ad7-47b8-892a-4662ab187981 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:01.705478 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e28227fd-4ad7-47b8-892a-4662ab187981 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 044b8b3a-db26-450b-b770-6134060ded1c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:01.729303 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0609f5bd-186d-41d2-989e-7301b34d72a6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:44:01.897569 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:01.935484 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0609f5bd-186d-41d2-989e-7301b34d72a6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 204 len: 0 microversion: 2.1 time: 0.326087 Jun 16 14:44:01.941002 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 632/1293] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:44:01 2022] DELETE /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:01.954111 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7193bd89-1108-4830-aabb-a10af1eed0d0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdeffcc7940>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:01.976375 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e28227fd-4ad7-47b8-892a-4662ab187981 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:01.977169 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e28227fd-4ad7-47b8-892a-4662ab187981 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:01.979148 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e28227fd-4ad7-47b8-892a-4662ab187981 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:01.980047 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e28227fd-4ad7-47b8-892a-4662ab187981 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:02.076030 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e28227fd-4ad7-47b8-892a-4662ab187981 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "POST /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c/action" status: 202 len: 0 microversion: 2.1 time: 0.385671 Jun 16 14:44:02.077643 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 662/1294] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:44:01 2022] POST /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:44:02.084882 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-06cc7bb7-43cd-4a6f-ae6a-5824354e3f4f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:02.087903 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-06cc7bb7-43cd-4a6f-ae6a-5824354e3f4f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:02.095982 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06cc7bb7-43cd-4a6f-ae6a-5824354e3f4f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:02.097639 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06cc7bb7-43cd-4a6f-ae6a-5824354e3f4f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:02.099714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06cc7bb7-43cd-4a6f-ae6a-5824354e3f4f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:02.100743 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06cc7bb7-43cd-4a6f-ae6a-5824354e3f4f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:02.152958 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06cc7bb7-43cd-4a6f-ae6a-5824354e3f4f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:02.153834 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06cc7bb7-43cd-4a6f-ae6a-5824354e3f4f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:02.155344 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-06cc7bb7-43cd-4a6f-ae6a-5824354e3f4f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lazy-loading 'fault' on Instance uuid f04e1cd2-656b-4de4-a784-ad2239f926bb {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:44:02.284625 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7193bd89-1108-4830-aabb-a10af1eed0d0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/ae8e4cb7-22b4-4984-b62d-924c60b7fcd4" status: 202 len: 0 microversion: 2.1 time: 0.339784 Jun 16 14:44:02.285365 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 633/1295] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:44:01 2022] DELETE /compute/v2.1/os-security-groups/ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:44:02.292574 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-aa0b40c9-c068-4922-b051-164ff13804eb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:02.295157 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-aa0b40c9-c068-4922-b051-164ff13804eb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:02.334873 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-06cc7bb7-43cd-4a6f-ae6a-5824354e3f4f tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1595 microversion: 2.1 time: 0.253989 Jun 16 14:44:02.336531 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 663/1296] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:02 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1595 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:02.342395 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b313cb26-f2d3-4f37-ae68-0f3c88526e4e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:02.343543 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b313cb26-f2d3-4f37-ae68-0f3c88526e4e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:02.374604 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b313cb26-f2d3-4f37-ae68-0f3c88526e4e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:02.376426 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b313cb26-f2d3-4f37-ae68-0f3c88526e4e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:02.378414 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b313cb26-f2d3-4f37-ae68-0f3c88526e4e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:02.379183 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b313cb26-f2d3-4f37-ae68-0f3c88526e4e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:02.404626 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-aa0b40c9-c068-4922-b051-164ff13804eb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:02.416369 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-aa0b40c9-c068-4922-b051-164ff13804eb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1052 microversion: 2.1 time: 0.129765 Jun 16 14:44:02.416994 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 634/1297] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:02 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1052 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:02.427943 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2a155399-4fb2-4fc5-bb91-8c2551406985 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:02.427943 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2a155399-4fb2-4fc5-bb91-8c2551406985 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:02.432132 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b313cb26-f2d3-4f37-ae68-0f3c88526e4e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Acquired lock "refresh_cache-2dce7bf2-76fb-41fc-b977-92c5ee0c31de" {{(pid=125862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 14:44:02.435208 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a155399-4fb2-4fc5-bb91-8c2551406985 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:02.435701 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a155399-4fb2-4fc5-bb91-8c2551406985 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:02.437275 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a155399-4fb2-4fc5-bb91-8c2551406985 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:02.437773 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a155399-4fb2-4fc5-bb91-8c2551406985 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:02.556472 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b313cb26-f2d3-4f37-ae68-0f3c88526e4e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Releasing lock "refresh_cache-2dce7bf2-76fb-41fc-b977-92c5ee0c31de" {{(pid=125862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 14:44:02.557124 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-b313cb26-f2d3-4f37-ae68-0f3c88526e4e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] HTTP exception thrown: floating IP not found Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b313cb26-f2d3-4f37-ae68-0f3c88526e4e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Request method failure captured: Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action HTTP/1.1 Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 41 Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0FqxZwOqV9pFM5xjuOTxjAK7HFJ6UqhHqwGUPJVF2mDSymRNTEA-AIrTAT9gdfI_37HQt_ZOjNG2CIlkbX9XxOjBDr51nBFTNusWdRAdQjRW1Pt8oBTrbTUB8ElV9ZXscdfi-T3RkcagYLxulu9G2YsPERE-0MjpFtURyqqRplkBR0 Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 2e7a1522e65c4da888c7823ce928a7b7 Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-838742123 Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:44:02.559190 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:44:02.560664 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e7a1522e65c4da888c7823ce928a7b7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e7a1522e65c4da888c7823ce928a7b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e7a1522e65c4da888c7823ce928a7b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e7a1522e65c4da888c7823ce928a7b7"}]}] Jun 16 14:44:02.560664 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-838742123 Jun 16 14:44:02.560664 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 2e7a1522e65c4da888c7823ce928a7b7 Jun 16 14:44:02.560664 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-838742123 Jun 16 14:44:02.560664 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project Jun 16 14:44:02.560664 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:44:02.560664 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:44:02.560664 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 0081c3e617394557a0eab45883186c09 Jun 16 14:44:02.560664 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project Jun 16 14:44:02.560664 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:44:02.560664 n-d-836830-4 devstack@n-api.service[125862]: {"addFloatingIp": {"address": "0.0.0.0"}} Jun 16 14:44:02.560664 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:44:02.560664 n-d-836830-4 devstack@n-api.service[125862]: exception: floating IP not found Jun 16 14:44:02.560664 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '2dce7bf2-76fb-41fc-b977-92c5ee0c31de', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:02.561610 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jun 16 14:44:02.563335 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:02.564792 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b313cb26-f2d3-4f37-ae68-0f3c88526e4e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Returning 404 to user: floating IP not found {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:02.564792 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b313cb26-f2d3-4f37-ae68-0f3c88526e4e tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action" status: 404 len: 67 microversion: 2.1 time: 0.224142 Jun 16 14:44:02.564792 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 664/1298] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:44:02 2022] POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action => generated 67 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:44:02.570020 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c4d41e49-18cf-4e86-a5de-34b4c5cdfdc7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:02.570809 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c4d41e49-18cf-4e86-a5de-34b4c5cdfdc7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 044b8b3a-db26-450b-b770-6134060ded1c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:02.578686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c4d41e49-18cf-4e86-a5de-34b4c5cdfdc7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:02.579168 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c4d41e49-18cf-4e86-a5de-34b4c5cdfdc7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:02.580013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c4d41e49-18cf-4e86-a5de-34b4c5cdfdc7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:02.580476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c4d41e49-18cf-4e86-a5de-34b4c5cdfdc7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:02.609000 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2a155399-4fb2-4fc5-bb91-8c2551406985 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:02.623230 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2a155399-4fb2-4fc5-bb91-8c2551406985 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 200 len: 1679 microversion: 2.1 time: 0.204623 Jun 16 14:44:02.624317 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 635/1299] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:02 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 1679 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:02.634321 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a916c321-5d46-4279-a32b-d02ab2fdc57d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:02.635551 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a916c321-5d46-4279-a32b-d02ab2fdc57d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:02.647339 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a916c321-5d46-4279-a32b-d02ab2fdc57d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:02.648181 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a916c321-5d46-4279-a32b-d02ab2fdc57d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:02.649676 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a916c321-5d46-4279-a32b-d02ab2fdc57d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:02.650519 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a916c321-5d46-4279-a32b-d02ab2fdc57d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:02.803981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c4d41e49-18cf-4e86-a5de-34b4c5cdfdc7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:02.820234 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c4d41e49-18cf-4e86-a5de-34b4c5cdfdc7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c" status: 200 len: 1472 microversion: 2.1 time: 0.254360 Jun 16 14:44:02.821341 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 665/1300] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:02 2022] GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c => generated 1472 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:02.831513 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3b2afd3b-b1b7-45b0-9115-6ba63aa4b635 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdeffe14f70>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:02.863871 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a916c321-5d46-4279-a32b-d02ab2fdc57d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:02.878653 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a916c321-5d46-4279-a32b-d02ab2fdc57d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:02.882576 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a916c321-5d46-4279-a32b-d02ab2fdc57d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:02.884392 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a916c321-5d46-4279-a32b-d02ab2fdc57d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.258322 Jun 16 14:44:02.894497 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 636/1301] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:02 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:02.894497 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-26bb5c4d-bf37-4c9d-aa0c-7d6c7d117622 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:02.894497 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-26bb5c4d-bf37-4c9d-aa0c-7d6c7d117622 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:02.901434 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-26bb5c4d-bf37-4c9d-aa0c-7d6c7d117622 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:02.901987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-26bb5c4d-bf37-4c9d-aa0c-7d6c7d117622 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:02.902895 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-26bb5c4d-bf37-4c9d-aa0c-7d6c7d117622 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:02.903351 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-26bb5c4d-bf37-4c9d-aa0c-7d6c7d117622 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:03.016232 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-26bb5c4d-bf37-4c9d-aa0c-7d6c7d117622 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb/action" status: 202 len: 0 microversion: 2.1 time: 0.129500 Jun 16 14:44:03.017300 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 637/1302] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:44:02 2022] POST /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:44:03.023633 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6b20d3f3-33de-410f-8dc4-30ff6e449b9b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Action: 'action', calling method: .version_select at 0x7fdf0eb0fb80>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:03.105968 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-6b20d3f3-33de-410f-8dc4-30ff6e449b9b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6b20d3f3-33de-410f-8dc4-30ff6e449b9b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Request method failure captured: Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action HTTP/1.1 Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 44 Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0FqxZwOqV9pFM5xjuOTxjAK7HFJ6UqhHqwGUPJVF2mDSymRNTEA-AIrTAT9gdfI_37HQt_ZOjNG2CIlkbX9XxOjBDr51nBFTNusWdRAdQjRW1Pt8oBTrbTUB8ElV9ZXscdfi-T3RkcagYLxulu9G2YsPERE-0MjpFtURyqqRplkBR0 Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 2e7a1522e65c4da888c7823ce928a7b7 Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-838742123 Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:44:03.108048 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:44:03.111036 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e7a1522e65c4da888c7823ce928a7b7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e7a1522e65c4da888c7823ce928a7b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e7a1522e65c4da888c7823ce928a7b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e7a1522e65c4da888c7823ce928a7b7"}]}] Jun 16 14:44:03.111036 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-838742123 Jun 16 14:44:03.111036 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 2e7a1522e65c4da888c7823ce928a7b7 Jun 16 14:44:03.111036 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-838742123 Jun 16 14:44:03.111036 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project Jun 16 14:44:03.111036 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:44:03.111036 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:44:03.111036 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 0081c3e617394557a0eab45883186c09 Jun 16 14:44:03.111036 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project Jun 16 14:44:03.111036 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:44:03.111036 n-d-836830-4 devstack@n-api.service[125863]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jun 16 14:44:03.111036 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:44:03.111036 n-d-836830-4 devstack@n-api.service[125863]: exception: Floating IP not found for address 0.0.0.0. Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '2dce7bf2-76fb-41fc-b977-92c5ee0c31de', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:03.114245 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jun 16 14:44:03.118633 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:03.123535 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6b20d3f3-33de-410f-8dc4-30ff6e449b9b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:03.123535 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6b20d3f3-33de-410f-8dc4-30ff6e449b9b tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action" status: 404 len: 88 microversion: 2.1 time: 0.091937 Jun 16 14:44:03.123535 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 638/1303] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:44:03 2022] POST /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de/action => generated 88 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:44:03.127067 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-863a0f9e-cb80-426f-a97b-8a0ba42866c9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:03.129383 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-863a0f9e-cb80-426f-a97b-8a0ba42866c9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:03.139016 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-863a0f9e-cb80-426f-a97b-8a0ba42866c9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:03.139753 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-863a0f9e-cb80-426f-a97b-8a0ba42866c9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:03.141151 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-863a0f9e-cb80-426f-a97b-8a0ba42866c9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:03.141951 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-863a0f9e-cb80-426f-a97b-8a0ba42866c9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:03.187842 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3b2afd3b-b1b7-45b0-9115-6ba63aa4b635 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/67950362-e320-4f68-b90b-8070abbcb35b" status: 202 len: 0 microversion: 2.1 time: 0.364976 Jun 16 14:44:03.188726 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 666/1304] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:44:02 2022] DELETE /compute/v2.1/os-security-groups/67950362-e320-4f68-b90b-8070abbcb35b => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:44:03.197014 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0ede8a1f-9556-44a9-834f-59ca731c692b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1586681265"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:03.199106 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0ede8a1f-9556-44a9-834f-59ca731c692b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 044b8b3a-db26-450b-b770-6134060ded1c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:03.210258 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0ede8a1f-9556-44a9-834f-59ca731c692b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:03.211088 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0ede8a1f-9556-44a9-834f-59ca731c692b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:03.212353 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0ede8a1f-9556-44a9-834f-59ca731c692b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:03.213001 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0ede8a1f-9556-44a9-834f-59ca731c692b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:03.425366 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-863a0f9e-cb80-426f-a97b-8a0ba42866c9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:03.438575 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-863a0f9e-cb80-426f-a97b-8a0ba42866c9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1542 microversion: 2.1 time: 0.321476 Jun 16 14:44:03.439953 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 639/1305] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:03 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1542 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:03.446191 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4a11e85d-1316-4101-a772-c16ddd2fa019 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:03.447370 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4a11e85d-1316-4101-a772-c16ddd2fa019 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:03.454960 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4a11e85d-1316-4101-a772-c16ddd2fa019 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:03.455821 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4a11e85d-1316-4101-a772-c16ddd2fa019 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:03.457060 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4a11e85d-1316-4101-a772-c16ddd2fa019 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:03.457809 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4a11e85d-1316-4101-a772-c16ddd2fa019 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:03.753560 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4a11e85d-1316-4101-a772-c16ddd2fa019 tempest-ServersAdminTestJSON-2045207258 tempest-ServersAdminTestJSON-2045207258-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1612 microversion: 2.1 time: 0.311497 Jun 16 14:44:03.756376 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 640/1306] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:03 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1612 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:03.766526 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c6d95cc7-995e-429d-8775-dc975a6f5b0f tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:03.768144 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c6d95cc7-995e-429d-8775-dc975a6f5b0f tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:03.781013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c6d95cc7-995e-429d-8775-dc975a6f5b0f tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:03.781789 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0ede8a1f-9556-44a9-834f-59ca731c692b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "POST /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c/action" status: 202 len: 0 microversion: 2.1 time: 0.590392 Jun 16 14:44:03.783029 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c6d95cc7-995e-429d-8775-dc975a6f5b0f tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:03.785030 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c6d95cc7-995e-429d-8775-dc975a6f5b0f tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:03.788466 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c6d95cc7-995e-429d-8775-dc975a6f5b0f tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:03.793571 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 667/1307] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:44:03 2022] POST /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 14:44:03.811786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-da6171c9-c500-436f-b466-d1477a590682 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'create', calling method: .version_select at 0x7fdeffe1d160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1456221601", "description": "tempest-description-1022177929"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:03.869289 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c6d95cc7-995e-429d-8775-dc975a6f5b0f tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:44:04.064689 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c6d95cc7-995e-429d-8775-dc975a6f5b0f tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 204 len: 0 microversion: 2.1 time: 0.305246 Jun 16 14:44:04.066332 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 641/1308] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:44:03 2022] DELETE /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:04.077245 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a536fc9e-892c-4bc5-91aa-52cb380fa95a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:04.079274 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a536fc9e-892c-4bc5-91aa-52cb380fa95a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:04.092375 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a536fc9e-892c-4bc5-91aa-52cb380fa95a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:04.093725 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a536fc9e-892c-4bc5-91aa-52cb380fa95a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:04.095676 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a536fc9e-892c-4bc5-91aa-52cb380fa95a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:04.096748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a536fc9e-892c-4bc5-91aa-52cb380fa95a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:04.264508 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-da6171c9-c500-436f-b466-d1477a590682 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.468231 Jun 16 14:44:04.265731 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 668/1309] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:44:03 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:04.283058 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-54efe8e0-f37a-43fb-8b20-119c8f6cac8f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:04.284001 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-54efe8e0-f37a-43fb-8b20-119c8f6cac8f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:04.297035 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54efe8e0-f37a-43fb-8b20-119c8f6cac8f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:04.298301 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54efe8e0-f37a-43fb-8b20-119c8f6cac8f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:04.299709 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54efe8e0-f37a-43fb-8b20-119c8f6cac8f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:04.300660 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54efe8e0-f37a-43fb-8b20-119c8f6cac8f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:04.320926 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a536fc9e-892c-4bc5-91aa-52cb380fa95a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:04.342547 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a536fc9e-892c-4bc5-91aa-52cb380fa95a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1150 microversion: 2.1 time: 0.273674 Jun 16 14:44:04.344827 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 642/1310] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:04 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1150 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:04.358813 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8c8fe53f-b8cb-4a35-9b82-7404e2887ff1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:04.360267 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8c8fe53f-b8cb-4a35-9b82-7404e2887ff1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:04.375178 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8c8fe53f-b8cb-4a35-9b82-7404e2887ff1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:04.376202 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8c8fe53f-b8cb-4a35-9b82-7404e2887ff1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:04.378638 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8c8fe53f-b8cb-4a35-9b82-7404e2887ff1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:04.379462 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8c8fe53f-b8cb-4a35-9b82-7404e2887ff1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:04.456503 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8c8fe53f-b8cb-4a35-9b82-7404e2887ff1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:44:04.573506 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:04.674593 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8c8fe53f-b8cb-4a35-9b82-7404e2887ff1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 204 len: 0 microversion: 2.1 time: 0.320078 Jun 16 14:44:04.674593 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 643/1311] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:44:04 2022] DELETE /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:04.684893 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ec622740-b694-41d7-8dd6-3e68d8d2b100 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffe105e0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:04.782615 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ec622740-b694-41d7-8dd6-3e68d8d2b100 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.107731 Jun 16 14:44:04.784077 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 644/1312] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:04 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:04.791931 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5b0de96f-4006-422b-a620-886c77dd6c04 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:04.794432 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5b0de96f-4006-422b-a620-886c77dd6c04 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:04.806347 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b0de96f-4006-422b-a620-886c77dd6c04 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:04.807120 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b0de96f-4006-422b-a620-886c77dd6c04 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:04.808088 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b0de96f-4006-422b-a620-886c77dd6c04 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:04.808818 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b0de96f-4006-422b-a620-886c77dd6c04 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:04.949499 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-54efe8e0-f37a-43fb-8b20-119c8f6cac8f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:04.958025 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-54efe8e0-f37a-43fb-8b20-119c8f6cac8f tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 200 len: 1679 microversion: 2.1 time: 0.683083 Jun 16 14:44:04.959940 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 669/1313] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:04 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 1679 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:04.965087 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5b29bb12-8d52-42bf-8a59-b94b1eb5c964 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:04.966013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5b29bb12-8d52-42bf-8a59-b94b1eb5c964 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:04.973326 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5b29bb12-8d52-42bf-8a59-b94b1eb5c964 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:04.974561 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5b29bb12-8d52-42bf-8a59-b94b1eb5c964 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:04.975451 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5b29bb12-8d52-42bf-8a59-b94b1eb5c964 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:04.975909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5b29bb12-8d52-42bf-8a59-b94b1eb5c964 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:05.143312 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5b29bb12-8d52-42bf-8a59-b94b1eb5c964 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:05.153018 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5b29bb12-8d52-42bf-8a59-b94b1eb5c964 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1541 microversion: 2.1 time: 0.191883 Jun 16 14:44:05.153742 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 670/1314] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:04 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1541 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:05.158939 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7f5f09e6-ad6d-4be4-93bb-87eb4f32aca8 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Action: 'update', calling method: .version_select at 0x7fdeffe47820>, body: {"security_group": {"name": "tempest-sg-hth-1421660192", "description": "tempest-description-hth-247028234"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:05.177690 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5b0de96f-4006-422b-a620-886c77dd6c04 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:05.196315 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5b0de96f-4006-422b-a620-886c77dd6c04 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:05.200523 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5b0de96f-4006-422b-a620-886c77dd6c04 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:05.203063 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5b0de96f-4006-422b-a620-886c77dd6c04 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.417082 Jun 16 14:44:05.204135 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 645/1315] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:04 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:05.226244 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-16a18b95-d82c-4f2e-b24a-b5ddf1a6bb45 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:05.226980 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-16a18b95-d82c-4f2e-b24a-b5ddf1a6bb45 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:05.242195 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-16a18b95-d82c-4f2e-b24a-b5ddf1a6bb45 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:05.243427 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-16a18b95-d82c-4f2e-b24a-b5ddf1a6bb45 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:05.246457 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-16a18b95-d82c-4f2e-b24a-b5ddf1a6bb45 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:05.247488 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-16a18b95-d82c-4f2e-b24a-b5ddf1a6bb45 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:05.563675 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-16a18b95-d82c-4f2e-b24a-b5ddf1a6bb45 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:05.578982 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7f5f09e6-ad6d-4be4-93bb-87eb4f32aca8 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "PUT /compute/v2.1/os-security-groups/00a7f6d6-1387-4fed-a5ec-2e7f8c0bf402" status: 200 len: 217 microversion: 2.1 time: 0.423490 Jun 16 14:44:05.580302 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 671/1316] 10.222.0.57 () {60 vars in 1289 bytes} [Thu Jun 16 14:44:05 2022] PUT /compute/v2.1/os-security-groups/00a7f6d6-1387-4fed-a5ec-2e7f8c0bf402 => generated 217 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:05.584362 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-16a18b95-d82c-4f2e-b24a-b5ddf1a6bb45 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1542 microversion: 2.1 time: 0.366515 Jun 16 14:44:05.586453 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 646/1317] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:05 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1542 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:05.591164 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-40b4ef07-b801-493c-823e-66cd3d36358a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:05.592226 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-40b4ef07-b801-493c-823e-66cd3d36358a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:05.600634 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bcd9d234-df51-4c43-b245-d793adff80ae tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:05.601570 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-40b4ef07-b801-493c-823e-66cd3d36358a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:05.601865 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bcd9d234-df51-4c43-b245-d793adff80ae tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:05.602675 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-40b4ef07-b801-493c-823e-66cd3d36358a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:05.603804 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-40b4ef07-b801-493c-823e-66cd3d36358a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:05.606126 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-40b4ef07-b801-493c-823e-66cd3d36358a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:05.612747 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:05.617634 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bcd9d234-df51-4c43-b245-d793adff80ae tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:05.619100 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bcd9d234-df51-4c43-b245-d793adff80ae tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:05.620743 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bcd9d234-df51-4c43-b245-d793adff80ae tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:05.621681 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bcd9d234-df51-4c43-b245-d793adff80ae tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:05.760314 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bcd9d234-df51-4c43-b245-d793adff80ae tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:05.775762 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bcd9d234-df51-4c43-b245-d793adff80ae tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1168 microversion: 2.1 time: 0.185618 Jun 16 14:44:05.777448 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 647/1318] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:05 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1168 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:05.789347 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-17c0e65b-1da7-4f43-9319-35596955d333 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdf0c07b4c0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:05.842874 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-40b4ef07-b801-493c-823e-66cd3d36358a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:05.856305 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-40b4ef07-b801-493c-823e-66cd3d36358a tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1469 microversion: 2.1 time: 0.274240 Jun 16 14:44:05.866575 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 672/1319] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:05 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1469 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:05.877220 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ed2f01d8-a059-43ba-a660-cc34ece093a8 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffe47310>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:05.951177 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ed2f01d8-a059-43ba-a660-cc34ece093a8 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.083317 Jun 16 14:44:05.952887 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 673/1320] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:05 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:05.959874 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-2da81853-61d3-4f9e-828a-72b9df5f2151 req-aaf30cff-d46d-46f0-8e78-280841805571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3e44fe0-8c95-439e-b249-80c3791ff385", "name": "network-vif-deleted", "tag": "bce297d7-6ae0-43d9-bf32-c0605158382b"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:05.970422 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-2da81853-61d3-4f9e-828a-72b9df5f2151 req-aaf30cff-d46d-46f0-8e78-280841805571 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:05.971181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-2da81853-61d3-4f9e-828a-72b9df5f2151 req-aaf30cff-d46d-46f0-8e78-280841805571 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:05.977070 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-17c0e65b-1da7-4f43-9319-35596955d333 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/00a7f6d6-1387-4fed-a5ec-2e7f8c0bf402" status: 200 len: 217 microversion: 2.1 time: 0.197664 Jun 16 14:44:05.978787 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 648/1321] 10.222.0.57 () {58 vars in 1268 bytes} [Thu Jun 16 14:44:05 2022] GET /compute/v2.1/os-security-groups/00a7f6d6-1387-4fed-a5ec-2e7f8c0bf402 => generated 217 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:05.988042 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1080811a-9ddf-4841-bbd7-efc511efeea6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:05.990205 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1080811a-9ddf-4841-bbd7-efc511efeea6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:05.993642 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-2da81853-61d3-4f9e-828a-72b9df5f2151 req-aaf30cff-d46d-46f0-8e78-280841805571 service nova] Creating event network-vif-deleted:bce297d7-6ae0-43d9-bf32-c0605158382b for instance b3e44fe0-8c95-439e-b249-80c3791ff385 on n-h1-836830-4 Jun 16 14:44:05.999836 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-2da81853-61d3-4f9e-828a-72b9df5f2151 req-aaf30cff-d46d-46f0-8e78-280841805571 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044522 Jun 16 14:44:06.000736 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 674/1322] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:06.003794 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1080811a-9ddf-4841-bbd7-efc511efeea6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:06.004252 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1080811a-9ddf-4841-bbd7-efc511efeea6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:06.005637 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1080811a-9ddf-4841-bbd7-efc511efeea6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:06.006096 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1080811a-9ddf-4841-bbd7-efc511efeea6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:06.008874 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8abaa7f3-479a-4d65-a921-35c3cffc98cd tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdeffe47430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:06.135963 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1080811a-9ddf-4841-bbd7-efc511efeea6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:06.145050 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1080811a-9ddf-4841-bbd7-efc511efeea6 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 200 len: 1612 microversion: 2.1 time: 0.164405 Jun 16 14:44:06.146293 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 649/1323] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:05 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 1612 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:06.174263 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-28bf010c-64cc-4fda-abfb-d9ac2f6a1bb4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:06.175322 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-28bf010c-64cc-4fda-abfb-d9ac2f6a1bb4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:06.183783 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28bf010c-64cc-4fda-abfb-d9ac2f6a1bb4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:06.184482 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28bf010c-64cc-4fda-abfb-d9ac2f6a1bb4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:06.185646 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28bf010c-64cc-4fda-abfb-d9ac2f6a1bb4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:06.186419 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28bf010c-64cc-4fda-abfb-d9ac2f6a1bb4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:06.312000 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8abaa7f3-479a-4d65-a921-35c3cffc98cd tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/00a7f6d6-1387-4fed-a5ec-2e7f8c0bf402" status: 202 len: 0 microversion: 2.1 time: 0.309368 Jun 16 14:44:06.328743 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 675/1324] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:44:06 2022] DELETE /compute/v2.1/os-security-groups/00a7f6d6-1387-4fed-a5ec-2e7f8c0bf402 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:44:06.352390 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-514c66f5-5c56-44d2-ad8e-c4473bf93260 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:06.366819 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-514c66f5-5c56-44d2-ad8e-c4473bf93260 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:06.383121 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-514c66f5-5c56-44d2-ad8e-c4473bf93260 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:06.384343 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-514c66f5-5c56-44d2-ad8e-c4473bf93260 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:06.386960 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-514c66f5-5c56-44d2-ad8e-c4473bf93260 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:06.387711 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-514c66f5-5c56-44d2-ad8e-c4473bf93260 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:06.401825 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-28bf010c-64cc-4fda-abfb-d9ac2f6a1bb4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:06.428762 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-28bf010c-64cc-4fda-abfb-d9ac2f6a1bb4 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1541 microversion: 2.1 time: 0.256196 Jun 16 14:44:06.435973 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 650/1325] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:06 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1541 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:06.443487 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0fab2468-6d02-4e85-850e-c5545ee857cc tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:06.444426 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0fab2468-6d02-4e85-850e-c5545ee857cc tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:06.458565 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0fab2468-6d02-4e85-850e-c5545ee857cc tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:06.459434 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0fab2468-6d02-4e85-850e-c5545ee857cc tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:06.460893 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0fab2468-6d02-4e85-850e-c5545ee857cc tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:06.461610 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0fab2468-6d02-4e85-850e-c5545ee857cc tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:06.516774 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-0fab2468-6d02-4e85-850e-c5545ee857cc tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0fab2468-6d02-4e85-850e-c5545ee857cc tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 HTTP/1.1 Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:44:06.527958 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:44:06.530969 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:44:06.530969 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:06.530969 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:06.530969 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:06.530969 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:06.530969 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:44:06.530969 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:44:06.530969 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:44:06.530969 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:06.530969 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:44:06.530969 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. Jun 16 14:44:06.530969 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '58f83874-bfcd-4b80-a6c5-949bd8f341b9'} Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:06.532863 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. Jun 16 14:44:06.535415 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.541377 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0fab2468-6d02-4e85-850e-c5545ee857cc tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 404 to user: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:06.555056 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0fab2468-6d02-4e85-850e-c5545ee857cc tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 404 len: 111 microversion: 2.1 time: 0.116233 Jun 16 14:44:06.556557 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 651/1326] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:44:06 2022] DELETE /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:44:06.576563 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-de8c0121-49fc-4fcd-b487-b2632a34e8e7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:06.579522 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-de8c0121-49fc-4fcd-b487-b2632a34e8e7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 58f83874-bfcd-4b80-a6c5-949bd8f341b9] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:06.595061 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de8c0121-49fc-4fcd-b487-b2632a34e8e7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:06.596274 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de8c0121-49fc-4fcd-b487-b2632a34e8e7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:06.598936 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de8c0121-49fc-4fcd-b487-b2632a34e8e7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:06.601150 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de8c0121-49fc-4fcd-b487-b2632a34e8e7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:06.643281 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-de8c0121-49fc-4fcd-b487-b2632a34e8e7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-de8c0121-49fc-4fcd-b487-b2632a34e8e7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 HTTP/1.1 Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:44:06.647604 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:44:06.650661 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:44:06.650661 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:06.650661 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:06.650661 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:06.650661 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:06.650661 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:44:06.650661 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:44:06.650661 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:44:06.650661 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:06.650661 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:44:06.650661 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. Jun 16 14:44:06.650661 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '58f83874-bfcd-4b80-a6c5-949bd8f341b9'} Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:06.652370 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. Jun 16 14:44:06.661210 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.671926 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-de8c0121-49fc-4fcd-b487-b2632a34e8e7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 404 to user: Instance 58f83874-bfcd-4b80-a6c5-949bd8f341b9 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:06.671926 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-de8c0121-49fc-4fcd-b487-b2632a34e8e7 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9" status: 404 len: 111 microversion: 2.1 time: 0.088539 Jun 16 14:44:06.671926 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 652/1327] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:06 2022] GET /compute/v2.1/servers/58f83874-bfcd-4b80-a6c5-949bd8f341b9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:44:06.671926 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ddfcd644-8b9b-49e6-9733-d18459eabc50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:06.671926 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ddfcd644-8b9b-49e6-9733-d18459eabc50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:06.684321 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddfcd644-8b9b-49e6-9733-d18459eabc50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:06.685241 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddfcd644-8b9b-49e6-9733-d18459eabc50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:06.686795 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddfcd644-8b9b-49e6-9733-d18459eabc50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:06.687608 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddfcd644-8b9b-49e6-9733-d18459eabc50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:06.741400 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-514c66f5-5c56-44d2-ad8e-c4473bf93260 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:06.754731 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-514c66f5-5c56-44d2-ad8e-c4473bf93260 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:06.757181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-514c66f5-5c56-44d2-ad8e-c4473bf93260 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:06.760719 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-514c66f5-5c56-44d2-ad8e-c4473bf93260 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.429863 Jun 16 14:44:06.765596 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 676/1328] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:06 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:06.774741 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3f6f2371-8e16-463a-9cb3-d5b1437150af tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdeffe47dc0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:06.821248 n-d-836830-4 devstack@n-api.service[125862]: DEBUG neutronclient.v2_0.client [None req-3f6f2371-8e16-463a-9cb3-d5b1437150af tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 67950362-e320-4f68-b90b-8070abbcb35b does not exist", "detail": ""}} {{(pid=125862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:44:06.822273 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.security_group_api [None req-3f6f2371-8e16-463a-9cb3-d5b1437150af tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Neutron security group 67950362-e320-4f68-b90b-8070abbcb35b not found {{(pid=125862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 14:44:06.823092 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-3f6f2371-8e16-463a-9cb3-d5b1437150af tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Security group 67950362-e320-4f68-b90b-8070abbcb35b does not exist Jun 16 14:44:06.823092 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-2edda6c1-a789-441e-a545-e024258e31a5'] Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3f6f2371-8e16-463a-9cb3-d5b1437150af tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/os-security-groups/67950362-e320-4f68-b90b-8070abbcb35b HTTP/1.1 Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:44:06.827171 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:44:06.829482 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:44:06.829482 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:06.829482 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:06.829482 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:06.829482 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:06.829482 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:44:06.829482 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:44:06.829482 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:44:06.829482 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:06.829482 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:44:06.829482 n-d-836830-4 devstack@n-api.service[125862]: exception: Security group 67950362-e320-4f68-b90b-8070abbcb35b does not exist Jun 16 14:44:06.829482 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-2edda6c1-a789-441e-a545-e024258e31a5'] Jun 16 14:44:06.829482 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '67950362-e320-4f68-b90b-8070abbcb35b'} Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:06.830738 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 67950362-e320-4f68-b90b-8070abbcb35b does not exist Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2edda6c1-a789-441e-a545-e024258e31a5'] Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 14:44:06.832626 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 67950362-e320-4f68-b90b-8070abbcb35b does not exist Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2edda6c1-a789-441e-a545-e024258e31a5'] Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 67950362-e320-4f68-b90b-8070abbcb35b does not exist Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2edda6c1-a789-441e-a545-e024258e31a5'] Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.834819 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:06.837185 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:06.837185 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:06.837185 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:06.837185 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:06.837185 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 67950362-e320-4f68-b90b-8070abbcb35b does not exist Jun 16 14:44:06.837185 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2edda6c1-a789-441e-a545-e024258e31a5'] Jun 16 14:44:06.837185 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:06.839825 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3f6f2371-8e16-463a-9cb3-d5b1437150af tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 404 to user: Security group 67950362-e320-4f68-b90b-8070abbcb35b does not exist Jun 16 14:44:06.839825 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-2edda6c1-a789-441e-a545-e024258e31a5'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:06.841848 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3f6f2371-8e16-463a-9cb3-d5b1437150af tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/67950362-e320-4f68-b90b-8070abbcb35b" status: 404 len: 194 microversion: 2.1 time: 0.074017 Jun 16 14:44:06.843746 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 677/1329] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:44:06 2022] DELETE /compute/v2.1/os-security-groups/67950362-e320-4f68-b90b-8070abbcb35b => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:44:06.850892 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-18b274fb-e991-4a60-a657-3d315317deb2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:06.851875 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-18b274fb-e991-4a60-a657-3d315317deb2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:06.861927 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18b274fb-e991-4a60-a657-3d315317deb2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:06.862714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18b274fb-e991-4a60-a657-3d315317deb2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:06.864878 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18b274fb-e991-4a60-a657-3d315317deb2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:06.866198 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18b274fb-e991-4a60-a657-3d315317deb2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:06.991842 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-18b274fb-e991-4a60-a657-3d315317deb2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:07.017889 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-18b274fb-e991-4a60-a657-3d315317deb2 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1168 microversion: 2.1 time: 0.172707 Jun 16 14:44:07.021897 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 678/1330] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:06 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1168 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:07.040762 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-67eb92c2-1db0-4638-aaac-b720ebc87639 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdeffe620d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:07.200444 n-d-836830-4 devstack@n-api.service[125862]: DEBUG neutronclient.v2_0.client [None req-67eb92c2-1db0-4638-aaac-b720ebc87639 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 does not exist", "detail": ""}} {{(pid=125862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:44:07.205238 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.security_group_api [None req-67eb92c2-1db0-4638-aaac-b720ebc87639 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Neutron security group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 not found {{(pid=125862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 14:44:07.207648 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-67eb92c2-1db0-4638-aaac-b720ebc87639 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Security group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 does not exist Jun 16 14:44:07.207648 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-08300b70-1436-4b71-bd4c-8f7c85c3099b'] Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-67eb92c2-1db0-4638-aaac-b720ebc87639 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/os-security-groups/ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 HTTP/1.1 Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:44:07.212330 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:44:07.213956 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:44:07.213956 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:07.213956 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:07.213956 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:07.213956 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:07.213956 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:44:07.213956 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:44:07.213956 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:44:07.213956 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:07.213956 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:44:07.213956 n-d-836830-4 devstack@n-api.service[125862]: exception: Security group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 does not exist Jun 16 14:44:07.213956 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-08300b70-1436-4b71-bd4c-8f7c85c3099b'] Jun 16 14:44:07.213956 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'ae8e4cb7-22b4-4984-b62d-924c60b7fcd4'} Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:07.214876 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 does not exist Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08300b70-1436-4b71-bd4c-8f7c85c3099b'] Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 14:44:07.216111 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 does not exist Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08300b70-1436-4b71-bd4c-8f7c85c3099b'] Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 does not exist Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08300b70-1436-4b71-bd4c-8f7c85c3099b'] Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:07.217263 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:07.218915 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:07.218915 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:07.218915 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:07.218915 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:07.218915 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 does not exist Jun 16 14:44:07.218915 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08300b70-1436-4b71-bd4c-8f7c85c3099b'] Jun 16 14:44:07.218915 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:07.218915 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-67eb92c2-1db0-4638-aaac-b720ebc87639 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 404 to user: Security group ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 does not exist Jun 16 14:44:07.218915 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-08300b70-1436-4b71-bd4c-8f7c85c3099b'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:07.218915 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-67eb92c2-1db0-4638-aaac-b720ebc87639 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/ae8e4cb7-22b4-4984-b62d-924c60b7fcd4" status: 404 len: 194 microversion: 2.1 time: 0.192585 Jun 16 14:44:07.218915 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 679/1331] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:44:07 2022] DELETE /compute/v2.1/os-security-groups/ae8e4cb7-22b4-4984-b62d-924c60b7fcd4 => generated 194 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:44:07.229472 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-866d9cba-ffba-4b05-b8d4-d0c434e73274 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:07.230896 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-866d9cba-ffba-4b05-b8d4-d0c434e73274 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:07.248494 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-866d9cba-ffba-4b05-b8d4-d0c434e73274 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:07.249542 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-866d9cba-ffba-4b05-b8d4-d0c434e73274 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:07.251248 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-866d9cba-ffba-4b05-b8d4-d0c434e73274 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:07.252480 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-866d9cba-ffba-4b05-b8d4-d0c434e73274 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:07.381416 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ddfcd644-8b9b-49e6-9733-d18459eabc50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:07.394130 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ddfcd644-8b9b-49e6-9733-d18459eabc50 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1542 microversion: 2.1 time: 0.737485 Jun 16 14:44:07.409473 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 653/1332] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:06 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1542 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:07.421877 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-971b9615-6a50-4830-b71d-9ecce12a0075 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c718c10>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:07.551087 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-971b9615-6a50-4830-b71d-9ecce12a0075 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.135502 Jun 16 14:44:07.552245 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 654/1333] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:07 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:07.566812 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-172c5567-c702-4d8b-a155-0af582a85f70 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:07.570888 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-172c5567-c702-4d8b-a155-0af582a85f70 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:07.580033 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-172c5567-c702-4d8b-a155-0af582a85f70 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:07.581137 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-172c5567-c702-4d8b-a155-0af582a85f70 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:07.582201 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-172c5567-c702-4d8b-a155-0af582a85f70 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:07.583527 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-172c5567-c702-4d8b-a155-0af582a85f70 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:07.658006 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-172c5567-c702-4d8b-a155-0af582a85f70 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:07.659068 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-172c5567-c702-4d8b-a155-0af582a85f70 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:07.659874 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-172c5567-c702-4d8b-a155-0af582a85f70 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lazy-loading 'fault' on Instance uuid b3e44fe0-8c95-439e-b249-80c3791ff385 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:44:07.757529 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-172c5567-c702-4d8b-a155-0af582a85f70 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '960ce02e58de4a02a547844c88034159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb259849be2454ba564207db28025d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:07.790920 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-172c5567-c702-4d8b-a155-0af582a85f70 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 200 len: 1330 microversion: 2.1 time: 0.232504 Jun 16 14:44:07.792037 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 655/1334] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:07 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 1330 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:07.821530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5f84d450-278b-4676-9817-3dbd3064caef tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdf0c07da60>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:07.924672 n-d-836830-4 devstack@n-api.service[125863]: DEBUG neutronclient.v2_0.client [None req-5f84d450-278b-4676-9817-3dbd3064caef tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist", "detail": ""}} {{(pid=125863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:44:07.925297 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.security_group_api [None req-5f84d450-278b-4676-9817-3dbd3064caef tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Neutron security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae not found {{(pid=125863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 14:44:07.925843 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-5f84d450-278b-4676-9817-3dbd3064caef tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist Jun 16 14:44:07.925843 n-d-836830-4 devstack@n-api.service[125863]: Neutron server returns request_ids: ['req-5753dff6-f0a0-4658-8bdf-4f7e3d1ddd39'] Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5f84d450-278b-4676-9817-3dbd3064caef tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/os-security-groups/aa6ffe21-123a-4d9f-9caa-2b86c25197ae HTTP/1.1 Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:44:07.928145 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:44:07.931093 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:44:07.931093 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:07.931093 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:07.931093 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:07.931093 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:07.931093 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:44:07.931093 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:44:07.931093 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:44:07.931093 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:07.931093 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:44:07.931093 n-d-836830-4 devstack@n-api.service[125863]: exception: Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist Jun 16 14:44:07.931093 n-d-836830-4 devstack@n-api.service[125863]: Neutron server returns request_ids: ['req-5753dff6-f0a0-4658-8bdf-4f7e3d1ddd39'] Jun 16 14:44:07.931093 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'aa6ffe21-123a-4d9f-9caa-2b86c25197ae'} Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:07.932899 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5753dff6-f0a0-4658-8bdf-4f7e3d1ddd39'] Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 14:44:07.935364 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5753dff6-f0a0-4658-8bdf-4f7e3d1ddd39'] Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5753dff6-f0a0-4658-8bdf-4f7e3d1ddd39'] Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:07.937660 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:07.940536 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:07.940536 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:07.940536 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:07.940536 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:07.940536 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist Jun 16 14:44:07.940536 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5753dff6-f0a0-4658-8bdf-4f7e3d1ddd39'] Jun 16 14:44:07.940536 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:07.940536 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5f84d450-278b-4676-9817-3dbd3064caef tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 404 to user: Security group aa6ffe21-123a-4d9f-9caa-2b86c25197ae does not exist Jun 16 14:44:07.940536 n-d-836830-4 devstack@n-api.service[125863]: Neutron server returns request_ids: ['req-5753dff6-f0a0-4658-8bdf-4f7e3d1ddd39'] {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:07.940536 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5f84d450-278b-4676-9817-3dbd3064caef tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/aa6ffe21-123a-4d9f-9caa-2b86c25197ae" status: 404 len: 194 microversion: 2.1 time: 0.122380 Jun 16 14:44:07.940536 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 656/1335] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:44:07 2022] DELETE /compute/v2.1/os-security-groups/aa6ffe21-123a-4d9f-9caa-2b86c25197ae => generated 194 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:44:07.946833 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3fcc8329-3d30-4ed5-bfed-aabe96d623a2 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:07.948828 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3fcc8329-3d30-4ed5-bfed-aabe96d623a2 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:07.976873 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3fcc8329-3d30-4ed5-bfed-aabe96d623a2 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:07.977823 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3fcc8329-3d30-4ed5-bfed-aabe96d623a2 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:07.982370 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3fcc8329-3d30-4ed5-bfed-aabe96d623a2 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:07.982983 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3fcc8329-3d30-4ed5-bfed-aabe96d623a2 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:08.227164 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-866d9cba-ffba-4b05-b8d4-d0c434e73274 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:08.271149 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-866d9cba-ffba-4b05-b8d4-d0c434e73274 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1469 microversion: 2.1 time: 1.048529 Jun 16 14:44:08.273176 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 680/1336] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:07 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1469 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:08.303720 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-49128fab-e2b1-44a9-9d7c-bfffc70324e7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:08.308756 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-49128fab-e2b1-44a9-9d7c-bfffc70324e7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:08.352119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49128fab-e2b1-44a9-9d7c-bfffc70324e7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:08.352835 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49128fab-e2b1-44a9-9d7c-bfffc70324e7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:08.354370 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49128fab-e2b1-44a9-9d7c-bfffc70324e7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:08.355323 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49128fab-e2b1-44a9-9d7c-bfffc70324e7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:08.767095 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3fcc8329-3d30-4ed5-bfed-aabe96d623a2 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:08.831020 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3fcc8329-3d30-4ed5-bfed-aabe96d623a2 tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1541 microversion: 2.1 time: 0.890742 Jun 16 14:44:08.836611 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 657/1337] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:07 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1541 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:08.852679 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-49128fab-e2b1-44a9-9d7c-bfffc70324e7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:08.863671 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9c77f25b-268d-4986-b318-c9403e60a95e tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdf0c07d280>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:08.876780 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-49128fab-e2b1-44a9-9d7c-bfffc70324e7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:08.877402 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-49128fab-e2b1-44a9-9d7c-bfffc70324e7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:08.878703 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-49128fab-e2b1-44a9-9d7c-bfffc70324e7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.603736 Jun 16 14:44:08.879286 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 681/1338] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:08 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:08.900217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2a086f1c-8c31-4cc3-ba50-767bfc442fcb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:08.914942 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2a086f1c-8c31-4cc3-ba50-767bfc442fcb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:08.927757 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2a086f1c-8c31-4cc3-ba50-767bfc442fcb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:08.935520 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2a086f1c-8c31-4cc3-ba50-767bfc442fcb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:08.936823 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2a086f1c-8c31-4cc3-ba50-767bfc442fcb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:08.939911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2a086f1c-8c31-4cc3-ba50-767bfc442fcb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:09.006562 n-d-836830-4 devstack@n-api.service[125863]: DEBUG neutronclient.v2_0.client [None req-9c77f25b-268d-4986-b318-c9403e60a95e tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist", "detail": ""}} {{(pid=125863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:44:09.008006 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.security_group_api [None req-9c77f25b-268d-4986-b318-c9403e60a95e tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Neutron security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af not found {{(pid=125863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 14:44:09.009409 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-9c77f25b-268d-4986-b318-c9403e60a95e tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist Jun 16 14:44:09.009409 n-d-836830-4 devstack@n-api.service[125863]: Neutron server returns request_ids: ['req-d9c53dfa-eff7-4acf-9abc-f2aed59895e4'] Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9c77f25b-268d-4986-b318-c9403e60a95e tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/os-security-groups/2a94d927-8e48-4ab0-ac5f-4ce77a4e21af HTTP/1.1 Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:44:09.033691 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:44:09.037601 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:44:09.037601 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:09.037601 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:09.037601 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:09.037601 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:09.037601 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:44:09.037601 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:44:09.037601 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:44:09.037601 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:09.037601 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:44:09.037601 n-d-836830-4 devstack@n-api.service[125863]: exception: Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist Jun 16 14:44:09.037601 n-d-836830-4 devstack@n-api.service[125863]: Neutron server returns request_ids: ['req-d9c53dfa-eff7-4acf-9abc-f2aed59895e4'] Jun 16 14:44:09.037601 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '2a94d927-8e48-4ab0-ac5f-4ce77a4e21af'} Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:09.039333 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9c53dfa-eff7-4acf-9abc-f2aed59895e4'] Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 14:44:09.041890 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9c53dfa-eff7-4acf-9abc-f2aed59895e4'] Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9c53dfa-eff7-4acf-9abc-f2aed59895e4'] Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:09.046068 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:09.048810 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:09.048810 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:09.048810 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:09.048810 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:09.048810 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist Jun 16 14:44:09.048810 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9c53dfa-eff7-4acf-9abc-f2aed59895e4'] Jun 16 14:44:09.048810 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:09.051595 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9c77f25b-268d-4986-b318-c9403e60a95e tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 404 to user: Security group 2a94d927-8e48-4ab0-ac5f-4ce77a4e21af does not exist Jun 16 14:44:09.051595 n-d-836830-4 devstack@n-api.service[125863]: Neutron server returns request_ids: ['req-d9c53dfa-eff7-4acf-9abc-f2aed59895e4'] {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:09.055164 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9c77f25b-268d-4986-b318-c9403e60a95e tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/2a94d927-8e48-4ab0-ac5f-4ce77a4e21af" status: 404 len: 194 microversion: 2.1 time: 0.214392 Jun 16 14:44:09.057490 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 658/1339] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:44:08 2022] DELETE /compute/v2.1/os-security-groups/2a94d927-8e48-4ab0-ac5f-4ce77a4e21af => generated 194 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:44:09.071607 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7b2714b1-dd15-45c8-b67b-e4030bc2fde3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:09.075919 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7b2714b1-dd15-45c8-b67b-e4030bc2fde3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:09.103053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7b2714b1-dd15-45c8-b67b-e4030bc2fde3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:09.104157 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7b2714b1-dd15-45c8-b67b-e4030bc2fde3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:09.105774 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7b2714b1-dd15-45c8-b67b-e4030bc2fde3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:09.107416 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7b2714b1-dd15-45c8-b67b-e4030bc2fde3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:09.711217 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7b2714b1-dd15-45c8-b67b-e4030bc2fde3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:09.741279 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7b2714b1-dd15-45c8-b67b-e4030bc2fde3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1542 microversion: 2.1 time: 0.675871 Jun 16 14:44:09.754037 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 659/1340] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:09 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1542 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:09.766618 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f47c7ad5-dda2-4db1-ac02-9c5d20f9ece0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0e7de1f0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:09.773712 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2a086f1c-8c31-4cc3-ba50-767bfc442fcb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:09.818331 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2a086f1c-8c31-4cc3-ba50-767bfc442fcb tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1210 microversion: 2.1 time: 0.913784 Jun 16 14:44:09.831586 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 682/1341] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:08 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1210 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:09.863136 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-630f3293-3017-431c-9104-8fa1d58129b7 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:09.865506 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-630f3293-3017-431c-9104-8fa1d58129b7 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] [instance: b3e44fe0-8c95-439e-b249-80c3791ff385] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:09.877639 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:09.880168 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-630f3293-3017-431c-9104-8fa1d58129b7 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:09.882371 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-630f3293-3017-431c-9104-8fa1d58129b7 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:09.883701 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-630f3293-3017-431c-9104-8fa1d58129b7 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:09.885270 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-630f3293-3017-431c-9104-8fa1d58129b7 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:09.918241 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-630f3293-3017-431c-9104-8fa1d58129b7 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] HTTP exception thrown: Instance b3e44fe0-8c95-439e-b249-80c3791ff385 could not be found. Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-630f3293-3017-431c-9104-8fa1d58129b7 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Request method failure captured: Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 HTTP/1.1 Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0C-MxugC5mLskBuQHWRxFCv-6lkiTYWT99BiCixj9U4TfzoZPLRUE9TOmR0XwSd0K0g9A72e8HClzvxLGlCNthuTmTNH7j2UDHYVnmiBjg530wjneK6KEwYJVVEjby3zenWl60edpp736WYU6464genNWmzhBnk6lUPcmpkREqPi_M Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 1cb259849be2454ba564207db28025d4 Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-VolumesAdminNegativeTest-1430161518 Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:44:09.920602 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:44:09.922188 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1cb259849be2454ba564207db28025d4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1cb259849be2454ba564207db28025d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1cb259849be2454ba564207db28025d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1cb259849be2454ba564207db28025d4"}]}] Jun 16 14:44:09.922188 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-VolumesAdminNegativeTest-1430161518 Jun 16 14:44:09.922188 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 1cb259849be2454ba564207db28025d4 Jun 16 14:44:09.922188 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1430161518 Jun 16 14:44:09.922188 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-VolumesAdminNegativeTest-1430161518-project Jun 16 14:44:09.922188 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:44:09.922188 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:44:09.922188 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 960ce02e58de4a02a547844c88034159 Jun 16 14:44:09.922188 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-VolumesAdminNegativeTest-1430161518-project Jun 16 14:44:09.922188 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:44:09.922188 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance b3e44fe0-8c95-439e-b249-80c3791ff385 could not be found. Jun 16 14:44:09.922188 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'b3e44fe0-8c95-439e-b249-80c3791ff385'} Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3e44fe0-8c95-439e-b249-80c3791ff385 could not be found. Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:09.923042 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3e44fe0-8c95-439e-b249-80c3791ff385 could not be found. Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3e44fe0-8c95-439e-b249-80c3791ff385 could not be found. Jun 16 14:44:09.924472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:09.938612 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-630f3293-3017-431c-9104-8fa1d58129b7 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Returning 404 to user: Instance b3e44fe0-8c95-439e-b249-80c3791ff385 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:09.942413 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-630f3293-3017-431c-9104-8fa1d58129b7 tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385" status: 404 len: 111 microversion: 2.1 time: 0.109059 Jun 16 14:44:09.951416 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 683/1342] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:09 2022] GET /compute/v2.1/servers/b3e44fe0-8c95-439e-b249-80c3791ff385 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:44:09.967357 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ef13063c-dc08-4a63-92de-6be68f366800 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdeffe86430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:09.994007 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f47c7ad5-dda2-4db1-ac02-9c5d20f9ece0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.245675 Jun 16 14:44:09.995039 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 660/1343] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:09 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:10.015715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-15399346-097a-40ac-b160-a2e536e640ae tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:10.017554 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-15399346-097a-40ac-b160-a2e536e640ae tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:10.048893 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15399346-097a-40ac-b160-a2e536e640ae tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:10.049695 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15399346-097a-40ac-b160-a2e536e640ae tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:10.051195 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15399346-097a-40ac-b160-a2e536e640ae tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:10.052050 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15399346-097a-40ac-b160-a2e536e640ae tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:10.110266 n-d-836830-4 devstack@n-api.service[125862]: DEBUG neutronclient.v2_0.client [None req-ef13063c-dc08-4a63-92de-6be68f366800 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist", "detail": ""}} {{(pid=125862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:44:10.110266 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.security_group_api [None req-ef13063c-dc08-4a63-92de-6be68f366800 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Neutron security group 0791aeaf-0e0e-440c-937a-653948ed0792 not found {{(pid=125862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 14:44:10.111201 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-ef13063c-dc08-4a63-92de-6be68f366800 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist Jun 16 14:44:10.111201 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-5d52f03c-5d7d-4427-a477-42293d984e17'] Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ef13063c-dc08-4a63-92de-6be68f366800 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/os-security-groups/0791aeaf-0e0e-440c-937a-653948ed0792 HTTP/1.1 Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:44:10.114108 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:44:10.121639 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:44:10.121639 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:10.121639 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:10.121639 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:10.121639 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:10.121639 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:44:10.121639 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:44:10.121639 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:44:10.121639 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:10.121639 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:44:10.121639 n-d-836830-4 devstack@n-api.service[125862]: exception: Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist Jun 16 14:44:10.121639 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-5d52f03c-5d7d-4427-a477-42293d984e17'] Jun 16 14:44:10.121639 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '0791aeaf-0e0e-440c-937a-653948ed0792'} Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:10.123436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d52f03c-5d7d-4427-a477-42293d984e17'] Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 14:44:10.126133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d52f03c-5d7d-4427-a477-42293d984e17'] Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d52f03c-5d7d-4427-a477-42293d984e17'] Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:10.128650 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:10.138874 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:10.138874 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:10.138874 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:10.138874 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:10.138874 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist Jun 16 14:44:10.138874 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d52f03c-5d7d-4427-a477-42293d984e17'] Jun 16 14:44:10.138874 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:10.138874 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ef13063c-dc08-4a63-92de-6be68f366800 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 404 to user: Security group 0791aeaf-0e0e-440c-937a-653948ed0792 does not exist Jun 16 14:44:10.138874 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-5d52f03c-5d7d-4427-a477-42293d984e17'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:10.138874 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ef13063c-dc08-4a63-92de-6be68f366800 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/0791aeaf-0e0e-440c-937a-653948ed0792" status: 404 len: 194 microversion: 2.1 time: 0.162915 Jun 16 14:44:10.138874 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 684/1344] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:44:09 2022] DELETE /compute/v2.1/os-security-groups/0791aeaf-0e0e-440c-937a-653948ed0792 => generated 194 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:44:10.143972 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-b08b72f1-9ce6-4bca-8100-a770449cd7a3 req-9b4e1b0e-8266-4bfc-9865-abb28f4fb8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dce7bf2-76fb-41fc-b977-92c5ee0c31de", "name": "network-vif-deleted", "tag": "59492a60-f926-414e-9a00-833130ddba76"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:10.174568 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-b08b72f1-9ce6-4bca-8100-a770449cd7a3 req-9b4e1b0e-8266-4bfc-9865-abb28f4fb8c4 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:10.178287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-b08b72f1-9ce6-4bca-8100-a770449cd7a3 req-9b4e1b0e-8266-4bfc-9865-abb28f4fb8c4 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:10.216481 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-b08b72f1-9ce6-4bca-8100-a770449cd7a3 req-9b4e1b0e-8266-4bfc-9865-abb28f4fb8c4 service nova] Creating event network-vif-deleted:59492a60-f926-414e-9a00-833130ddba76 for instance 2dce7bf2-76fb-41fc-b977-92c5ee0c31de on n-h1-836830-4 Jun 16 14:44:10.230184 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-b08b72f1-9ce6-4bca-8100-a770449cd7a3 req-9b4e1b0e-8266-4bfc-9865-abb28f4fb8c4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109332 Jun 16 14:44:10.235465 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 685/1345] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:10.248054 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bb6da016-787c-49c7-a50a-f3f0d887881a tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:10.252707 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bb6da016-787c-49c7-a50a-f3f0d887881a tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:10.269449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bb6da016-787c-49c7-a50a-f3f0d887881a tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:10.272518 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bb6da016-787c-49c7-a50a-f3f0d887881a tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:10.276267 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bb6da016-787c-49c7-a50a-f3f0d887881a tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:10.277778 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bb6da016-787c-49c7-a50a-f3f0d887881a tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:10.441202 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bb6da016-787c-49c7-a50a-f3f0d887881a tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:10.447890 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bb6da016-787c-49c7-a50a-f3f0d887881a tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:10.448822 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-bb6da016-787c-49c7-a50a-f3f0d887881a tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lazy-loading 'fault' on Instance uuid 2dce7bf2-76fb-41fc-b977-92c5ee0c31de {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:44:10.458005 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-15399346-097a-40ac-b160-a2e536e640ae tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:10.491392 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-15399346-097a-40ac-b160-a2e536e640ae tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 200 len: 1427 microversion: 2.1 time: 0.487271 Jun 16 14:44:10.498226 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 661/1346] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:09 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 1427 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:10.530695 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-15390166-5118-4b56-af5b-910d668d127d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:10.533241 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-15390166-5118-4b56-af5b-910d668d127d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:10.571953 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15390166-5118-4b56-af5b-910d668d127d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:10.577028 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15390166-5118-4b56-af5b-910d668d127d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:10.579054 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15390166-5118-4b56-af5b-910d668d127d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:10.580245 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15390166-5118-4b56-af5b-910d668d127d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:10.716614 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bb6da016-787c-49c7-a50a-f3f0d887881a tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0081c3e617394557a0eab45883186c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7a1522e65c4da888c7823ce928a7b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:10.737013 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bb6da016-787c-49c7-a50a-f3f0d887881a tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 200 len: 1321 microversion: 2.1 time: 0.497603 Jun 16 14:44:10.741002 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 686/1347] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:10 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 1321 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:10.758219 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-73aa0612-63ed-45f4-a5c6-0075742706fc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] Calling method '.version_select at 0x7fdeffe86c10>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:10.844820 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-73aa0612-63ed-45f4-a5c6-0075742706fc tempest-VolumesAdminNegativeTest-1430161518 tempest-VolumesAdminNegativeTest-1430161518-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-655384762" status: 202 len: 0 microversion: 2.1 time: 0.101202 Jun 16 14:44:10.846495 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 687/1348] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jun 16 14:44:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-655384762 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:44:10.855844 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9c48ee9a-d32f-465d-874f-f7064e2e0aff tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdeffdadee0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:11.061318 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:11.253618 n-d-836830-4 devstack@n-api.service[125862]: DEBUG neutronclient.v2_0.client [None req-9c48ee9a-d32f-465d-874f-f7064e2e0aff tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist", "detail": ""}} {{(pid=125862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:44:11.257783 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.security_group_api [None req-9c48ee9a-d32f-465d-874f-f7064e2e0aff tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Neutron security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b not found {{(pid=125862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 14:44:11.260314 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-9c48ee9a-d32f-465d-874f-f7064e2e0aff tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist Jun 16 14:44:11.260314 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-83e29928-c86b-45f6-8eb4-ca2e5f272df6'] Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9c48ee9a-d32f-465d-874f-f7064e2e0aff tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/os-security-groups/93f158b7-1d87-46d2-b72a-c4045aee0f7b HTTP/1.1 Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:44:11.274646 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:44:11.277348 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:44:11.277348 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:11.277348 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:11.277348 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:11.277348 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:11.277348 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:44:11.277348 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:44:11.277348 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:44:11.277348 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:11.277348 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:44:11.277348 n-d-836830-4 devstack@n-api.service[125862]: exception: Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist Jun 16 14:44:11.277348 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-83e29928-c86b-45f6-8eb4-ca2e5f272df6'] Jun 16 14:44:11.277348 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '93f158b7-1d87-46d2-b72a-c4045aee0f7b'} Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:11.281329 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83e29928-c86b-45f6-8eb4-ca2e5f272df6'] Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 14:44:11.287135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83e29928-c86b-45f6-8eb4-ca2e5f272df6'] Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83e29928-c86b-45f6-8eb4-ca2e5f272df6'] Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:11.294326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:11.299272 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:11.299272 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:11.299272 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:11.299272 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:11.299272 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist Jun 16 14:44:11.299272 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83e29928-c86b-45f6-8eb4-ca2e5f272df6'] Jun 16 14:44:11.299272 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:11.299272 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9c48ee9a-d32f-465d-874f-f7064e2e0aff tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 404 to user: Security group 93f158b7-1d87-46d2-b72a-c4045aee0f7b does not exist Jun 16 14:44:11.299272 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-83e29928-c86b-45f6-8eb4-ca2e5f272df6'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:11.304597 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9c48ee9a-d32f-465d-874f-f7064e2e0aff tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/93f158b7-1d87-46d2-b72a-c4045aee0f7b" status: 404 len: 194 microversion: 2.1 time: 0.454872 Jun 16 14:44:11.311529 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 688/1349] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:44:10 2022] DELETE /compute/v2.1/os-security-groups/93f158b7-1d87-46d2-b72a-c4045aee0f7b => generated 194 bytes in 463 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:44:11.339301 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-ba4bf417-2e38-4871-a1d8-990fa320c7ee req-94044cc0-df5a-4370-8eb9-59c354a03635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b", "name": "network-vif-deleted", "tag": "eabf5bdc-af0f-48b9-8cab-200ee753d374"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:11.356053 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-ba4bf417-2e38-4871-a1d8-990fa320c7ee req-94044cc0-df5a-4370-8eb9-59c354a03635 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:11.357535 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-ba4bf417-2e38-4871-a1d8-990fa320c7ee req-94044cc0-df5a-4370-8eb9-59c354a03635 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:11.372951 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-ba4bf417-2e38-4871-a1d8-990fa320c7ee req-94044cc0-df5a-4370-8eb9-59c354a03635 service nova] Creating event network-vif-deleted:eabf5bdc-af0f-48b9-8cab-200ee753d374 for instance 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b on n-h1-836830-4 Jun 16 14:44:11.380692 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-ba4bf417-2e38-4871-a1d8-990fa320c7ee req-94044cc0-df5a-4370-8eb9-59c354a03635 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064760 Jun 16 14:44:11.382112 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 689/1350] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:11.391849 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-215c63ef-6d18-450a-8a93-5a1e2b51bbfe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:11.393212 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-215c63ef-6d18-450a-8a93-5a1e2b51bbfe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:11.403046 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-215c63ef-6d18-450a-8a93-5a1e2b51bbfe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:11.403960 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-215c63ef-6d18-450a-8a93-5a1e2b51bbfe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:11.405062 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-215c63ef-6d18-450a-8a93-5a1e2b51bbfe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:11.406057 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-215c63ef-6d18-450a-8a93-5a1e2b51bbfe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:11.591572 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-15390166-5118-4b56-af5b-910d668d127d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:11.635172 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-15390166-5118-4b56-af5b-910d668d127d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:11.646335 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-15390166-5118-4b56-af5b-910d668d127d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:11.651601 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-15390166-5118-4b56-af5b-910d668d127d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 1.150501 Jun 16 14:44:11.656282 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 662/1351] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:10 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:11.681887 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-53423340-7e94-4552-9759-f69f2e42ba1f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:11.683244 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-53423340-7e94-4552-9759-f69f2e42ba1f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:11.704923 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53423340-7e94-4552-9759-f69f2e42ba1f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:11.705748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53423340-7e94-4552-9759-f69f2e42ba1f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:11.714392 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53423340-7e94-4552-9759-f69f2e42ba1f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:11.715321 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53423340-7e94-4552-9759-f69f2e42ba1f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:12.141993 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-215c63ef-6d18-450a-8a93-5a1e2b51bbfe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:12.165360 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-215c63ef-6d18-450a-8a93-5a1e2b51bbfe tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1542 microversion: 2.1 time: 0.780743 Jun 16 14:44:12.168050 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 690/1352] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:11 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1542 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:12.186002 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2fe3c0fe-067a-4381-8040-6913d8343592 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffe58310>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:12.401585 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2fe3c0fe-067a-4381-8040-6913d8343592 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.231747 Jun 16 14:44:12.411280 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=8 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:12.415466 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 691/1353] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:12 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:12.446161 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6343d217-5569-49f8-b741-d32a4f3f2fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:12.448367 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6343d217-5569-49f8-b741-d32a4f3f2fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:12.451378 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-53423340-7e94-4552-9759-f69f2e42ba1f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:12.469118 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6343d217-5569-49f8-b741-d32a4f3f2fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:12.471833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6343d217-5569-49f8-b741-d32a4f3f2fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:12.474777 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6343d217-5569-49f8-b741-d32a4f3f2fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:12.475673 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6343d217-5569-49f8-b741-d32a4f3f2fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:12.485022 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-53423340-7e94-4552-9759-f69f2e42ba1f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1210 microversion: 2.1 time: 0.818778 Jun 16 14:44:12.502567 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 663/1354] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:11 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1210 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:12.512713 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cb83aa2c-ddd3-4291-bb25-6a8971ea5b55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:12.514310 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cb83aa2c-ddd3-4291-bb25-6a8971ea5b55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:12.528150 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cb83aa2c-ddd3-4291-bb25-6a8971ea5b55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:12.529416 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cb83aa2c-ddd3-4291-bb25-6a8971ea5b55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:12.531367 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cb83aa2c-ddd3-4291-bb25-6a8971ea5b55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:12.532469 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cb83aa2c-ddd3-4291-bb25-6a8971ea5b55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:12.547324 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6343d217-5569-49f8-b741-d32a4f3f2fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:44:12.553488 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-cb83aa2c-ddd3-4291-bb25-6a8971ea5b55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] HTTP exception thrown: Instance 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b could not be found. Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cb83aa2c-ddd3-4291-bb25-6a8971ea5b55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Request method failure captured: Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b HTTP/1.1 Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0EJwFYtuFSQfzEOugf63Vz8VMtZLeEeZvKpMnabXfJHY5SLiXs_IpXov3VuZOM86P1fO8H7ooDcDF5GpEwrEgLVyA7IiqKVBVzfcJrVcpKGOsdMcWTLIYziPmCmRNMd75AoLIuoL2-oeQN3qN1Nub1W38a-RFl4I1qjaDXSXxvl070 Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b50858433c774049b7c3fe4a4f98e948 Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersAdminTestJSON-1722745255 Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:44:12.555866 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:44:12.557610 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b50858433c774049b7c3fe4a4f98e948", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b50858433c774049b7c3fe4a4f98e948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b50858433c774049b7c3fe4a4f98e948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b50858433c774049b7c3fe4a4f98e948"}]}] Jun 16 14:44:12.557610 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersAdminTestJSON-1722745255 Jun 16 14:44:12.557610 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b50858433c774049b7c3fe4a4f98e948 Jun 16 14:44:12.557610 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersAdminTestJSON-1722745255 Jun 16 14:44:12.557610 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersAdminTestJSON-1722745255-project Jun 16 14:44:12.557610 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:44:12.557610 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:44:12.557610 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 23594325f9174f3a80dd744eaaaba379 Jun 16 14:44:12.557610 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersAdminTestJSON-1722745255-project Jun 16 14:44:12.557610 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:44:12.557610 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b could not be found. Jun 16 14:44:12.557610 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b'} Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b could not be found. Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:12.559040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b could not be found. Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b could not be found. Jun 16 14:44:12.560709 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:12.563289 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cb83aa2c-ddd3-4291-bb25-6a8971ea5b55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Returning 404 to user: Instance 2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:12.564477 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cb83aa2c-ddd3-4291-bb25-6a8971ea5b55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b" status: 404 len: 111 microversion: 2.1 time: 0.059345 Jun 16 14:44:12.565395 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 664/1355] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:12 2022] GET /compute/v2.1/servers/2d8b0396-6f79-43a0-83ec-3c17c7ce9e7b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:44:12.572224 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-59cd4003-e538-4466-8a70-350fc82b51bc tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:12.573225 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-59cd4003-e538-4466-8a70-350fc82b51bc tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] [instance: 2dce7bf2-76fb-41fc-b977-92c5ee0c31de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:12.580739 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-59cd4003-e538-4466-8a70-350fc82b51bc tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:12.581562 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-59cd4003-e538-4466-8a70-350fc82b51bc tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:12.583752 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-59cd4003-e538-4466-8a70-350fc82b51bc tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:12.584465 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-59cd4003-e538-4466-8a70-350fc82b51bc tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:12.604042 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-59cd4003-e538-4466-8a70-350fc82b51bc tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] HTTP exception thrown: Instance 2dce7bf2-76fb-41fc-b977-92c5ee0c31de could not be found. Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-59cd4003-e538-4466-8a70-350fc82b51bc tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Request method failure captured: Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de HTTP/1.1 Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0FqxZwOqV9pFM5xjuOTxjAK7HFJ6UqhHqwGUPJVF2mDSymRNTEA-AIrTAT9gdfI_37HQt_ZOjNG2CIlkbX9XxOjBDr51nBFTNusWdRAdQjRW1Pt8oBTrbTUB8ElV9ZXscdfi-T3RkcagYLxulu9G2YsPERE-0MjpFtURyqqRplkBR0 Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 2e7a1522e65c4da888c7823ce928a7b7 Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-838742123 Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:44:12.605975 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:44:12.607671 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2e7a1522e65c4da888c7823ce928a7b7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e7a1522e65c4da888c7823ce928a7b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2e7a1522e65c4da888c7823ce928a7b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2e7a1522e65c4da888c7823ce928a7b7"}]}] Jun 16 14:44:12.607671 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-838742123 Jun 16 14:44:12.607671 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 2e7a1522e65c4da888c7823ce928a7b7 Jun 16 14:44:12.607671 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-838742123 Jun 16 14:44:12.607671 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project Jun 16 14:44:12.607671 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:44:12.607671 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:44:12.607671 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 0081c3e617394557a0eab45883186c09 Jun 16 14:44:12.607671 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project Jun 16 14:44:12.607671 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:44:12.607671 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 2dce7bf2-76fb-41fc-b977-92c5ee0c31de could not be found. Jun 16 14:44:12.607671 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '2dce7bf2-76fb-41fc-b977-92c5ee0c31de'} Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dce7bf2-76fb-41fc-b977-92c5ee0c31de could not be found. Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:12.608524 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dce7bf2-76fb-41fc-b977-92c5ee0c31de could not be found. Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dce7bf2-76fb-41fc-b977-92c5ee0c31de could not be found. Jun 16 14:44:12.609882 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:12.612428 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-59cd4003-e538-4466-8a70-350fc82b51bc tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] Returning 404 to user: Instance 2dce7bf2-76fb-41fc-b977-92c5ee0c31de could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:12.613896 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-59cd4003-e538-4466-8a70-350fc82b51bc tempest-FloatingIPsAssociationNegativeTestJSON-838742123 tempest-FloatingIPsAssociationNegativeTestJSON-838742123-project] 10.222.0.57 "GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de" status: 404 len: 111 microversion: 2.1 time: 0.046890 Jun 16 14:44:12.620128 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 665/1356] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:12 2022] GET /compute/v2.1/servers/2dce7bf2-76fb-41fc-b977-92c5ee0c31de => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:44:12.626916 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-1d32b699-9745-4cae-8093-3df05a7535d9 req-7a5c7ac6-64f5-4134-a225-888702e7c0ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "044b8b3a-db26-450b-b770-6134060ded1c", "name": "network-vif-plugged", "status": "completed", "tag": "ed657ed2-678a-4297-b198-f02f59e7a238"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:12.637414 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-1d32b699-9745-4cae-8093-3df05a7535d9 req-7a5c7ac6-64f5-4134-a225-888702e7c0ab service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:12.638216 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-1d32b699-9745-4cae-8093-3df05a7535d9 req-7a5c7ac6-64f5-4134-a225-888702e7c0ab service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:12.664157 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-1d32b699-9745-4cae-8093-3df05a7535d9 req-7a5c7ac6-64f5-4134-a225-888702e7c0ab service nova] Creating event network-vif-plugged:ed657ed2-678a-4297-b198-f02f59e7a238 for instance 044b8b3a-db26-450b-b770-6134060ded1c on n-h2-836830-4 Jun 16 14:44:12.678621 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-1d32b699-9745-4cae-8093-3df05a7535d9 req-7a5c7ac6-64f5-4134-a225-888702e7c0ab service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053800 Jun 16 14:44:12.680637 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 666/1357] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:12.695364 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-f67ee26a-dc46-46dd-812f-615ebcb779dd req-4b5d6d32-5768-42fb-a4d7-73ebf0e664f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4855363-724b-4eff-a76e-915e440af995", "name": "network-vif-unplugged", "status": "completed", "tag": "f4722aca-79de-427f-b18d-882b6697a114"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:12.714543 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-f67ee26a-dc46-46dd-812f-615ebcb779dd req-4b5d6d32-5768-42fb-a4d7-73ebf0e664f6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:12.715742 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-f67ee26a-dc46-46dd-812f-615ebcb779dd req-4b5d6d32-5768-42fb-a4d7-73ebf0e664f6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:12.762063 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-f67ee26a-dc46-46dd-812f-615ebcb779dd req-4b5d6d32-5768-42fb-a4d7-73ebf0e664f6 service nova] Creating event network-vif-unplugged:f4722aca-79de-427f-b18d-882b6697a114 for instance e4855363-724b-4eff-a76e-915e440af995 on n-h2-836830-4 Jun 16 14:44:12.795923 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-f67ee26a-dc46-46dd-812f-615ebcb779dd req-4b5d6d32-5768-42fb-a4d7-73ebf0e664f6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105869 Jun 16 14:44:12.800531 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 667/1358] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:12.844447 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2286e38c-96cc-466a-b1ab-f6ad2a145d09 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:12.855021 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2286e38c-96cc-466a-b1ab-f6ad2a145d09 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:12.878840 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2286e38c-96cc-466a-b1ab-f6ad2a145d09 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:12.880932 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2286e38c-96cc-466a-b1ab-f6ad2a145d09 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:12.883454 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2286e38c-96cc-466a-b1ab-f6ad2a145d09 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:12.897744 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6343d217-5569-49f8-b741-d32a4f3f2fe0 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 204 len: 0 microversion: 2.1 time: 0.478265 Jun 16 14:44:12.903332 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 692/1359] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:44:12 2022] DELETE /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:12.905432 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2286e38c-96cc-466a-b1ab-f6ad2a145d09 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:12.942021 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5bd1c51c-b87b-4310-92c4-296e25930a14 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:12.948953 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5bd1c51c-b87b-4310-92c4-296e25930a14 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:12.973715 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5bd1c51c-b87b-4310-92c4-296e25930a14 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:12.974360 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5bd1c51c-b87b-4310-92c4-296e25930a14 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:12.977675 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5bd1c51c-b87b-4310-92c4-296e25930a14 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:12.978394 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5bd1c51c-b87b-4310-92c4-296e25930a14 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:13.025510 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2286e38c-96cc-466a-b1ab-f6ad2a145d09 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:44:13.110497 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:13.257541 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2286e38c-96cc-466a-b1ab-f6ad2a145d09 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 204 len: 0 microversion: 2.1 time: 0.437339 Jun 16 14:44:13.259024 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 668/1360] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:44:12 2022] DELETE /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:13.265597 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9cc41f6a-1c42-40b2-94fc-4ea03a05b3d5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:13.268488 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9cc41f6a-1c42-40b2-94fc-4ea03a05b3d5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:13.285307 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9cc41f6a-1c42-40b2-94fc-4ea03a05b3d5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:13.287082 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9cc41f6a-1c42-40b2-94fc-4ea03a05b3d5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:13.291120 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9cc41f6a-1c42-40b2-94fc-4ea03a05b3d5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:13.291746 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9cc41f6a-1c42-40b2-94fc-4ea03a05b3d5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:14.266200 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9cc41f6a-1c42-40b2-94fc-4ea03a05b3d5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:14.279014 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9cc41f6a-1c42-40b2-94fc-4ea03a05b3d5 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 200 len: 1648 microversion: 2.1 time: 1.018486 Jun 16 14:44:14.288076 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 669/1361] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:13 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 1648 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:14.312908 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a2d2456b-f857-4484-b41e-fbc7199d79e6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:14.314211 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a2d2456b-f857-4484-b41e-fbc7199d79e6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:14.329208 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a2d2456b-f857-4484-b41e-fbc7199d79e6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:14.330253 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a2d2456b-f857-4484-b41e-fbc7199d79e6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:14.331659 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a2d2456b-f857-4484-b41e-fbc7199d79e6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:14.333573 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a2d2456b-f857-4484-b41e-fbc7199d79e6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:14.685116 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5bd1c51c-b87b-4310-92c4-296e25930a14 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:14.697832 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5bd1c51c-b87b-4310-92c4-296e25930a14 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:14.710581 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5bd1c51c-b87b-4310-92c4-296e25930a14 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:14.712781 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5bd1c51c-b87b-4310-92c4-296e25930a14 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 1.806007 Jun 16 14:44:14.715521 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 693/1362] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:12 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:14.723898 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-261d16bd-dfe7-4d71-b7aa-5fbbd5031a55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:14.739769 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-261d16bd-dfe7-4d71-b7aa-5fbbd5031a55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:14.747899 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-261d16bd-dfe7-4d71-b7aa-5fbbd5031a55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:14.748782 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-261d16bd-dfe7-4d71-b7aa-5fbbd5031a55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:14.749885 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-261d16bd-dfe7-4d71-b7aa-5fbbd5031a55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:14.750616 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-261d16bd-dfe7-4d71-b7aa-5fbbd5031a55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:14.943897 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a2d2456b-f857-4484-b41e-fbc7199d79e6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:14.992360 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a2d2456b-f857-4484-b41e-fbc7199d79e6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1542 microversion: 2.1 time: 0.700479 Jun 16 14:44:14.993489 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 670/1363] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:14 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1542 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:15.029264 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2b4e2bbf-69c3-475c-a5e0-5891c58eac69 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c861280>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:15.173051 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2b4e2bbf-69c3-475c-a5e0-5891c58eac69 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.170847 Jun 16 14:44:15.192647 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 671/1364] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:14 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:15.220516 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a7ccf799-ceaa-4256-bfd4-9e860e450ef5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:15.236533 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a7ccf799-ceaa-4256-bfd4-9e860e450ef5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:15.259842 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7ccf799-ceaa-4256-bfd4-9e860e450ef5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:15.261796 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7ccf799-ceaa-4256-bfd4-9e860e450ef5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:15.265206 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7ccf799-ceaa-4256-bfd4-9e860e450ef5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:15.266601 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7ccf799-ceaa-4256-bfd4-9e860e450ef5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:15.699486 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a7ccf799-ceaa-4256-bfd4-9e860e450ef5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:15.719967 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a7ccf799-ceaa-4256-bfd4-9e860e450ef5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1210 microversion: 2.1 time: 0.523771 Jun 16 14:44:15.731033 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 672/1365] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:15 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1210 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:15.733347 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-ca7923d6-9a91-4d07-8bd9-ac297e894661 req-328ff410-da49-46b2-8d9b-87fef8e6b176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4855363-724b-4eff-a76e-915e440af995", "tag": "f4722aca-79de-427f-b18d-882b6697a114"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:15.753710 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-ca7923d6-9a91-4d07-8bd9-ac297e894661 req-328ff410-da49-46b2-8d9b-87fef8e6b176 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:15.756092 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-ca7923d6-9a91-4d07-8bd9-ac297e894661 req-328ff410-da49-46b2-8d9b-87fef8e6b176 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:15.786625 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-ca7923d6-9a91-4d07-8bd9-ac297e894661 req-328ff410-da49-46b2-8d9b-87fef8e6b176 service nova] Creating event network-changed:f4722aca-79de-427f-b18d-882b6697a114 for instance e4855363-724b-4eff-a76e-915e440af995 on n-h2-836830-4 Jun 16 14:44:15.799039 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-ca7923d6-9a91-4d07-8bd9-ac297e894661 req-328ff410-da49-46b2-8d9b-87fef8e6b176 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073893 Jun 16 14:44:15.807355 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 673/1366] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:15.820755 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e352b196-bc43-41bf-ae03-8b3731c23b8f tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:15.823131 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e352b196-bc43-41bf-ae03-8b3731c23b8f tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:15.837383 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e352b196-bc43-41bf-ae03-8b3731c23b8f tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:15.838242 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e352b196-bc43-41bf-ae03-8b3731c23b8f tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:15.839722 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e352b196-bc43-41bf-ae03-8b3731c23b8f tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:15.841585 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e352b196-bc43-41bf-ae03-8b3731c23b8f tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:15.996200 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-261d16bd-dfe7-4d71-b7aa-5fbbd5031a55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:16.005831 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-261d16bd-dfe7-4d71-b7aa-5fbbd5031a55 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1468 microversion: 2.1 time: 1.288241 Jun 16 14:44:16.021796 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 694/1367] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:14 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1468 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:16.027246 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e5a0c40b-bafc-403b-a789-c6dd8d3cd0eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:16.028273 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e5a0c40b-bafc-403b-a789-c6dd8d3cd0eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:16.050886 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e5a0c40b-bafc-403b-a789-c6dd8d3cd0eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:16.052422 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e5a0c40b-bafc-403b-a789-c6dd8d3cd0eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:16.053621 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e5a0c40b-bafc-403b-a789-c6dd8d3cd0eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:16.054440 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e5a0c40b-bafc-403b-a789-c6dd8d3cd0eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:16.573166 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e352b196-bc43-41bf-ae03-8b3731c23b8f tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:16.602478 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e352b196-bc43-41bf-ae03-8b3731c23b8f tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 200 len: 1648 microversion: 2.1 time: 0.792589 Jun 16 14:44:16.604404 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 674/1368] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:15 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 1648 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:16.624833 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c6bda24c-de44-4c12-af9b-fda0929f6402 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:16.626511 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c6bda24c-de44-4c12-af9b-fda0929f6402 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:16.650429 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c6bda24c-de44-4c12-af9b-fda0929f6402 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:16.656435 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c6bda24c-de44-4c12-af9b-fda0929f6402 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:16.663987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c6bda24c-de44-4c12-af9b-fda0929f6402 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:16.666337 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c6bda24c-de44-4c12-af9b-fda0929f6402 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:17.538991 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c6bda24c-de44-4c12-af9b-fda0929f6402 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:17.560522 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c6bda24c-de44-4c12-af9b-fda0929f6402 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1542 microversion: 2.1 time: 0.953782 Jun 16 14:44:17.561832 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 675/1369] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:16 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1542 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:17.590079 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-996e7522-38a9-4740-8d52-f0486a6e0032 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c38eb80>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:17.720277 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-996e7522-38a9-4740-8d52-f0486a6e0032 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.139512 Jun 16 14:44:17.722873 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 676/1370] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:17 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:17.731750 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7270da09-4543-4919-a471-e0d22145803f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:17.733259 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7270da09-4543-4919-a471-e0d22145803f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:17.773185 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7270da09-4543-4919-a471-e0d22145803f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:17.782544 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7270da09-4543-4919-a471-e0d22145803f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:17.784326 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7270da09-4543-4919-a471-e0d22145803f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:17.788569 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7270da09-4543-4919-a471-e0d22145803f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:18.164183 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e5a0c40b-bafc-403b-a789-c6dd8d3cd0eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:18.198068 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e5a0c40b-bafc-403b-a789-c6dd8d3cd0eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:18.215910 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e5a0c40b-bafc-403b-a789-c6dd8d3cd0eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:18.228383 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e5a0c40b-bafc-403b-a789-c6dd8d3cd0eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 2.195502 Jun 16 14:44:18.229698 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 695/1371] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:16 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:18.233966 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7270da09-4543-4919-a471-e0d22145803f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:18.258339 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cf9c7284-34c3-4d36-989e-61bf6da25ad8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:18.263417 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cf9c7284-34c3-4d36-989e-61bf6da25ad8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:18.276776 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7270da09-4543-4919-a471-e0d22145803f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1210 microversion: 2.1 time: 0.552576 Jun 16 14:44:18.279773 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 677/1372] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:17 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1210 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:18.303863 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e27cc7a1-f0ad-4f95-820a-fece7f3b4da6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:18.304979 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e27cc7a1-f0ad-4f95-820a-fece7f3b4da6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:18.307152 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf9c7284-34c3-4d36-989e-61bf6da25ad8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:18.308522 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf9c7284-34c3-4d36-989e-61bf6da25ad8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:18.313806 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf9c7284-34c3-4d36-989e-61bf6da25ad8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:18.315065 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf9c7284-34c3-4d36-989e-61bf6da25ad8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:18.355366 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e27cc7a1-f0ad-4f95-820a-fece7f3b4da6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:18.356267 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e27cc7a1-f0ad-4f95-820a-fece7f3b4da6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:18.370120 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e27cc7a1-f0ad-4f95-820a-fece7f3b4da6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:18.370914 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e27cc7a1-f0ad-4f95-820a-fece7f3b4da6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:18.530804 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:18.534423 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e27cc7a1-f0ad-4f95-820a-fece7f3b4da6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:18.536469 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e27cc7a1-f0ad-4f95-820a-fece7f3b4da6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:18.537130 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-e27cc7a1-f0ad-4f95-820a-fece7f3b4da6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lazy-loading 'fault' on Instance uuid 512e2984-9834-496e-b3a6-085dc29a58a2 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:44:18.650592 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e27cc7a1-f0ad-4f95-820a-fece7f3b4da6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669878ef64c4cb982dee4369c88e832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '070acceac9dc494481baedda1baf5740', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:18.688960 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e27cc7a1-f0ad-4f95-820a-fece7f3b4da6 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 200 len: 1305 microversion: 2.1 time: 0.408180 Jun 16 14:44:18.693216 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 678/1373] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:18 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 1305 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:18.715969 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-4de08396-7253-4db7-83a3-99fc768288e3 req-5e228051-68fa-4e97-81e2-925165c18e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512e2984-9834-496e-b3a6-085dc29a58a2", "name": "network-vif-deleted", "tag": "6427fc84-9f0c-4e17-abd5-21b7c6824b81"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:18.744364 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-4de08396-7253-4db7-83a3-99fc768288e3 req-5e228051-68fa-4e97-81e2-925165c18e51 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:18.758164 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-4de08396-7253-4db7-83a3-99fc768288e3 req-5e228051-68fa-4e97-81e2-925165c18e51 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:18.809284 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-4de08396-7253-4db7-83a3-99fc768288e3 req-5e228051-68fa-4e97-81e2-925165c18e51 service nova] Creating event network-vif-deleted:6427fc84-9f0c-4e17-abd5-21b7c6824b81 for instance 512e2984-9834-496e-b3a6-085dc29a58a2 on n-h2-836830-4 Jun 16 14:44:18.829218 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-4de08396-7253-4db7-83a3-99fc768288e3 req-5e228051-68fa-4e97-81e2-925165c18e51 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125461 Jun 16 14:44:18.853576 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 679/1374] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:18.867763 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7da05460-355b-46e8-b0b0-4fddeb9529ba tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:18.868999 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7da05460-355b-46e8-b0b0-4fddeb9529ba tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:18.880474 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7da05460-355b-46e8-b0b0-4fddeb9529ba tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:18.880474 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7da05460-355b-46e8-b0b0-4fddeb9529ba tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:18.881494 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7da05460-355b-46e8-b0b0-4fddeb9529ba tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:18.881648 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7da05460-355b-46e8-b0b0-4fddeb9529ba tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:19.114583 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7da05460-355b-46e8-b0b0-4fddeb9529ba tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:19.126027 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7da05460-355b-46e8-b0b0-4fddeb9529ba tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1542 microversion: 2.1 time: 0.269582 Jun 16 14:44:19.126769 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 680/1375] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:18 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1542 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:19.150188 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4f3f3473-f5e5-452f-8b49-60c4626a30e1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c9151f0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:19.208329 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4f3f3473-f5e5-452f-8b49-60c4626a30e1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.065575 Jun 16 14:44:19.209529 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 681/1376] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:19 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:19.248711 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-07c2f363-f8c0-42bd-89ac-f7280d1d9284 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:19.249522 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-07c2f363-f8c0-42bd-89ac-f7280d1d9284 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:19.256784 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-07c2f363-f8c0-42bd-89ac-f7280d1d9284 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:19.257291 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-07c2f363-f8c0-42bd-89ac-f7280d1d9284 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:19.258252 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-07c2f363-f8c0-42bd-89ac-f7280d1d9284 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:19.258740 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-07c2f363-f8c0-42bd-89ac-f7280d1d9284 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:19.530412 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-07c2f363-f8c0-42bd-89ac-f7280d1d9284 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:19.549194 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-07c2f363-f8c0-42bd-89ac-f7280d1d9284 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:19.550916 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-07c2f363-f8c0-42bd-89ac-f7280d1d9284 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:19.552978 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-07c2f363-f8c0-42bd-89ac-f7280d1d9284 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.308028 Jun 16 14:44:19.570305 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 682/1377] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:19 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:44:19.581381 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f288a284-a6b6-4a92-98e0-80c616d10edd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:19.582791 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f288a284-a6b6-4a92-98e0-80c616d10edd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:19.602648 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f288a284-a6b6-4a92-98e0-80c616d10edd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:19.603137 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f288a284-a6b6-4a92-98e0-80c616d10edd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:19.603940 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f288a284-a6b6-4a92-98e0-80c616d10edd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:19.604389 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f288a284-a6b6-4a92-98e0-80c616d10edd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:20.165709 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cf9c7284-34c3-4d36-989e-61bf6da25ad8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:20.225686 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cf9c7284-34c3-4d36-989e-61bf6da25ad8 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1468 microversion: 2.1 time: 1.988508 Jun 16 14:44:20.230456 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 696/1378] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:18 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1468 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:20.250939 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ae1956e1-85aa-4ae4-a4f5-20667cf07d34 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:20.252131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ae1956e1-85aa-4ae4-a4f5-20667cf07d34 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] [instance: 512e2984-9834-496e-b3a6-085dc29a58a2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:20.272465 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ae1956e1-85aa-4ae4-a4f5-20667cf07d34 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:20.275052 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ae1956e1-85aa-4ae4-a4f5-20667cf07d34 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:20.277546 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ae1956e1-85aa-4ae4-a4f5-20667cf07d34 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:20.282810 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f288a284-a6b6-4a92-98e0-80c616d10edd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:20.291975 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ae1956e1-85aa-4ae4-a4f5-20667cf07d34 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:20.303086 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f288a284-a6b6-4a92-98e0-80c616d10edd tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1210 microversion: 2.1 time: 0.731058 Jun 16 14:44:20.304372 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 683/1379] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:19 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1210 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:20.344790 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-bdb112a7-5940-4a97-a49f-f5c84fa35d23 req-bcb33dc1-4555-4d23-ae67-8b306c461a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d49ca2-5a83-4054-bedf-0c06897d6b07", "tag": "ad00f43d-1679-420a-90e5-decadf4b3c3e"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:20.355039 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-ae1956e1-85aa-4ae4-a4f5-20667cf07d34 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] HTTP exception thrown: Instance 512e2984-9834-496e-b3a6-085dc29a58a2 could not be found. Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ae1956e1-85aa-4ae4-a4f5-20667cf07d34 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Request method failure captured: Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 HTTP/1.1 Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0ExDwQ89RnANaUWeBm8rVP_BWRGeqxbpX4qB4-2ccS4nc43e7Ili0WclGnImraEMZily-eDR8hy-BtCtAI2Kx2p_3cD-6sDD_QSVuRfYr4ijSYYZi0RLs8s4Waq3Mx4Sq7dbRkXZHEX1Z0bCCyGpCS0yyJUQXuTJfNfo48VBPkwfmU Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:44:20.357687 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:44:20.359289 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_070acceac9dc494481baedda1baf5740", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/070acceac9dc494481baedda1baf5740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/070acceac9dc494481baedda1baf5740"}]}] Jun 16 14:44:20.359289 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:20.359289 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 070acceac9dc494481baedda1baf5740 Jun 16 14:44:20.359289 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-650967224 Jun 16 14:44:20.359289 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:20.359289 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:44:20.359289 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:44:20.359289 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 9669878ef64c4cb982dee4369c88e832 Jun 16 14:44:20.359289 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupsTestJSON-650967224-project Jun 16 14:44:20.359289 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:44:20.359289 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 512e2984-9834-496e-b3a6-085dc29a58a2 could not be found. Jun 16 14:44:20.359289 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '512e2984-9834-496e-b3a6-085dc29a58a2'} Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512e2984-9834-496e-b3a6-085dc29a58a2 could not be found. Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:20.360107 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512e2984-9834-496e-b3a6-085dc29a58a2 could not be found. Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512e2984-9834-496e-b3a6-085dc29a58a2 could not be found. Jun 16 14:44:20.361457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:44:20.366323 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ae1956e1-85aa-4ae4-a4f5-20667cf07d34 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Returning 404 to user: Instance 512e2984-9834-496e-b3a6-085dc29a58a2 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:20.367828 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ae1956e1-85aa-4ae4-a4f5-20667cf07d34 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2" status: 404 len: 111 microversion: 2.1 time: 0.131666 Jun 16 14:44:20.369076 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 697/1380] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:20 2022] GET /compute/v2.1/servers/512e2984-9834-496e-b3a6-085dc29a58a2 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:44:20.376480 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-04c1f30f-e138-4945-a220-00fce76d5e65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:20.377909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-04c1f30f-e138-4945-a220-00fce76d5e65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:20.386581 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-04c1f30f-e138-4945-a220-00fce76d5e65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:20.387463 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-04c1f30f-e138-4945-a220-00fce76d5e65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:20.387991 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-bdb112a7-5940-4a97-a49f-f5c84fa35d23 req-bcb33dc1-4555-4d23-ae67-8b306c461a40 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:20.388464 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-bdb112a7-5940-4a97-a49f-f5c84fa35d23 req-bcb33dc1-4555-4d23-ae67-8b306c461a40 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:20.389184 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-04c1f30f-e138-4945-a220-00fce76d5e65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:20.389864 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-04c1f30f-e138-4945-a220-00fce76d5e65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:20.416230 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-bdb112a7-5940-4a97-a49f-f5c84fa35d23 req-bcb33dc1-4555-4d23-ae67-8b306c461a40 service nova] Creating event network-changed:ad00f43d-1679-420a-90e5-decadf4b3c3e for instance 34d49ca2-5a83-4054-bedf-0c06897d6b07 on n-h1-836830-4 Jun 16 14:44:20.423051 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:20.428126 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-bdb112a7-5940-4a97-a49f-f5c84fa35d23 req-bcb33dc1-4555-4d23-ae67-8b306c461a40 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108989 Jun 16 14:44:20.435077 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 684/1381] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:20.440871 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-99c032c5-96e7-4544-9636-e7e4bccb8f70 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffb8b0d0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:20.562143 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-99c032c5-96e7-4544-9636-e7e4bccb8f70 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.125493 Jun 16 14:44:20.562787 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 685/1382] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:20 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:20.573191 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6823c86c-a288-400b-9e79-046d1d7d360f tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdf0c2d24c0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:20.977428 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6823c86c-a288-400b-9e79-046d1d7d360f tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/82b71b79-2f44-4ff3-8327-e6767db62a23" status: 202 len: 0 microversion: 2.1 time: 0.413029 Jun 16 14:44:20.979590 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 686/1383] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:44:20 2022] DELETE /compute/v2.1/os-security-groups/82b71b79-2f44-4ff3-8327-e6767db62a23 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:44:20.990207 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4dd5a1c7-4067-42ed-96c9-c7ec23956591 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:20.993744 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4dd5a1c7-4067-42ed-96c9-c7ec23956591 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:21.025297 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4dd5a1c7-4067-42ed-96c9-c7ec23956591 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:21.028984 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4dd5a1c7-4067-42ed-96c9-c7ec23956591 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:21.030816 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4dd5a1c7-4067-42ed-96c9-c7ec23956591 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:21.031482 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4dd5a1c7-4067-42ed-96c9-c7ec23956591 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:21.418852 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4dd5a1c7-4067-42ed-96c9-c7ec23956591 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:21.464501 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4dd5a1c7-4067-42ed-96c9-c7ec23956591 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:21.467899 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4dd5a1c7-4067-42ed-96c9-c7ec23956591 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:21.474836 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4dd5a1c7-4067-42ed-96c9-c7ec23956591 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.493411 Jun 16 14:44:21.484359 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 687/1384] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:20 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:21.506117 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cb40b5fd-0531-41dc-a4dd-bba3bac1e856 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] Calling method '.version_select at 0x7fdeffe10670>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:21.778949 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-04c1f30f-e138-4945-a220-00fce76d5e65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:21.787889 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-04c1f30f-e138-4945-a220-00fce76d5e65 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1542 microversion: 2.1 time: 1.417115 Jun 16 14:44:21.799339 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 698/1385] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:20 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1542 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:21.804866 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-78b881ee-8155-46d7-a9f5-4c51c4749926 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:21.812342 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-78b881ee-8155-46d7-a9f5-4c51c4749926 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:21.821912 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78b881ee-8155-46d7-a9f5-4c51c4749926 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:21.822770 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78b881ee-8155-46d7-a9f5-4c51c4749926 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:21.823803 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78b881ee-8155-46d7-a9f5-4c51c4749926 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:21.824429 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78b881ee-8155-46d7-a9f5-4c51c4749926 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:21.907208 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cb40b5fd-0531-41dc-a4dd-bba3bac1e856 tempest-SecurityGroupsTestJSON-650967224 tempest-SecurityGroupsTestJSON-650967224-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/65d89d10-197e-467b-9b59-7603ac9f99dd" status: 202 len: 0 microversion: 2.1 time: 0.420421 Jun 16 14:44:21.908674 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 688/1386] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:44:21 2022] DELETE /compute/v2.1/os-security-groups/65d89d10-197e-467b-9b59-7603ac9f99dd => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:44:21.916513 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-03ac859c-1e12-464e-a7fa-908ff60b46bf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:21.919746 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-03ac859c-1e12-464e-a7fa-908ff60b46bf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:21.940287 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-03ac859c-1e12-464e-a7fa-908ff60b46bf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:21.941572 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-03ac859c-1e12-464e-a7fa-908ff60b46bf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:21.942771 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-03ac859c-1e12-464e-a7fa-908ff60b46bf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:21.943068 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-03ac859c-1e12-464e-a7fa-908ff60b46bf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:22.229622 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-03ac859c-1e12-464e-a7fa-908ff60b46bf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:22.249650 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-03ac859c-1e12-464e-a7fa-908ff60b46bf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1198 microversion: 2.1 time: 0.338592 Jun 16 14:44:22.264767 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 689/1387] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:21 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1198 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:22.281005 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-28d08482-a6b1-48b7-8134-cd76044cacf1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffb8b9d0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:22.357482 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-28d08482-a6b1-48b7-8134-cd76044cacf1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.090730 Jun 16 14:44:22.369218 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 690/1388] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:22 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:22.518269 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-afbe87f8-d5af-48e0-9c7e-b7d573a79c2c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:22.521771 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-afbe87f8-d5af-48e0-9c7e-b7d573a79c2c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:22.525693 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-78b881ee-8155-46d7-a9f5-4c51c4749926 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:22.536409 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-afbe87f8-d5af-48e0-9c7e-b7d573a79c2c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:22.538553 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-afbe87f8-d5af-48e0-9c7e-b7d573a79c2c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:22.540352 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-afbe87f8-d5af-48e0-9c7e-b7d573a79c2c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:22.541482 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-afbe87f8-d5af-48e0-9c7e-b7d573a79c2c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:22.571282 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-78b881ee-8155-46d7-a9f5-4c51c4749926 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1426 microversion: 2.1 time: 0.770051 Jun 16 14:44:22.577523 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 699/1389] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:21 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1426 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:22.600588 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-91239809-d4bf-43f9-875d-313644b24cd9 req-4bcf2779-72b8-4b00-af00-60e65cefc00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8ac858-0bec-476e-8bd5-0234b252a67f", "name": "network-vif-deleted", "tag": "54c6b864-0c09-49b6-96ef-b067ca450425"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:22.646871 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-91239809-d4bf-43f9-875d-313644b24cd9 req-4bcf2779-72b8-4b00-af00-60e65cefc00e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:22.648495 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-91239809-d4bf-43f9-875d-313644b24cd9 req-4bcf2779-72b8-4b00-af00-60e65cefc00e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:22.675511 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-91239809-d4bf-43f9-875d-313644b24cd9 req-4bcf2779-72b8-4b00-af00-60e65cefc00e service nova] Creating event network-vif-deleted:54c6b864-0c09-49b6-96ef-b067ca450425 for instance 4b8ac858-0bec-476e-8bd5-0234b252a67f on n-h2-836830-4 Jun 16 14:44:22.681183 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-91239809-d4bf-43f9-875d-313644b24cd9 req-4bcf2779-72b8-4b00-af00-60e65cefc00e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101280 Jun 16 14:44:22.682497 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 700/1390] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:22.811728 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-47c2a1c7-d44a-4142-9d22-dde84d1f7a16 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:22.814212 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-47c2a1c7-d44a-4142-9d22-dde84d1f7a16 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:22.822443 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-afbe87f8-d5af-48e0-9c7e-b7d573a79c2c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:22.827647 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-47c2a1c7-d44a-4142-9d22-dde84d1f7a16 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:22.828108 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-47c2a1c7-d44a-4142-9d22-dde84d1f7a16 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:22.829161 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-47c2a1c7-d44a-4142-9d22-dde84d1f7a16 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:22.829973 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-47c2a1c7-d44a-4142-9d22-dde84d1f7a16 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:22.835238 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-afbe87f8-d5af-48e0-9c7e-b7d573a79c2c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:22.837517 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-afbe87f8-d5af-48e0-9c7e-b7d573a79c2c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:22.839373 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-afbe87f8-d5af-48e0-9c7e-b7d573a79c2c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.334984 Jun 16 14:44:22.840621 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 691/1391] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:22 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:23.280795 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-eb61aa3e-4a9f-41af-a281-a3f1f94fb717 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:23.281687 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-eb61aa3e-4a9f-41af-a281-a3f1f94fb717 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:23.298232 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb61aa3e-4a9f-41af-a281-a3f1f94fb717 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:23.298232 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb61aa3e-4a9f-41af-a281-a3f1f94fb717 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:23.306821 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb61aa3e-4a9f-41af-a281-a3f1f94fb717 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:23.307719 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb61aa3e-4a9f-41af-a281-a3f1f94fb717 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:23.590274 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-eb61aa3e-4a9f-41af-a281-a3f1f94fb717 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:23.601374 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-eb61aa3e-4a9f-41af-a281-a3f1f94fb717 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1198 microversion: 2.1 time: 0.325457 Jun 16 14:44:23.601990 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 692/1392] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:23 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1198 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:44:23.607866 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7c7bb005-5dde-41ac-bff3-6e77e9ef7707 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c38e1f0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:23.703464 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7c7bb005-5dde-41ac-bff3-6e77e9ef7707 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.100200 Jun 16 14:44:23.704677 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 693/1393] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:23 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:23.716206 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6dbf8139-ac40-4bca-857c-099564cb4726 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:23.717176 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6dbf8139-ac40-4bca-857c-099564cb4726 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:23.726199 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6dbf8139-ac40-4bca-857c-099564cb4726 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:23.726677 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6dbf8139-ac40-4bca-857c-099564cb4726 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:23.727971 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6dbf8139-ac40-4bca-857c-099564cb4726 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:23.728419 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6dbf8139-ac40-4bca-857c-099564cb4726 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:23.776617 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:23.817062 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6dbf8139-ac40-4bca-857c-099564cb4726 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:23.817806 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6dbf8139-ac40-4bca-857c-099564cb4726 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:23.818606 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-6dbf8139-ac40-4bca-857c-099564cb4726 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lazy-loading 'fault' on Instance uuid 4b8ac858-0bec-476e-8bd5-0234b252a67f {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:44:23.910456 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6dbf8139-ac40-4bca-857c-099564cb4726 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:23.930744 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6dbf8139-ac40-4bca-857c-099564cb4726 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 200 len: 1303 microversion: 2.1 time: 0.224323 Jun 16 14:44:23.932734 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 694/1394] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:23 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 1303 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:23.937593 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-47c2a1c7-d44a-4142-9d22-dde84d1f7a16 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:23.945661 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-01269ce3-0bf3-477f-85d7-04ac39a5625d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:23.948325 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-01269ce3-0bf3-477f-85d7-04ac39a5625d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:23.955243 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-47c2a1c7-d44a-4142-9d22-dde84d1f7a16 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1542 microversion: 2.1 time: 1.150497 Jun 16 14:44:23.955914 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 701/1395] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:22 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1542 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:44:23.963242 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01269ce3-0bf3-477f-85d7-04ac39a5625d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:23.964527 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01269ce3-0bf3-477f-85d7-04ac39a5625d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:23.973393 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01269ce3-0bf3-477f-85d7-04ac39a5625d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:23.974637 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01269ce3-0bf3-477f-85d7-04ac39a5625d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:24.268436 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-01269ce3-0bf3-477f-85d7-04ac39a5625d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:24.302222 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-01269ce3-0bf3-477f-85d7-04ac39a5625d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:24.307929 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-01269ce3-0bf3-477f-85d7-04ac39a5625d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:24.310506 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-01269ce3-0bf3-477f-85d7-04ac39a5625d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.375529 Jun 16 14:44:24.326417 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 695/1396] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:23 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:24.627024 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fd3b9789-7d70-432a-b2ca-186d6045c031 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:24.627545 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fd3b9789-7d70-432a-b2ca-186d6045c031 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:24.645869 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd3b9789-7d70-432a-b2ca-186d6045c031 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:24.646692 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd3b9789-7d70-432a-b2ca-186d6045c031 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:24.647691 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd3b9789-7d70-432a-b2ca-186d6045c031 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:24.651125 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd3b9789-7d70-432a-b2ca-186d6045c031 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:24.722783 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e80cf8b4-670c-4773-93fc-20c12ecdf15a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffdbe280>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:24.853836 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e80cf8b4-670c-4773-93fc-20c12ecdf15a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.136169 Jun 16 14:44:24.863626 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 696/1397] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:24 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:24.966149 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ba554249-1562-414a-ae33-ec39d26536a1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:24.972487 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ba554249-1562-414a-ae33-ec39d26536a1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: 4b8ac858-0bec-476e-8bd5-0234b252a67f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:24.989141 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ba554249-1562-414a-ae33-ec39d26536a1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:24.990407 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ba554249-1562-414a-ae33-ec39d26536a1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:24.993070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ba554249-1562-414a-ae33-ec39d26536a1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:24.994512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ba554249-1562-414a-ae33-ec39d26536a1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:25.038506 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-ba554249-1562-414a-ae33-ec39d26536a1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] HTTP exception thrown: Instance 4b8ac858-0bec-476e-8bd5-0234b252a67f could not be found. Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ba554249-1562-414a-ae33-ec39d26536a1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Request method failure captured: Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f HTTP/1.1 Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0EJwFYtuFSQfzEOugf63Vz8VMtZLeEeZvKpMnabXfJHY5SLiXs_IpXov3VuZOM86P1fO8H7ooDcDF5GpEwrEgLVyA7IiqKVBVzfcJrVcpKGOsdMcWTLIYziPmCmRNMd75AoLIuoL2-oeQN3qN1Nub1W38a-RFl4I1qjaDXSXxvl070 Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b50858433c774049b7c3fe4a4f98e948 Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersAdminTestJSON-1722745255 Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:44:25.043572 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:44:25.047258 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b50858433c774049b7c3fe4a4f98e948", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b50858433c774049b7c3fe4a4f98e948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b50858433c774049b7c3fe4a4f98e948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b50858433c774049b7c3fe4a4f98e948"}]}] Jun 16 14:44:25.047258 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersAdminTestJSON-1722745255 Jun 16 14:44:25.047258 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b50858433c774049b7c3fe4a4f98e948 Jun 16 14:44:25.047258 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersAdminTestJSON-1722745255 Jun 16 14:44:25.047258 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersAdminTestJSON-1722745255-project Jun 16 14:44:25.047258 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:44:25.047258 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:44:25.047258 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 23594325f9174f3a80dd744eaaaba379 Jun 16 14:44:25.047258 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersAdminTestJSON-1722745255-project Jun 16 14:44:25.047258 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:44:25.047258 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 4b8ac858-0bec-476e-8bd5-0234b252a67f could not be found. Jun 16 14:44:25.047258 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '4b8ac858-0bec-476e-8bd5-0234b252a67f'} Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b8ac858-0bec-476e-8bd5-0234b252a67f could not be found. Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:25.049005 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b8ac858-0bec-476e-8bd5-0234b252a67f could not be found. Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b8ac858-0bec-476e-8bd5-0234b252a67f could not be found. Jun 16 14:44:25.051913 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:25.057613 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ba554249-1562-414a-ae33-ec39d26536a1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Returning 404 to user: Instance 4b8ac858-0bec-476e-8bd5-0234b252a67f could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:25.059739 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ba554249-1562-414a-ae33-ec39d26536a1 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f" status: 404 len: 111 microversion: 2.1 time: 0.101862 Jun 16 14:44:25.076449 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 697/1398] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:24 2022] GET /compute/v2.1/servers/4b8ac858-0bec-476e-8bd5-0234b252a67f => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:44:25.087129 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-afef7958-e4b7-4a60-b5aa-ed3abb826009 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:25.103624 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-afef7958-e4b7-4a60-b5aa-ed3abb826009 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:25.129328 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-afef7958-e4b7-4a60-b5aa-ed3abb826009 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:25.134008 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-afef7958-e4b7-4a60-b5aa-ed3abb826009 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:25.135954 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-afef7958-e4b7-4a60-b5aa-ed3abb826009 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:25.142836 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-afef7958-e4b7-4a60-b5aa-ed3abb826009 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:25.957067 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fd3b9789-7d70-432a-b2ca-186d6045c031 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:25.990922 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fd3b9789-7d70-432a-b2ca-186d6045c031 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1198 microversion: 2.1 time: 1.368019 Jun 16 14:44:25.996893 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 702/1399] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:24 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1198 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:26.025599 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-afef7958-e4b7-4a60-b5aa-ed3abb826009 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:26.026992 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7d0d1e74-84d5-4534-b112-d23b9247106d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:26.028279 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7d0d1e74-84d5-4534-b112-d23b9247106d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:26.060264 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7d0d1e74-84d5-4534-b112-d23b9247106d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:26.067928 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7d0d1e74-84d5-4534-b112-d23b9247106d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:26.069536 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7d0d1e74-84d5-4534-b112-d23b9247106d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:26.070500 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7d0d1e74-84d5-4534-b112-d23b9247106d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:26.080786 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-afef7958-e4b7-4a60-b5aa-ed3abb826009 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1541 microversion: 2.1 time: 1.000074 Jun 16 14:44:26.088089 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 698/1400] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:25 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1541 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:26.108100 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-25a8d9be-df85-463e-90fb-8df7c4a3ca59 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:26.109253 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-25a8d9be-df85-463e-90fb-8df7c4a3ca59 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:26.166592 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-25a8d9be-df85-463e-90fb-8df7c4a3ca59 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:26.173557 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-25a8d9be-df85-463e-90fb-8df7c4a3ca59 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:26.175359 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-25a8d9be-df85-463e-90fb-8df7c4a3ca59 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:26.176846 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-25a8d9be-df85-463e-90fb-8df7c4a3ca59 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:26.217786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7d0d1e74-84d5-4534-b112-d23b9247106d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:44:26.434816 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7d0d1e74-84d5-4534-b112-d23b9247106d tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 204 len: 0 microversion: 2.1 time: 0.434341 Jun 16 14:44:26.436124 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 703/1401] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:44:25 2022] DELETE /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:26.442702 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-739417d5-1ddd-4e50-adbc-6f3d6a168725 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffe58820>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:26.502998 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-739417d5-1ddd-4e50-adbc-6f3d6a168725 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.065202 Jun 16 14:44:26.504044 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 704/1402] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:26 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:26.510099 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9ca1ec29-e162-4858-a2a9-e36623ca2141 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:26.511346 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9ca1ec29-e162-4858-a2a9-e36623ca2141 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:26.523032 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9ca1ec29-e162-4858-a2a9-e36623ca2141 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:26.523926 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9ca1ec29-e162-4858-a2a9-e36623ca2141 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:26.525592 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9ca1ec29-e162-4858-a2a9-e36623ca2141 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:26.526527 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9ca1ec29-e162-4858-a2a9-e36623ca2141 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:27.200932 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-25a8d9be-df85-463e-90fb-8df7c4a3ca59 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:27.241544 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-25a8d9be-df85-463e-90fb-8df7c4a3ca59 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:27.244857 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-25a8d9be-df85-463e-90fb-8df7c4a3ca59 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:27.260347 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-25a8d9be-df85-463e-90fb-8df7c4a3ca59 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 1.168074 Jun 16 14:44:27.260347 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 699/1403] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:26 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:27.280157 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-53bf7b8a-258e-476f-9c89-fe037c143f04 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:27.285581 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-53bf7b8a-258e-476f-9c89-fe037c143f04 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:27.322865 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53bf7b8a-258e-476f-9c89-fe037c143f04 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:27.326442 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53bf7b8a-258e-476f-9c89-fe037c143f04 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:27.328749 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53bf7b8a-258e-476f-9c89-fe037c143f04 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:27.332817 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53bf7b8a-258e-476f-9c89-fe037c143f04 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:27.764481 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9ca1ec29-e162-4858-a2a9-e36623ca2141 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:27.782313 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9ca1ec29-e162-4858-a2a9-e36623ca2141 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1467 microversion: 2.1 time: 1.276326 Jun 16 14:44:27.794201 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 705/1404] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:26 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1467 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:27.794582 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6f800dbe-f887-4b2b-9b4c-f5bcdaac176b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:27.795233 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6f800dbe-f887-4b2b-9b4c-f5bcdaac176b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:27.818901 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f800dbe-f887-4b2b-9b4c-f5bcdaac176b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:27.819374 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f800dbe-f887-4b2b-9b4c-f5bcdaac176b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:27.820222 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f800dbe-f887-4b2b-9b4c-f5bcdaac176b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:27.820684 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f800dbe-f887-4b2b-9b4c-f5bcdaac176b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:28.317960 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-53bf7b8a-258e-476f-9c89-fe037c143f04 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:28.350275 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-53bf7b8a-258e-476f-9c89-fe037c143f04 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1198 microversion: 2.1 time: 1.083485 Jun 16 14:44:28.351927 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 700/1405] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:27 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1198 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:28.361415 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7415f43e-e782-4ccd-bc44-bc9bc2f0d89b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c4e09d0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:28.511787 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7415f43e-e782-4ccd-bc44-bc9bc2f0d89b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.155176 Jun 16 14:44:28.524185 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 701/1406] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:28 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:28.536756 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f685aa1c-f053-434c-a95d-a332151c4160 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:28.538482 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f685aa1c-f053-434c-a95d-a332151c4160 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:28.553101 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f685aa1c-f053-434c-a95d-a332151c4160 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:28.554984 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f685aa1c-f053-434c-a95d-a332151c4160 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:28.557116 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f685aa1c-f053-434c-a95d-a332151c4160 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:28.558763 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f685aa1c-f053-434c-a95d-a332151c4160 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:28.829363 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6f800dbe-f887-4b2b-9b4c-f5bcdaac176b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:28.841116 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6f800dbe-f887-4b2b-9b4c-f5bcdaac176b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1541 microversion: 2.1 time: 1.057027 Jun 16 14:44:28.851594 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 706/1407] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:27 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1541 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:28.864069 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-133d211c-a9dc-450b-a3ef-16948e62a8e7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:28.867315 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-133d211c-a9dc-450b-a3ef-16948e62a8e7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:28.884400 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-133d211c-a9dc-450b-a3ef-16948e62a8e7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:28.885191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-133d211c-a9dc-450b-a3ef-16948e62a8e7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:28.886207 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-133d211c-a9dc-450b-a3ef-16948e62a8e7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:28.886843 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-133d211c-a9dc-450b-a3ef-16948e62a8e7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:29.047088 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f685aa1c-f053-434c-a95d-a332151c4160 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:29.073224 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f685aa1c-f053-434c-a95d-a332151c4160 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:29.080496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f685aa1c-f053-434c-a95d-a332151c4160 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:29.083341 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f685aa1c-f053-434c-a95d-a332151c4160 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.556947 Jun 16 14:44:29.084707 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 702/1408] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:28 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:29.229503 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-f9330db4-6d11-4eb4-9cdd-7b0dbf9d1d83 req-cfad3ed1-0336-4d9a-aa85-6884152a9c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4855363-724b-4eff-a76e-915e440af995", "name": "network-vif-unplugged", "status": "completed", "tag": "f4722aca-79de-427f-b18d-882b6697a114"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:29.251252 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-f9330db4-6d11-4eb4-9cdd-7b0dbf9d1d83 req-cfad3ed1-0336-4d9a-aa85-6884152a9c3b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:29.254429 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-f9330db4-6d11-4eb4-9cdd-7b0dbf9d1d83 req-cfad3ed1-0336-4d9a-aa85-6884152a9c3b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:29.291804 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-f9330db4-6d11-4eb4-9cdd-7b0dbf9d1d83 req-cfad3ed1-0336-4d9a-aa85-6884152a9c3b service nova] Creating event network-vif-unplugged:f4722aca-79de-427f-b18d-882b6697a114 for instance e4855363-724b-4eff-a76e-915e440af995 on n-h2-836830-4 Jun 16 14:44:29.316490 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-f9330db4-6d11-4eb4-9cdd-7b0dbf9d1d83 req-cfad3ed1-0336-4d9a-aa85-6884152a9c3b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091084 Jun 16 14:44:29.317501 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 703/1409] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:44:29.371202 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3a5c027d-039b-436b-ac11-155503f6b0af tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:29.373912 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3a5c027d-039b-436b-ac11-155503f6b0af tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:29.390653 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3a5c027d-039b-436b-ac11-155503f6b0af tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:29.391654 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3a5c027d-039b-436b-ac11-155503f6b0af tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:29.392661 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3a5c027d-039b-436b-ac11-155503f6b0af tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:29.393875 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3a5c027d-039b-436b-ac11-155503f6b0af tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:29.750645 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3a5c027d-039b-436b-ac11-155503f6b0af tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:29.761325 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3a5c027d-039b-436b-ac11-155503f6b0af tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1198 microversion: 2.1 time: 0.394879 Jun 16 14:44:29.762373 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 704/1410] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:29 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1198 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:44:29.771139 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-a8d62d02-36c9-405a-80af-ec4d5c70b426 req-32ab17a1-abba-4085-a371-f6be35efdd41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04e1cd2-656b-4de4-a784-ad2239f926bb", "name": "network-vif-deleted", "tag": "b1a39f33-a168-43db-ac7a-31811d74465c"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:29.790506 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-a8d62d02-36c9-405a-80af-ec4d5c70b426 req-32ab17a1-abba-4085-a371-f6be35efdd41 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:29.791537 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-a8d62d02-36c9-405a-80af-ec4d5c70b426 req-32ab17a1-abba-4085-a371-f6be35efdd41 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:29.810882 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-a8d62d02-36c9-405a-80af-ec4d5c70b426 req-32ab17a1-abba-4085-a371-f6be35efdd41 service nova] Creating event network-vif-deleted:b1a39f33-a168-43db-ac7a-31811d74465c for instance f04e1cd2-656b-4de4-a784-ad2239f926bb on n-h1-836830-4 Jun 16 14:44:29.819052 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-a8d62d02-36c9-405a-80af-ec4d5c70b426 req-32ab17a1-abba-4085-a371-f6be35efdd41 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054935 Jun 16 14:44:29.819956 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 705/1411] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:29.829751 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cd526f58-f34d-4e32-b854-c2a087cb73c6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c2d20d0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:29.910587 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cd526f58-f34d-4e32-b854-c2a087cb73c6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.089002 Jun 16 14:44:29.917586 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 706/1412] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:29 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:29.922753 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-168d2609-795b-4e7b-8a2e-65b7de33ba00 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:29.924105 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-168d2609-795b-4e7b-8a2e-65b7de33ba00 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:29.935127 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-168d2609-795b-4e7b-8a2e-65b7de33ba00 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:29.935912 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-168d2609-795b-4e7b-8a2e-65b7de33ba00 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:29.936868 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-168d2609-795b-4e7b-8a2e-65b7de33ba00 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:29.937644 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-168d2609-795b-4e7b-8a2e-65b7de33ba00 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:30.333959 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-133d211c-a9dc-450b-a3ef-16948e62a8e7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23594325f9174f3a80dd744eaaaba379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50858433c774049b7c3fe4a4f98e948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:30.369088 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-133d211c-a9dc-450b-a3ef-16948e62a8e7 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 200 len: 1467 microversion: 2.1 time: 1.515569 Jun 16 14:44:30.372959 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 707/1413] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:28 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 1467 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:30.389047 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-168d2609-795b-4e7b-8a2e-65b7de33ba00 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:30.403266 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-168d2609-795b-4e7b-8a2e-65b7de33ba00 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1541 microversion: 2.1 time: 0.483523 Jun 16 14:44:30.405458 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 707/1414] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:29 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1541 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:30.411434 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-fe2872d9-65a9-437f-a4c4-ea9050aa7428 req-d252a594-fda3-419c-ba32-519e60186b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b628388b-e782-439f-b76a-ab248b22404a", "name": "network-vif-unplugged", "status": "completed", "tag": "8bb810a3-e086-4b58-bef2-f3a96202f1cd"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:30.433011 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-fe2872d9-65a9-437f-a4c4-ea9050aa7428 req-d252a594-fda3-419c-ba32-519e60186b42 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:30.437899 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-fe2872d9-65a9-437f-a4c4-ea9050aa7428 req-d252a594-fda3-419c-ba32-519e60186b42 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:30.486310 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-fe2872d9-65a9-437f-a4c4-ea9050aa7428 req-d252a594-fda3-419c-ba32-519e60186b42 service nova] Creating event network-vif-unplugged:8bb810a3-e086-4b58-bef2-f3a96202f1cd for instance b628388b-e782-439f-b76a-ab248b22404a on n-h1-836830-4 Jun 16 14:44:30.501711 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [req-fe2872d9-65a9-437f-a4c4-ea9050aa7428 req-d252a594-fda3-419c-ba32-519e60186b42 service nova] Instance b628388b-e782-439f-b76a-ab248b22404a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:44:30.525784 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-fe2872d9-65a9-437f-a4c4-ea9050aa7428 req-d252a594-fda3-419c-ba32-519e60186b42 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118813 Jun 16 14:44:30.528575 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 708/1415] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:30.789038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-802a5b21-ac96-4e9b-9e50-5a1822734f3d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:30.796969 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-802a5b21-ac96-4e9b-9e50-5a1822734f3d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:30.812353 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-21db7488-f263-44ae-b74d-1653b91ba4f3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:30.820032 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-21db7488-f263-44ae-b74d-1653b91ba4f3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:30.833792 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-802a5b21-ac96-4e9b-9e50-5a1822734f3d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:30.837935 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-802a5b21-ac96-4e9b-9e50-5a1822734f3d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:30.848411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-802a5b21-ac96-4e9b-9e50-5a1822734f3d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:30.852307 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-802a5b21-ac96-4e9b-9e50-5a1822734f3d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:30.865671 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-21db7488-f263-44ae-b74d-1653b91ba4f3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:30.868672 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-21db7488-f263-44ae-b74d-1653b91ba4f3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:30.873906 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-21db7488-f263-44ae-b74d-1653b91ba4f3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:30.876643 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-21db7488-f263-44ae-b74d-1653b91ba4f3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:31.384641 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-21db7488-f263-44ae-b74d-1653b91ba4f3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:31.398190 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-21db7488-f263-44ae-b74d-1653b91ba4f3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1198 microversion: 2.1 time: 0.613761 Jun 16 14:44:31.410793 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 709/1416] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:30 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1198 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:44:31.418226 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9773c520-76ee-4c93-adc4-e0323e1e2e28 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffc9d3a0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:31.526001 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9773c520-76ee-4c93-adc4-e0323e1e2e28 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.113571 Jun 16 14:44:31.533472 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 710/1417] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:31 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:31.540360 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2abebca8-a211-4aad-a4db-b4ca50a596a2 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:31.541522 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2abebca8-a211-4aad-a4db-b4ca50a596a2 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] [instance: f04e1cd2-656b-4de4-a784-ad2239f926bb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:31.551268 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2abebca8-a211-4aad-a4db-b4ca50a596a2 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:31.552148 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2abebca8-a211-4aad-a4db-b4ca50a596a2 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:31.553368 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2abebca8-a211-4aad-a4db-b4ca50a596a2 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:31.554342 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2abebca8-a211-4aad-a4db-b4ca50a596a2 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:31.617421 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-2abebca8-a211-4aad-a4db-b4ca50a596a2 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] HTTP exception thrown: Instance f04e1cd2-656b-4de4-a784-ad2239f926bb could not be found. Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2abebca8-a211-4aad-a4db-b4ca50a596a2 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Request method failure captured: Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb HTTP/1.1 Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0EJwFYtuFSQfzEOugf63Vz8VMtZLeEeZvKpMnabXfJHY5SLiXs_IpXov3VuZOM86P1fO8H7ooDcDF5GpEwrEgLVyA7IiqKVBVzfcJrVcpKGOsdMcWTLIYziPmCmRNMd75AoLIuoL2-oeQN3qN1Nub1W38a-RFl4I1qjaDXSXxvl070 Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b50858433c774049b7c3fe4a4f98e948 Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersAdminTestJSON-1722745255 Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:44:31.629390 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:44:31.632283 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b50858433c774049b7c3fe4a4f98e948", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b50858433c774049b7c3fe4a4f98e948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b50858433c774049b7c3fe4a4f98e948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b50858433c774049b7c3fe4a4f98e948"}]}] Jun 16 14:44:31.632283 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersAdminTestJSON-1722745255 Jun 16 14:44:31.632283 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b50858433c774049b7c3fe4a4f98e948 Jun 16 14:44:31.632283 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersAdminTestJSON-1722745255 Jun 16 14:44:31.632283 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersAdminTestJSON-1722745255-project Jun 16 14:44:31.632283 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:44:31.632283 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:44:31.632283 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 23594325f9174f3a80dd744eaaaba379 Jun 16 14:44:31.632283 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersAdminTestJSON-1722745255-project Jun 16 14:44:31.632283 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:44:31.632283 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance f04e1cd2-656b-4de4-a784-ad2239f926bb could not be found. Jun 16 14:44:31.632283 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'f04e1cd2-656b-4de4-a784-ad2239f926bb'} Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04e1cd2-656b-4de4-a784-ad2239f926bb could not be found. Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:44:31.633749 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04e1cd2-656b-4de4-a784-ad2239f926bb could not be found. Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04e1cd2-656b-4de4-a784-ad2239f926bb could not be found. Jun 16 14:44:31.637691 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:44:31.642188 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2abebca8-a211-4aad-a4db-b4ca50a596a2 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] Returning 404 to user: Instance f04e1cd2-656b-4de4-a784-ad2239f926bb could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:44:31.642188 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2abebca8-a211-4aad-a4db-b4ca50a596a2 tempest-ServersAdminTestJSON-1722745255 tempest-ServersAdminTestJSON-1722745255-project] 10.222.0.57 "GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb" status: 404 len: 111 microversion: 2.1 time: 0.105770 Jun 16 14:44:31.662728 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 711/1418] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:31 2022] GET /compute/v2.1/servers/f04e1cd2-656b-4de4-a784-ad2239f926bb => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:44:31.668135 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-29561f2d-e96e-408b-a572-e6b6efa3caee tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:31.668756 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-29561f2d-e96e-408b-a572-e6b6efa3caee tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:31.688501 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-29561f2d-e96e-408b-a572-e6b6efa3caee tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:31.688962 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-29561f2d-e96e-408b-a572-e6b6efa3caee tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:31.690371 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-29561f2d-e96e-408b-a572-e6b6efa3caee tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:31.691729 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-29561f2d-e96e-408b-a572-e6b6efa3caee tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:33.199925 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-29561f2d-e96e-408b-a572-e6b6efa3caee tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:33.219482 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-29561f2d-e96e-408b-a572-e6b6efa3caee tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1541 microversion: 2.1 time: 1.555055 Jun 16 14:44:33.221895 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 712/1419] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:31 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1541 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:33.239613 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b41c3abf-9999-4090-ad35-bc4fb8a4a83e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:33.253207 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b41c3abf-9999-4090-ad35-bc4fb8a4a83e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:33.276822 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b41c3abf-9999-4090-ad35-bc4fb8a4a83e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:33.277655 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b41c3abf-9999-4090-ad35-bc4fb8a4a83e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:33.279255 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b41c3abf-9999-4090-ad35-bc4fb8a4a83e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:33.280108 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b41c3abf-9999-4090-ad35-bc4fb8a4a83e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:33.724868 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-802a5b21-ac96-4e9b-9e50-5a1822734f3d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:33.754236 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-802a5b21-ac96-4e9b-9e50-5a1822734f3d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:33.766530 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-802a5b21-ac96-4e9b-9e50-5a1822734f3d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:33.773718 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-802a5b21-ac96-4e9b-9e50-5a1822734f3d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 3.398239 Jun 16 14:44:33.778677 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 708/1420] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:30 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 3405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:33.799830 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9023c0b1-5d0f-46ec-b7eb-d32f3e8b52fa tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c1a0550>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:33.862021 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b41c3abf-9999-4090-ad35-bc4fb8a4a83e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:33.889214 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b41c3abf-9999-4090-ad35-bc4fb8a4a83e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1198 microversion: 2.1 time: 0.657002 Jun 16 14:44:33.911780 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 713/1421] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:33 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1198 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:33.918411 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9023c0b1-5d0f-46ec-b7eb-d32f3e8b52fa tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.136028 Jun 16 14:44:33.923817 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 709/1422] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:33 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:34.239407 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d392799a-c9e8-4e66-a0e0-4313249c2222 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:34.240944 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d392799a-c9e8-4e66-a0e0-4313249c2222 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:34.250576 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d392799a-c9e8-4e66-a0e0-4313249c2222 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:34.251403 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d392799a-c9e8-4e66-a0e0-4313249c2222 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:34.253506 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d392799a-c9e8-4e66-a0e0-4313249c2222 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:34.254726 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d392799a-c9e8-4e66-a0e0-4313249c2222 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:34.420969 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-8d8ec0f5-cb7f-4f66-a3fa-b18b6a197d2f req-aa128162-b84e-4319-b052-02a2e4cc693e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b628388b-e782-439f-b76a-ab248b22404a", "tag": "8bb810a3-e086-4b58-bef2-f3a96202f1cd"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:34.436549 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-8d8ec0f5-cb7f-4f66-a3fa-b18b6a197d2f req-aa128162-b84e-4319-b052-02a2e4cc693e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:34.437327 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-8d8ec0f5-cb7f-4f66-a3fa-b18b6a197d2f req-aa128162-b84e-4319-b052-02a2e4cc693e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:34.471632 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-8d8ec0f5-cb7f-4f66-a3fa-b18b6a197d2f req-aa128162-b84e-4319-b052-02a2e4cc693e service nova] Creating event network-changed:8bb810a3-e086-4b58-bef2-f3a96202f1cd for instance b628388b-e782-439f-b76a-ab248b22404a on n-h1-836830-4 Jun 16 14:44:34.487171 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [req-8d8ec0f5-cb7f-4f66-a3fa-b18b6a197d2f req-aa128162-b84e-4319-b052-02a2e4cc693e service nova] Instance b628388b-e782-439f-b76a-ab248b22404a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:44:34.536549 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-8d8ec0f5-cb7f-4f66-a3fa-b18b6a197d2f req-aa128162-b84e-4319-b052-02a2e4cc693e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120183 Jun 16 14:44:34.541870 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 710/1423] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:44:34.804621 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b97ab6d2-40e7-4a8c-b235-1b5c76b8ca95 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:34.805648 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b97ab6d2-40e7-4a8c-b235-1b5c76b8ca95 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:34.825294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b97ab6d2-40e7-4a8c-b235-1b5c76b8ca95 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:34.825779 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b97ab6d2-40e7-4a8c-b235-1b5c76b8ca95 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:34.835051 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b97ab6d2-40e7-4a8c-b235-1b5c76b8ca95 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:34.837455 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b97ab6d2-40e7-4a8c-b235-1b5c76b8ca95 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:35.171478 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d392799a-c9e8-4e66-a0e0-4313249c2222 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:35.237195 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d392799a-c9e8-4e66-a0e0-4313249c2222 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1541 microversion: 2.1 time: 0.978013 Jun 16 14:44:35.237195 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 714/1424] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:34 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1541 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:35.237195 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-34c2b2ae-ad8b-4355-884a-fe827384adad tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:35.237195 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-34c2b2ae-ad8b-4355-884a-fe827384adad tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:35.243270 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-34c2b2ae-ad8b-4355-884a-fe827384adad tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:35.244231 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-34c2b2ae-ad8b-4355-884a-fe827384adad tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:35.244524 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-34c2b2ae-ad8b-4355-884a-fe827384adad tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:35.244977 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-34c2b2ae-ad8b-4355-884a-fe827384adad tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:35.550306 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b97ab6d2-40e7-4a8c-b235-1b5c76b8ca95 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:35.593737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b97ab6d2-40e7-4a8c-b235-1b5c76b8ca95 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:35.600611 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b97ab6d2-40e7-4a8c-b235-1b5c76b8ca95 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:35.606040 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b97ab6d2-40e7-4a8c-b235-1b5c76b8ca95 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.807523 Jun 16 14:44:35.627969 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 711/1425] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:34 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:35.663290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d9f9baef-7e64-4087-ab77-40bb347f4f3e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdefffdf5e0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:35.735965 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-34c2b2ae-ad8b-4355-884a-fe827384adad tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:35.755362 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-34c2b2ae-ad8b-4355-884a-fe827384adad tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1198 microversion: 2.1 time: 0.536920 Jun 16 14:44:35.757447 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 715/1426] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:35 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1198 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:35.822579 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d9f9baef-7e64-4087-ab77-40bb347f4f3e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1414 microversion: 2.1 time: 0.165094 Jun 16 14:44:35.823771 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 712/1427] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:35 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1414 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:36.234674 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-53054ac1-fc06-4126-95ee-09fcb30818bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:36.236881 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-53054ac1-fc06-4126-95ee-09fcb30818bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:36.267149 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53054ac1-fc06-4126-95ee-09fcb30818bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:36.271121 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53054ac1-fc06-4126-95ee-09fcb30818bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:36.277849 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53054ac1-fc06-4126-95ee-09fcb30818bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:36.279395 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53054ac1-fc06-4126-95ee-09fcb30818bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:36.663735 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d85b1525-61d2-4e2a-97d5-d85697471aca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:36.666123 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d85b1525-61d2-4e2a-97d5-d85697471aca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:36.728513 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d85b1525-61d2-4e2a-97d5-d85697471aca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:36.729984 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d85b1525-61d2-4e2a-97d5-d85697471aca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:36.737738 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d85b1525-61d2-4e2a-97d5-d85697471aca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:36.745603 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d85b1525-61d2-4e2a-97d5-d85697471aca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:37.307400 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-53054ac1-fc06-4126-95ee-09fcb30818bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:37.326783 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-53054ac1-fc06-4126-95ee-09fcb30818bc tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1541 microversion: 2.1 time: 1.097490 Jun 16 14:44:37.327701 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 716/1428] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:36 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1541 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:37.334764 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d3d539e3-829f-4f2e-89e3-127aec164fd8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:37.338857 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d3d539e3-829f-4f2e-89e3-127aec164fd8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:37.352637 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3d539e3-829f-4f2e-89e3-127aec164fd8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:37.353404 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3d539e3-829f-4f2e-89e3-127aec164fd8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:37.354577 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3d539e3-829f-4f2e-89e3-127aec164fd8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:37.355224 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3d539e3-829f-4f2e-89e3-127aec164fd8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:37.996087 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d85b1525-61d2-4e2a-97d5-d85697471aca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:38.021933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d85b1525-61d2-4e2a-97d5-d85697471aca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:38.027054 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d85b1525-61d2-4e2a-97d5-d85697471aca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:38.030850 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d85b1525-61d2-4e2a-97d5-d85697471aca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 1.387787 Jun 16 14:44:38.038153 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 713/1429] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:36 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:44:38.050977 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2252883b-9350-48ed-8f67-b8600f63ef2e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdefff94430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:38.101863 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d3d539e3-829f-4f2e-89e3-127aec164fd8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:38.106053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:38.118898 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d3d539e3-829f-4f2e-89e3-127aec164fd8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1198 microversion: 2.1 time: 0.789777 Jun 16 14:44:38.119891 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 717/1430] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:37 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1198 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:38.156210 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-54e3f8a8-5512-43ea-a84b-7fad667fbf0f req-30efdce8-6cff-4ba4-adc8-3334559eeed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d49ca2-5a83-4054-bedf-0c06897d6b07", "name": "network-vif-plugged", "status": "completed", "tag": "ad00f43d-1679-420a-90e5-decadf4b3c3e"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:38.179144 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2252883b-9350-48ed-8f67-b8600f63ef2e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1423 microversion: 2.1 time: 0.138011 Jun 16 14:44:38.184857 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 714/1431] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:38 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1423 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:38.188334 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-54e3f8a8-5512-43ea-a84b-7fad667fbf0f req-30efdce8-6cff-4ba4-adc8-3334559eeed9 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:38.189230 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-54e3f8a8-5512-43ea-a84b-7fad667fbf0f req-30efdce8-6cff-4ba4-adc8-3334559eeed9 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:38.198340 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-89af195c-2c9a-4377-9709-d54a78a9e9b1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffedd8b0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:38.233942 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-54e3f8a8-5512-43ea-a84b-7fad667fbf0f req-30efdce8-6cff-4ba4-adc8-3334559eeed9 service nova] Creating event network-vif-plugged:ad00f43d-1679-420a-90e5-decadf4b3c3e for instance 34d49ca2-5a83-4054-bedf-0c06897d6b07 on n-h1-836830-4 Jun 16 14:44:38.247444 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-54e3f8a8-5512-43ea-a84b-7fad667fbf0f req-30efdce8-6cff-4ba4-adc8-3334559eeed9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109486 Jun 16 14:44:38.248824 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 718/1432] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:38.308031 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-89af195c-2c9a-4377-9709-d54a78a9e9b1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 200 len: 1423 microversion: 2.1 time: 0.114337 Jun 16 14:44:38.309442 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 715/1433] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:44:38 2022] GET /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 1423 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:38.328783 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e222cf2b-9da1-4365-b09c-adee8b622da0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c3a0160>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:38.344988 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e41aaf06-c3e1-4865-9c1a-96a16cbe6b28 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:38.346576 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e41aaf06-c3e1-4865-9c1a-96a16cbe6b28 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:38.369755 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e41aaf06-c3e1-4865-9c1a-96a16cbe6b28 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:38.370234 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e41aaf06-c3e1-4865-9c1a-96a16cbe6b28 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:38.371132 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e41aaf06-c3e1-4865-9c1a-96a16cbe6b28 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:38.371706 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e41aaf06-c3e1-4865-9c1a-96a16cbe6b28 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:38.817702 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e41aaf06-c3e1-4865-9c1a-96a16cbe6b28 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:38.835516 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e41aaf06-c3e1-4865-9c1a-96a16cbe6b28 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1473 microversion: 2.1 time: 0.494750 Jun 16 14:44:38.836395 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 716/1434] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:38 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1473 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:44:39.056388 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e134fe71-8b94-48b0-a9fc-faf04de04546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:39.057457 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e134fe71-8b94-48b0-a9fc-faf04de04546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:39.076733 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e134fe71-8b94-48b0-a9fc-faf04de04546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:39.078051 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e134fe71-8b94-48b0-a9fc-faf04de04546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:39.081050 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e134fe71-8b94-48b0-a9fc-faf04de04546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:39.083822 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e134fe71-8b94-48b0-a9fc-faf04de04546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:39.646983 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e134fe71-8b94-48b0-a9fc-faf04de04546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:39.682894 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e134fe71-8b94-48b0-a9fc-faf04de04546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:39.697546 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e134fe71-8b94-48b0-a9fc-faf04de04546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:39.700298 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e134fe71-8b94-48b0-a9fc-faf04de04546 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.647776 Jun 16 14:44:39.724165 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 717/1435] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:39 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:44:39.739217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8b1bbcaa-3fab-4d04-9842-1917ad101d57 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:39.741772 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8b1bbcaa-3fab-4d04-9842-1917ad101d57 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:39.761806 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8b1bbcaa-3fab-4d04-9842-1917ad101d57 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:39.762282 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8b1bbcaa-3fab-4d04-9842-1917ad101d57 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:39.768400 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8b1bbcaa-3fab-4d04-9842-1917ad101d57 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:39.769437 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8b1bbcaa-3fab-4d04-9842-1917ad101d57 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:39.833883 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e222cf2b-9da1-4365-b09c-adee8b622da0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 204 len: 0 microversion: 2.1 time: 1.510463 Jun 16 14:44:39.835733 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 719/1436] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:38 2022] DELETE /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 0 bytes in 1513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:39.844559 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0962b444-9510-464a-a996-b94d30506991 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:39.847997 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0962b444-9510-464a-a996-b94d30506991 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 044b8b3a-db26-450b-b770-6134060ded1c] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:39.887883 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0962b444-9510-464a-a996-b94d30506991 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:39.888729 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0962b444-9510-464a-a996-b94d30506991 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:39.890284 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0962b444-9510-464a-a996-b94d30506991 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:39.891161 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0962b444-9510-464a-a996-b94d30506991 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:40.009089 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0962b444-9510-464a-a996-b94d30506991 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 044b8b3a-db26-450b-b770-6134060ded1c] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:44:40.275614 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8b1bbcaa-3fab-4d04-9842-1917ad101d57 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:40.286252 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0962b444-9510-464a-a996-b94d30506991 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c" status: 204 len: 0 microversion: 2.1 time: 0.442708 Jun 16 14:44:40.288327 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 720/1437] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:44:39 2022] DELETE /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:40.289892 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8b1bbcaa-3fab-4d04-9842-1917ad101d57 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1198 microversion: 2.1 time: 0.563685 Jun 16 14:44:40.304046 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 718/1438] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:39 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1198 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:40.330151 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-65ffd986-fac9-488d-b901-cdd5c6df36ea tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:40.331374 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-65ffd986-fac9-488d-b901-cdd5c6df36ea tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:40.344945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65ffd986-fac9-488d-b901-cdd5c6df36ea tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:40.345945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65ffd986-fac9-488d-b901-cdd5c6df36ea tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:40.347041 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65ffd986-fac9-488d-b901-cdd5c6df36ea tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:40.348349 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65ffd986-fac9-488d-b901-cdd5c6df36ea tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:40.670787 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1091932949", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "3140785d-f673-4aae-abcb-d2ef972abb5e"}]}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:40.703836 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:40.796804 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] validate_networks() for [('3140785d-f673-4aae-abcb-d2ef972abb5e', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:44:41.017201 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-65ffd986-fac9-488d-b901-cdd5c6df36ea tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:41.035047 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-65ffd986-fac9-488d-b901-cdd5c6df36ea tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1473 microversion: 2.1 time: 0.743020 Jun 16 14:44:41.036415 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 721/1439] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:40 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1473 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:41.045459 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f67ef5c3-e023-4194-a265-7a8e7911a63b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:41.047550 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f67ef5c3-e023-4194-a265-7a8e7911a63b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:41.071945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f67ef5c3-e023-4194-a265-7a8e7911a63b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:41.075993 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f67ef5c3-e023-4194-a265-7a8e7911a63b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:41.077253 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f67ef5c3-e023-4194-a265-7a8e7911a63b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:41.078059 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f67ef5c3-e023-4194-a265-7a8e7911a63b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:41.572753 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f67ef5c3-e023-4194-a265-7a8e7911a63b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:41.615375 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f67ef5c3-e023-4194-a265-7a8e7911a63b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:41.621657 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f67ef5c3-e023-4194-a265-7a8e7911a63b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:41.640965 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f67ef5c3-e023-4194-a265-7a8e7911a63b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1813 microversion: 2.25 time: 0.601724 Jun 16 14:44:41.644683 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 722/1440] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:41 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1813 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:41.671147 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b1c46f00-e272-4b79-a709-3ba50d855b3f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:41.673026 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b1c46f00-e272-4b79-a709-3ba50d855b3f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:41.697773 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b1c46f00-e272-4b79-a709-3ba50d855b3f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:41.702187 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b1c46f00-e272-4b79-a709-3ba50d855b3f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:41.708471 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b1c46f00-e272-4b79-a709-3ba50d855b3f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:41.712135 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b1c46f00-e272-4b79-a709-3ba50d855b3f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:42.379473 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b1c46f00-e272-4b79-a709-3ba50d855b3f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:42.403423 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b1c46f00-e272-4b79-a709-3ba50d855b3f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1198 microversion: 2.1 time: 0.756946 Jun 16 14:44:42.404335 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 723/1441] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:41 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1198 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:42.411179 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6686717b-aa56-4729-9c15-cc391009fc8b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:42.412261 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6686717b-aa56-4729-9c15-cc391009fc8b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:42.422952 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6686717b-aa56-4729-9c15-cc391009fc8b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:42.424199 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6686717b-aa56-4729-9c15-cc391009fc8b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:42.425313 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6686717b-aa56-4729-9c15-cc391009fc8b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:42.425958 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6686717b-aa56-4729-9c15-cc391009fc8b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:42.792542 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:44:42.798001 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:44:42.811176 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:44:42.811619 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:44:42.812055 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:44:42.848335 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:42.855019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:42.857326 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:42.858909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:42.904472 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:42.934870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Getting quotas for project 1ac65ee04fbf47608c18c173900ad8f7. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:44:42.958704 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Getting quotas for user f91d14d5fb884048a0b12279c62e963d and project 1ac65ee04fbf47608c18c173900ad8f7. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:44:43.013313 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:44:43.017211 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:44:43.091930 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f40f2b97-165e-426b-8ad0-d2963d0d2a42 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.425076 Jun 16 14:44:43.093351 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 719/1442] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:44:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:44:43.285959 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6686717b-aa56-4729-9c15-cc391009fc8b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:43.302919 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6686717b-aa56-4729-9c15-cc391009fc8b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1470 microversion: 2.1 time: 0.896584 Jun 16 14:44:43.313409 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 724/1443] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:42 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1470 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:43.341430 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7c4ec0bd-f31c-4ec5-9f35-83befaa56f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:43.342485 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7c4ec0bd-f31c-4ec5-9f35-83befaa56f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:43.386770 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7c4ec0bd-f31c-4ec5-9f35-83befaa56f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:43.388034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7c4ec0bd-f31c-4ec5-9f35-83befaa56f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:43.390522 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7c4ec0bd-f31c-4ec5-9f35-83befaa56f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:43.391279 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7c4ec0bd-f31c-4ec5-9f35-83befaa56f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:43.575969 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-324291704", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:43.733650 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] validate_networks() for None {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:44:44.036794 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7c4ec0bd-f31c-4ec5-9f35-83befaa56f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:44.054201 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7c4ec0bd-f31c-4ec5-9f35-83befaa56f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:44.056089 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7c4ec0bd-f31c-4ec5-9f35-83befaa56f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:44.061265 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7c4ec0bd-f31c-4ec5-9f35-83befaa56f4f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1803 microversion: 2.25 time: 0.740188 Jun 16 14:44:44.067541 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 725/1444] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:43 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1803 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:44.080034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7b935aee-c829-46c0-94b8-692ae8020cdd tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:44.080740 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7b935aee-c829-46c0-94b8-692ae8020cdd tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:44.733947 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7b935aee-c829-46c0-94b8-692ae8020cdd tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:44.746537 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7b935aee-c829-46c0-94b8-692ae8020cdd tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1208 microversion: 2.1 time: 0.674882 Jun 16 14:44:44.748800 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 726/1445] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:44 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1208 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:44.762258 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c01a2eb6-eae6-4d7d-bcda-4bc3e9023a0d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:44.765966 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c01a2eb6-eae6-4d7d-bcda-4bc3e9023a0d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:44.788728 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c01a2eb6-eae6-4d7d-bcda-4bc3e9023a0d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:44.791270 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c01a2eb6-eae6-4d7d-bcda-4bc3e9023a0d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:44.792330 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c01a2eb6-eae6-4d7d-bcda-4bc3e9023a0d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:44.807314 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c01a2eb6-eae6-4d7d-bcda-4bc3e9023a0d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:44.990044 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c01a2eb6-eae6-4d7d-bcda-4bc3e9023a0d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:44.992893 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c01a2eb6-eae6-4d7d-bcda-4bc3e9023a0d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:44.994278 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c01a2eb6-eae6-4d7d-bcda-4bc3e9023a0d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:44.995854 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c01a2eb6-eae6-4d7d-bcda-4bc3e9023a0d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:45.080413 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-c01a2eb6-eae6-4d7d-bcda-4bc3e9023a0d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Getting quotas for project 414e3b792647435daa2ecce22a2c6132. Resources: {'cores', 'ram'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:44:45.110865 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-c01a2eb6-eae6-4d7d-bcda-4bc3e9023a0d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Getting quotas for user 65cde69f3b52448c8b08297b548bb377 and project 414e3b792647435daa2ecce22a2c6132. Resources: {'cores', 'ram'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:44:45.228586 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:45.459623 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c01a2eb6-eae6-4d7d-bcda-4bc3e9023a0d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "POST /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a/action" status: 202 len: 0 microversion: 2.1 time: 0.705327 Jun 16 14:44:45.465295 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 727/1446] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:44:44 2022] POST /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a/action => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:44:45.469574 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-50fc7c86-eb8c-4849-9810-c2bf9b782b43 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:45.472338 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-50fc7c86-eb8c-4849-9810-c2bf9b782b43 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:45.481381 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-50fc7c86-eb8c-4849-9810-c2bf9b782b43 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:45.482009 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-50fc7c86-eb8c-4849-9810-c2bf9b782b43 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:45.488159 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-50fc7c86-eb8c-4849-9810-c2bf9b782b43 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:45.489150 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-50fc7c86-eb8c-4849-9810-c2bf9b782b43 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:45.871106 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:44:45.872968 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:44:45.874193 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:44:45.875297 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:44:45.876883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:44:45.920741 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:45.927647 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:45.937367 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:45.938174 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:45.977452 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-50fc7c86-eb8c-4849-9810-c2bf9b782b43 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:45.991574 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:44:45.993203 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-50fc7c86-eb8c-4849-9810-c2bf9b782b43 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1381 microversion: 2.1 time: 0.526596 Jun 16 14:44:45.994194 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 728/1447] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:45 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1381 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:46.011517 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:44:46.018026 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-515c462b-b056-46eb-b35c-fd40fa6f4c8b req-b008aae7-6f48-4582-a676-3153c9841454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "044b8b3a-db26-450b-b770-6134060ded1c", "name": "network-vif-deleted", "tag": "ed657ed2-678a-4297-b198-f02f59e7a238"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:46.043413 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:44:46.048544 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:44:46.062769 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-515c462b-b056-46eb-b35c-fd40fa6f4c8b req-b008aae7-6f48-4582-a676-3153c9841454 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:46.065799 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-515c462b-b056-46eb-b35c-fd40fa6f4c8b req-b008aae7-6f48-4582-a676-3153c9841454 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:46.109831 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-515c462b-b056-46eb-b35c-fd40fa6f4c8b req-b008aae7-6f48-4582-a676-3153c9841454 service nova] Creating event network-vif-deleted:ed657ed2-678a-4297-b198-f02f59e7a238 for instance 044b8b3a-db26-450b-b770-6134060ded1c on n-h2-836830-4 Jun 16 14:44:46.141027 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-515c462b-b056-46eb-b35c-fd40fa6f4c8b req-b008aae7-6f48-4582-a676-3153c9841454 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143994 Jun 16 14:44:46.142893 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 729/1448] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:46.152260 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-02852473-e739-412e-85f9-6d232c293b30 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '.version_select at 0x7fdf0c5c54c0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:46.158008 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-02852473-e739-412e-85f9-6d232c293b30 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:46.158981 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-02852473-e739-412e-85f9-6d232c293b30 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:46.183008 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-02852473-e739-412e-85f9-6d232c293b30 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 4046 microversion: 2.25 time: 0.037704 Jun 16 14:44:46.184036 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 730/1449] 10.222.0.57 () {60 vars in 1183 bytes} [Thu Jun 16 14:44:46 2022] GET /compute/v2.1/os-migrations => generated 4046 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:46.191070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c31bcb9e-21bf-4f4c-b548-0918dca947a6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:46.192257 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c31bcb9e-21bf-4f4c-b548-0918dca947a6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:46.202587 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c31bcb9e-21bf-4f4c-b548-0918dca947a6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:46.203351 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c31bcb9e-21bf-4f4c-b548-0918dca947a6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:46.206412 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c31bcb9e-21bf-4f4c-b548-0918dca947a6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:46.207437 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c31bcb9e-21bf-4f4c-b548-0918dca947a6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:46.273311 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-71582d0c-9b49-44aa-8177-fe55c20a6ca0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.173364 Jun 16 14:44:46.284179 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 720/1450] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:44:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:44:46.307953 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-97504cc5-dadb-4a3b-bd99-ac1a8e7a9544 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:46.312600 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-97504cc5-dadb-4a3b-bd99-ac1a8e7a9544 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:46.336578 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97504cc5-dadb-4a3b-bd99-ac1a8e7a9544 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:46.337586 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97504cc5-dadb-4a3b-bd99-ac1a8e7a9544 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:46.339030 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97504cc5-dadb-4a3b-bd99-ac1a8e7a9544 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:46.341900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97504cc5-dadb-4a3b-bd99-ac1a8e7a9544 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:47.006456 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c31bcb9e-21bf-4f4c-b548-0918dca947a6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:47.038030 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c31bcb9e-21bf-4f4c-b548-0918dca947a6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1469 microversion: 2.1 time: 0.851862 Jun 16 14:44:47.048229 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 731/1451] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:46 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1469 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:47.053517 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f3dd7174-fc75-45ce-8c4b-25adec7e8366 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:47.054154 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f3dd7174-fc75-45ce-8c4b-25adec7e8366 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:47.086752 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f3dd7174-fc75-45ce-8c4b-25adec7e8366 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:47.087585 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f3dd7174-fc75-45ce-8c4b-25adec7e8366 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:47.088905 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f3dd7174-fc75-45ce-8c4b-25adec7e8366 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:47.089598 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f3dd7174-fc75-45ce-8c4b-25adec7e8366 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:47.170119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-97504cc5-dadb-4a3b-bd99-ac1a8e7a9544 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:47.189948 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-97504cc5-dadb-4a3b-bd99-ac1a8e7a9544 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1268 microversion: 2.1 time: 0.898838 Jun 16 14:44:47.195480 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 721/1452] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:46 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1268 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:47.212191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ab75cbbb-c0b7-4eee-b3bf-b11ecf16c7fa tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:47.213215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ab75cbbb-c0b7-4eee-b3bf-b11ecf16c7fa tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:47.241630 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ab75cbbb-c0b7-4eee-b3bf-b11ecf16c7fa tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:47.250184 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ab75cbbb-c0b7-4eee-b3bf-b11ecf16c7fa tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:47.258938 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ab75cbbb-c0b7-4eee-b3bf-b11ecf16c7fa tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:47.260081 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ab75cbbb-c0b7-4eee-b3bf-b11ecf16c7fa tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:47.711074 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f3dd7174-fc75-45ce-8c4b-25adec7e8366 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1532 microversion: 2.1 time: 0.661367 Jun 16 14:44:47.712267 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 732/1453] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:47 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1532 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:47.732986 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c24f271e-0253-4821-94b9-02dd59952d82 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:47.739213 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c24f271e-0253-4821-94b9-02dd59952d82 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:47.749935 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c24f271e-0253-4821-94b9-02dd59952d82 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:47.755035 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c24f271e-0253-4821-94b9-02dd59952d82 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:47.756338 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c24f271e-0253-4821-94b9-02dd59952d82 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:47.757774 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c24f271e-0253-4821-94b9-02dd59952d82 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:47.930728 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c24f271e-0253-4821-94b9-02dd59952d82 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:47.934951 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:47.948424 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c24f271e-0253-4821-94b9-02dd59952d82 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1212 microversion: 2.1 time: 0.215647 Jun 16 14:44:47.955849 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 733/1454] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:47 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1212 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:47.977805 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-8fbd1bda-5cfe-469d-94b4-f7d83ef9d3e3 req-fe763f57-9a33-42de-b5ff-ca314d8093de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b628388b-e782-439f-b76a-ab248b22404a", "name": "network-vif-plugged", "status": "completed", "tag": "8bb810a3-e086-4b58-bef2-f3a96202f1cd"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:48.031518 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-8fbd1bda-5cfe-469d-94b4-f7d83ef9d3e3 req-fe763f57-9a33-42de-b5ff-ca314d8093de service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:48.035477 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-8fbd1bda-5cfe-469d-94b4-f7d83ef9d3e3 req-fe763f57-9a33-42de-b5ff-ca314d8093de service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:48.092792 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-8fbd1bda-5cfe-469d-94b4-f7d83ef9d3e3 req-fe763f57-9a33-42de-b5ff-ca314d8093de service nova] Creating event network-vif-plugged:8bb810a3-e086-4b58-bef2-f3a96202f1cd for instance b628388b-e782-439f-b76a-ab248b22404a on n-h1-836830-4 Jun 16 14:44:48.112221 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [req-8fbd1bda-5cfe-469d-94b4-f7d83ef9d3e3 req-fe763f57-9a33-42de-b5ff-ca314d8093de service nova] Instance b628388b-e782-439f-b76a-ab248b22404a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:44:48.144463 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-8fbd1bda-5cfe-469d-94b4-f7d83ef9d3e3 req-fe763f57-9a33-42de-b5ff-ca314d8093de service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186202 Jun 16 14:44:48.152630 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 734/1455] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:48.176271 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d7882a7a-5f5d-4598-ba41-e91682c5cea1 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:48.182002 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d7882a7a-5f5d-4598-ba41-e91682c5cea1 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:48.208082 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d7882a7a-5f5d-4598-ba41-e91682c5cea1 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:48.208807 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d7882a7a-5f5d-4598-ba41-e91682c5cea1 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:48.212978 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d7882a7a-5f5d-4598-ba41-e91682c5cea1 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:48.216481 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d7882a7a-5f5d-4598-ba41-e91682c5cea1 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:48.467968 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-ab75cbbb-c0b7-4eee-b3bf-b11ecf16c7fa tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'services' on Instance uuid e4855363-724b-4eff-a76e-915e440af995 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:44:48.534858 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ab75cbbb-c0b7-4eee-b3bf-b11ecf16c7fa tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 2422 microversion: 2.25 time: 1.337179 Jun 16 14:44:48.539334 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 722/1456] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:47 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 2422 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:48.570559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7875cddd-60cf-4d8c-a0b6-37d74c0ac4e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:48.585468 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7875cddd-60cf-4d8c-a0b6-37d74c0ac4e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:48.598803 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7875cddd-60cf-4d8c-a0b6-37d74c0ac4e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:48.599778 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7875cddd-60cf-4d8c-a0b6-37d74c0ac4e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:48.601625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7875cddd-60cf-4d8c-a0b6-37d74c0ac4e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:48.602479 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7875cddd-60cf-4d8c-a0b6-37d74c0ac4e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:48.786169 n-d-836830-4 devstack@n-api.service[125863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 14:44:48.786691 n-d-836830-4 devstack@n-api.service[125863]: Thu Jun 16 14:44:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 (ip 10.222.0.57) !!! Jun 16 14:44:49.042435 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d7882a7a-5f5d-4598-ba41-e91682c5cea1 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1532 microversion: 2.1 time: 0.885438 Jun 16 14:44:49.056544 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 735/1457] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:48 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1532 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:49.097528 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7f4cb838-070c-40b6-9454-1e02cb420a36 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:49.102060 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7f4cb838-070c-40b6-9454-1e02cb420a36 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:49.114939 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7f4cb838-070c-40b6-9454-1e02cb420a36 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:49.115697 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7f4cb838-070c-40b6-9454-1e02cb420a36 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:49.116645 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7f4cb838-070c-40b6-9454-1e02cb420a36 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:49.117207 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7f4cb838-070c-40b6-9454-1e02cb420a36 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:49.413594 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7875cddd-60cf-4d8c-a0b6-37d74c0ac4e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:49.458551 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7875cddd-60cf-4d8c-a0b6-37d74c0ac4e9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1469 microversion: 2.1 time: 0.914625 Jun 16 14:44:49.461448 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 723/1458] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:48 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1469 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:49.486708 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0739d397-3c03-426e-8d4b-9f71b7dd3ba7 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:49.490301 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0739d397-3c03-426e-8d4b-9f71b7dd3ba7 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:49.506104 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0739d397-3c03-426e-8d4b-9f71b7dd3ba7 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:49.507450 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0739d397-3c03-426e-8d4b-9f71b7dd3ba7 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:49.509028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0739d397-3c03-426e-8d4b-9f71b7dd3ba7 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:49.509828 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0739d397-3c03-426e-8d4b-9f71b7dd3ba7 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:49.818787 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7f4cb838-070c-40b6-9454-1e02cb420a36 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:49.831693 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7f4cb838-070c-40b6-9454-1e02cb420a36 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1266 microversion: 2.1 time: 0.773472 Jun 16 14:44:49.842824 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 736/1459] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:49 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1266 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:49.842824 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0d3c799a-5de7-4f87-bc82-6b70b9982e8b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:49.842824 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0d3c799a-5de7-4f87-bc82-6b70b9982e8b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:49.861686 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0d3c799a-5de7-4f87-bc82-6b70b9982e8b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:49.862200 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0d3c799a-5de7-4f87-bc82-6b70b9982e8b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:49.863047 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0d3c799a-5de7-4f87-bc82-6b70b9982e8b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:49.871547 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0d3c799a-5de7-4f87-bc82-6b70b9982e8b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:50.101927 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0d3c799a-5de7-4f87-bc82-6b70b9982e8b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:50.113265 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0d3c799a-5de7-4f87-bc82-6b70b9982e8b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1274 microversion: 2.1 time: 0.275528 Jun 16 14:44:50.126650 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 737/1460] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:49 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1274 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:50.132920 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-dc320860-fcc3-4887-b512-814a28968863 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:50.136051 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:44:50.136051 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:44:50.137854 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dc320860-fcc3-4887-b512-814a28968863 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:50.138472 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dc320860-fcc3-4887-b512-814a28968863 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:50.139904 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dc320860-fcc3-4887-b512-814a28968863 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:50.141059 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dc320860-fcc3-4887-b512-814a28968863 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:50.180345 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-dc320860-fcc3-4887-b512-814a28968863 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.064017 Jun 16 14:44:50.182784 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 738/1461] 10.222.0.57 () {58 vars in 1175 bytes} [Thu Jun 16 14:44:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:50.207473 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-011e7a33-919a-4936-9d9a-957ffd39752b tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-4", "block_migration": false, "disk_over_commit": false}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:50.209405 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-011e7a33-919a-4936-9d9a-957ffd39752b tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:50.219675 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-011e7a33-919a-4936-9d9a-957ffd39752b tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:50.220599 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-011e7a33-919a-4936-9d9a-957ffd39752b tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:50.221607 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-011e7a33-919a-4936-9d9a-957ffd39752b tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:50.222142 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-011e7a33-919a-4936-9d9a-957ffd39752b tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:50.269692 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-011e7a33-919a-4936-9d9a-957ffd39752b tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lazy-loading 'flavor' on Instance uuid 34d49ca2-5a83-4054-bedf-0c06897d6b07 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:44:50.289023 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-011e7a33-919a-4936-9d9a-957ffd39752b tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Going to try to live migrate instance to n-h2-836830-4 {{(pid=125863) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 14:44:50.781861 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-0739d397-3c03-426e-8d4b-9f71b7dd3ba7 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'services' on Instance uuid e4855363-724b-4eff-a76e-915e440af995 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:44:50.823690 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0739d397-3c03-426e-8d4b-9f71b7dd3ba7 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 2422 microversion: 2.25 time: 1.358384 Jun 16 14:44:50.825764 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 724/1462] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:44:49 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 2422 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:44:50.839234 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-eb819b42-e544-499f-ab1b-69435b47b5aa tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:50.841359 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-eb819b42-e544-499f-ab1b-69435b47b5aa tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:50.856907 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb819b42-e544-499f-ab1b-69435b47b5aa tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:50.858009 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb819b42-e544-499f-ab1b-69435b47b5aa tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:50.860065 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb819b42-e544-499f-ab1b-69435b47b5aa tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:50.862712 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-eb819b42-e544-499f-ab1b-69435b47b5aa tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:51.715129 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-eb819b42-e544-499f-ab1b-69435b47b5aa tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:51.727676 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-eb819b42-e544-499f-ab1b-69435b47b5aa tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1469 microversion: 2.1 time: 0.899968 Jun 16 14:44:51.728611 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 725/1463] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:50 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1469 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:51.751672 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5a6094e0-f73d-4681-a9d9-04fd6bbdf4ee tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:51.752322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5a6094e0-f73d-4681-a9d9-04fd6bbdf4ee tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:51.780522 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5a6094e0-f73d-4681-a9d9-04fd6bbdf4ee tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:51.780991 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5a6094e0-f73d-4681-a9d9-04fd6bbdf4ee tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:51.781828 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5a6094e0-f73d-4681-a9d9-04fd6bbdf4ee tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:51.782904 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5a6094e0-f73d-4681-a9d9-04fd6bbdf4ee tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:52.006121 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5a6094e0-f73d-4681-a9d9-04fd6bbdf4ee tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:52.035941 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5a6094e0-f73d-4681-a9d9-04fd6bbdf4ee tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1308 microversion: 2.1 time: 0.288154 Jun 16 14:44:52.036577 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 726/1464] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:51 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1308 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:52.052128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9a6ba98b-44ef-45b0-af31-d754fce8c1f4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:52.053122 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9a6ba98b-44ef-45b0-af31-d754fce8c1f4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:52.068082 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a6ba98b-44ef-45b0-af31-d754fce8c1f4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:52.068571 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a6ba98b-44ef-45b0-af31-d754fce8c1f4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:52.076862 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a6ba98b-44ef-45b0-af31-d754fce8c1f4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:52.076862 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a6ba98b-44ef-45b0-af31-d754fce8c1f4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:52.290934 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-9a6ba98b-44ef-45b0-af31-d754fce8c1f4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lazy-loading 'services' on Instance uuid e4855363-724b-4eff-a76e-915e440af995 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:44:52.545016 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9a6ba98b-44ef-45b0-af31-d754fce8c1f4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments/afe2a9db-4f95-450e-a15f-c1856c09cc15" status: 202 len: 0 microversion: 2.25 time: 0.506391 Jun 16 14:44:52.547432 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 727/1465] 10.222.0.57 () {60 vars in 1456 bytes} [Thu Jun 16 14:44:52 2022] DELETE /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments/afe2a9db-4f95-450e-a15f-c1856c09cc15 => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:52.567917 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-74e6bb07-563d-4839-b864-24f16b2d6253 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:52.570762 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-74e6bb07-563d-4839-b864-24f16b2d6253 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:52.608802 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-74e6bb07-563d-4839-b864-24f16b2d6253 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:52.611343 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-74e6bb07-563d-4839-b864-24f16b2d6253 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:52.613763 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-74e6bb07-563d-4839-b864-24f16b2d6253 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:52.615332 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-74e6bb07-563d-4839-b864-24f16b2d6253 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:53.484773 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-74e6bb07-563d-4839-b864-24f16b2d6253 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:53.522641 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-74e6bb07-563d-4839-b864-24f16b2d6253 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1316 microversion: 2.1 time: 0.971452 Jun 16 14:44:53.524470 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 728/1466] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:52 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1316 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:53.541559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dc986950-b416-469e-b81a-1bc26883e8aa tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:53.545399 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-dc986950-b416-469e-b81a-1bc26883e8aa tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:53.564623 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dc986950-b416-469e-b81a-1bc26883e8aa tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:53.565326 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dc986950-b416-469e-b81a-1bc26883e8aa tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:53.567376 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dc986950-b416-469e-b81a-1bc26883e8aa tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:53.568806 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dc986950-b416-469e-b81a-1bc26883e8aa tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:53.666080 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-dc986950-b416-469e-b81a-1bc26883e8aa tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.140041 Jun 16 14:44:53.668592 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 729/1467] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jun 16 14:44:53 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:44:53.674809 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a2417b05-dbaa-4923-80a9-d6cba06f7361 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:53.675751 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a2417b05-dbaa-4923-80a9-d6cba06f7361 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:53.701356 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a2417b05-dbaa-4923-80a9-d6cba06f7361 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:53.702426 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a2417b05-dbaa-4923-80a9-d6cba06f7361 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:53.703438 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a2417b05-dbaa-4923-80a9-d6cba06f7361 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:53.704961 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a2417b05-dbaa-4923-80a9-d6cba06f7361 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:54.739747 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:55.237051 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a2417b05-dbaa-4923-80a9-d6cba06f7361 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:55.322208 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a2417b05-dbaa-4923-80a9-d6cba06f7361 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1469 microversion: 2.1 time: 1.649921 Jun 16 14:44:55.331633 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 730/1468] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:53 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1469 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:55.435307 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e7ccd57a-3c8b-44f4-a826-07d358155dcf tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:55.435956 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e7ccd57a-3c8b-44f4-a826-07d358155dcf tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:55.453319 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e7ccd57a-3c8b-44f4-a826-07d358155dcf tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:55.454976 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e7ccd57a-3c8b-44f4-a826-07d358155dcf tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:55.459025 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e7ccd57a-3c8b-44f4-a826-07d358155dcf tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:55.461672 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e7ccd57a-3c8b-44f4-a826-07d358155dcf tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:55.599978 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-011e7a33-919a-4936-9d9a-957ffd39752b tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07/action" status: 202 len: 0 microversion: 2.1 time: 5.405562 Jun 16 14:44:55.600611 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 739/1469] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:44:50 2022] POST /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07/action => generated 0 bytes in 5408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 14:44:55.614230 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e1b748f2-a120-4cc2-8ea7-2f5075557a0f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:55.616402 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e1b748f2-a120-4cc2-8ea7-2f5075557a0f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:55.633926 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e1b748f2-a120-4cc2-8ea7-2f5075557a0f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:55.639635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e1b748f2-a120-4cc2-8ea7-2f5075557a0f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:55.640822 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e1b748f2-a120-4cc2-8ea7-2f5075557a0f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:55.642199 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e1b748f2-a120-4cc2-8ea7-2f5075557a0f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:55.963624 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:56.025076 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=12 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:56.462659 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e7ccd57a-3c8b-44f4-a826-07d358155dcf tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:56.474284 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e7ccd57a-3c8b-44f4-a826-07d358155dcf tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1308 microversion: 2.1 time: 1.135606 Jun 16 14:44:56.481561 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 731/1470] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:55 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1308 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:56.498976 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f2f76420-9ea9-4f3e-9ff0-b9cc8cbf12c4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:56.500996 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f2f76420-9ea9-4f3e-9ff0-b9cc8cbf12c4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:56.507474 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f2f76420-9ea9-4f3e-9ff0-b9cc8cbf12c4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:56.507934 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f2f76420-9ea9-4f3e-9ff0-b9cc8cbf12c4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:56.511686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f2f76420-9ea9-4f3e-9ff0-b9cc8cbf12c4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:56.512513 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f2f76420-9ea9-4f3e-9ff0-b9cc8cbf12c4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:56.644679 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f2f76420-9ea9-4f3e-9ff0-b9cc8cbf12c4 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.156530 Jun 16 14:44:56.646827 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 732/1471] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jun 16 14:44:56 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:44:56.675110 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-134b9765-1cf2-43ed-989a-99ff1618948a req-bc7fbc7d-f049-4c78-abaf-6b8e964f926d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc", "tag": "05c0eff0-1b94-46e0-bbf5-a7cf99df002c"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:56.699723 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-134b9765-1cf2-43ed-989a-99ff1618948a req-bc7fbc7d-f049-4c78-abaf-6b8e964f926d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:56.701052 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-134b9765-1cf2-43ed-989a-99ff1618948a req-bc7fbc7d-f049-4c78-abaf-6b8e964f926d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:56.734023 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-134b9765-1cf2-43ed-989a-99ff1618948a req-bc7fbc7d-f049-4c78-abaf-6b8e964f926d service nova] Creating event network-changed:05c0eff0-1b94-46e0-bbf5-a7cf99df002c for instance 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc on n-h2-836830-4 Jun 16 14:44:56.745922 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-134b9765-1cf2-43ed-989a-99ff1618948a req-bc7fbc7d-f049-4c78-abaf-6b8e964f926d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096805 Jun 16 14:44:56.746752 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 733/1472] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:56.752915 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2178be26-975a-48c8-ba4c-2872a36341ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:56.767804 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2178be26-975a-48c8-ba4c-2872a36341ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:56.775911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2178be26-975a-48c8-ba4c-2872a36341ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:56.778257 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2178be26-975a-48c8-ba4c-2872a36341ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:56.779116 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2178be26-975a-48c8-ba4c-2872a36341ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:56.780143 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2178be26-975a-48c8-ba4c-2872a36341ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:57.409062 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e1b748f2-a120-4cc2-8ea7-2f5075557a0f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:57.439513 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e1b748f2-a120-4cc2-8ea7-2f5075557a0f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1316 microversion: 2.1 time: 1.825420 Jun 16 14:44:57.440818 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 740/1473] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:55 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1316 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:57.446612 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-40d1ec11-3c46-4c68-97bf-25107f6c0c6c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:57.453274 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-40d1ec11-3c46-4c68-97bf-25107f6c0c6c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:57.472741 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40d1ec11-3c46-4c68-97bf-25107f6c0c6c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:57.473606 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40d1ec11-3c46-4c68-97bf-25107f6c0c6c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:57.476734 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40d1ec11-3c46-4c68-97bf-25107f6c0c6c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:57.478227 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40d1ec11-3c46-4c68-97bf-25107f6c0c6c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:59.198339 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2178be26-975a-48c8-ba4c-2872a36341ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:59.237427 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2178be26-975a-48c8-ba4c-2872a36341ed tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 2.484596 Jun 16 14:44:59.249973 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 734/1474] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:56 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 2495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:59.266847 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-f8c8145a-480d-404b-8e75-f535589fe243 req-338700cc-5950-42ad-ae0c-e26b41ebf19f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b628388b-e782-439f-b76a-ab248b22404a", "name": "network-vif-unplugged", "status": "completed", "tag": "8bb810a3-e086-4b58-bef2-f3a96202f1cd"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:44:59.315078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-f8c8145a-480d-404b-8e75-f535589fe243 req-338700cc-5950-42ad-ae0c-e26b41ebf19f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:59.322876 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-f8c8145a-480d-404b-8e75-f535589fe243 req-338700cc-5950-42ad-ae0c-e26b41ebf19f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:59.403004 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-f8c8145a-480d-404b-8e75-f535589fe243 req-338700cc-5950-42ad-ae0c-e26b41ebf19f service nova] Creating event network-vif-unplugged:8bb810a3-e086-4b58-bef2-f3a96202f1cd for instance b628388b-e782-439f-b76a-ab248b22404a on n-h2-836830-4 Jun 16 14:44:59.436789 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [req-f8c8145a-480d-404b-8e75-f535589fe243 req-338700cc-5950-42ad-ae0c-e26b41ebf19f service nova] Instance b628388b-e782-439f-b76a-ab248b22404a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:44:59.523932 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-f8c8145a-480d-404b-8e75-f535589fe243 req-338700cc-5950-42ad-ae0c-e26b41ebf19f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.272322 Jun 16 14:44:59.528817 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 735/1475] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:44:59.559443 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-20835e06-fe7e-4290-9d4a-db35ec878f93 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:59.561361 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-20835e06-fe7e-4290-9d4a-db35ec878f93 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:59.578201 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-20835e06-fe7e-4290-9d4a-db35ec878f93 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:59.580409 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-20835e06-fe7e-4290-9d4a-db35ec878f93 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:59.582833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-20835e06-fe7e-4290-9d4a-db35ec878f93 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:59.584520 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-20835e06-fe7e-4290-9d4a-db35ec878f93 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:59.640481 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-40d1ec11-3c46-4c68-97bf-25107f6c0c6c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:44:59.680229 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-40d1ec11-3c46-4c68-97bf-25107f6c0c6c tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1535 microversion: 2.1 time: 2.233449 Jun 16 14:44:59.682014 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 741/1476] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:57 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1535 bytes in 2240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:59.705262 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b28326f6-c21f-42ee-9fea-d4ae586cf418 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:59.711119 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b28326f6-c21f-42ee-9fea-d4ae586cf418 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:59.740374 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b28326f6-c21f-42ee-9fea-d4ae586cf418 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:59.741781 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b28326f6-c21f-42ee-9fea-d4ae586cf418 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:59.746054 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b28326f6-c21f-42ee-9fea-d4ae586cf418 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:59.748063 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b28326f6-c21f-42ee-9fea-d4ae586cf418 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:59.832846 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b28326f6-c21f-42ee-9fea-d4ae586cf418 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.147149 Jun 16 14:44:59.833840 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 742/1477] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jun 16 14:44:59 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:44:59.839552 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-624fd7b8-c75b-4749-96bc-4efcff489c4a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:44:59.840624 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-624fd7b8-c75b-4749-96bc-4efcff489c4a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:44:59.849065 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-624fd7b8-c75b-4749-96bc-4efcff489c4a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:59.849840 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-624fd7b8-c75b-4749-96bc-4efcff489c4a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:44:59.851108 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-624fd7b8-c75b-4749-96bc-4efcff489c4a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:44:59.851743 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-624fd7b8-c75b-4749-96bc-4efcff489c4a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:00.155371 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=5 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:00.799223 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-20835e06-fe7e-4290-9d4a-db35ec878f93 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:00.811615 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:00.839906 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-20835e06-fe7e-4290-9d4a-db35ec878f93 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1308 microversion: 2.1 time: 1.303630 Jun 16 14:45:00.852504 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 736/1478] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:59 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1308 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:00.868623 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-624fd7b8-c75b-4749-96bc-4efcff489c4a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:00.887835 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9487e6d2-48d4-4057-8d6f-b0a4dd04511f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:00.888475 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9487e6d2-48d4-4057-8d6f-b0a4dd04511f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:00.901998 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-624fd7b8-c75b-4749-96bc-4efcff489c4a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1316 microversion: 2.1 time: 1.051599 Jun 16 14:45:00.902690 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 743/1479] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:44:59 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1316 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:00.958352 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9487e6d2-48d4-4057-8d6f-b0a4dd04511f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:00.958850 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9487e6d2-48d4-4057-8d6f-b0a4dd04511f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:00.966456 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-070aa60d-346a-4737-a5c0-ca19e4be67f2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:00.967138 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-070aa60d-346a-4737-a5c0-ca19e4be67f2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:00.973958 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9487e6d2-48d4-4057-8d6f-b0a4dd04511f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:00.978244 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9487e6d2-48d4-4057-8d6f-b0a4dd04511f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:00.997920 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-070aa60d-346a-4737-a5c0-ca19e4be67f2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:00.998543 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-070aa60d-346a-4737-a5c0-ca19e4be67f2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:01.004382 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-070aa60d-346a-4737-a5c0-ca19e4be67f2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:01.011266 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-070aa60d-346a-4737-a5c0-ca19e4be67f2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:01.685440 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-070aa60d-346a-4737-a5c0-ca19e4be67f2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:01.716708 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-070aa60d-346a-4737-a5c0-ca19e4be67f2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1535 microversion: 2.1 time: 0.798196 Jun 16 14:45:01.722746 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 744/1480] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:00 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1535 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:01.742267 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4cf46a04-091c-43a9-a94d-a8c18c494f69 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:01.758094 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4cf46a04-091c-43a9-a94d-a8c18c494f69 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:01.779808 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4cf46a04-091c-43a9-a94d-a8c18c494f69 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:01.780660 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4cf46a04-091c-43a9-a94d-a8c18c494f69 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:01.785432 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4cf46a04-091c-43a9-a94d-a8c18c494f69 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:01.790192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4cf46a04-091c-43a9-a94d-a8c18c494f69 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:01.904668 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4cf46a04-091c-43a9-a94d-a8c18c494f69 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.179961 Jun 16 14:45:01.912324 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 745/1481] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jun 16 14:45:01 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:01.919512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-9b7663af-4f15-4f56-936e-07a579a6da19 req-fa914d29-88d8-4478-918c-c5fa170e374b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26234dd2-d806-4819-ac5a-651c8dd442ef", "tag": "ec234d03-baa1-4218-9879-5938404785e9"}, {"name": "network-changed", "server_uuid": "b628388b-e782-439f-b76a-ab248b22404a", "tag": "8bb810a3-e086-4b58-bef2-f3a96202f1cd"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:01.963293 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-9b7663af-4f15-4f56-936e-07a579a6da19 req-fa914d29-88d8-4478-918c-c5fa170e374b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:01.963757 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-9b7663af-4f15-4f56-936e-07a579a6da19 req-fa914d29-88d8-4478-918c-c5fa170e374b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:02.045026 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-9b7663af-4f15-4f56-936e-07a579a6da19 req-fa914d29-88d8-4478-918c-c5fa170e374b service nova] Creating event network-changed:ec234d03-baa1-4218-9879-5938404785e9 for instance 26234dd2-d806-4819-ac5a-651c8dd442ef on n-h1-836830-4 Jun 16 14:45:02.045555 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-9b7663af-4f15-4f56-936e-07a579a6da19 req-fa914d29-88d8-4478-918c-c5fa170e374b service nova] Creating event network-changed:8bb810a3-e086-4b58-bef2-f3a96202f1cd for instance b628388b-e782-439f-b76a-ab248b22404a on n-h2-836830-4 Jun 16 14:45:02.082580 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [req-9b7663af-4f15-4f56-936e-07a579a6da19 req-fa914d29-88d8-4478-918c-c5fa170e374b service nova] Instance b628388b-e782-439f-b76a-ab248b22404a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:45:02.132458 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-9b7663af-4f15-4f56-936e-07a579a6da19 req-fa914d29-88d8-4478-918c-c5fa170e374b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.218267 Jun 16 14:45:02.141158 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 746/1482] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:02.152194 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9487e6d2-48d4-4057-8d6f-b0a4dd04511f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:02.168103 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d017f9d2-e51f-4aef-929e-340c66f7ab88 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:02.168859 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d017f9d2-e51f-4aef-929e-340c66f7ab88 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:02.195375 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9487e6d2-48d4-4057-8d6f-b0a4dd04511f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 1.331938 Jun 16 14:45:02.195375 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 737/1483] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:00 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:02.211364 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c038e4a3-89e6-49c5-9f4c-dfdcef372ea0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:02.212792 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c038e4a3-89e6-49c5-9f4c-dfdcef372ea0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:02.220908 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d017f9d2-e51f-4aef-929e-340c66f7ab88 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:02.224132 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d017f9d2-e51f-4aef-929e-340c66f7ab88 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:02.239055 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c038e4a3-89e6-49c5-9f4c-dfdcef372ea0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:02.243032 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c038e4a3-89e6-49c5-9f4c-dfdcef372ea0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:02.248263 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c038e4a3-89e6-49c5-9f4c-dfdcef372ea0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:02.248671 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d017f9d2-e51f-4aef-929e-340c66f7ab88 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:02.249622 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c038e4a3-89e6-49c5-9f4c-dfdcef372ea0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:02.255521 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d017f9d2-e51f-4aef-929e-340c66f7ab88 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:03.151458 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d017f9d2-e51f-4aef-929e-340c66f7ab88 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:03.168781 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d017f9d2-e51f-4aef-929e-340c66f7ab88 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1308 microversion: 2.1 time: 1.024856 Jun 16 14:45:03.169797 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 747/1484] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:02 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1308 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:03.456963 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-18e3d078-3f66-48a0-acb1-94fc4b870d0a tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Action: 'create', calling method: .version_select at 0x7fdf0c5c5940>, body: {"keypair": {"name": "tempest-keypair-1051454349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjefEWoeoBpw1HdTU0nxgor139JNm0JbmbYBHFLlIJSYi1JidRjKBTUqTqzG57bWndUfaIBHl37IWgJC7bmxeRLtJ6QkhEKrcB+3o8CUKSqWZAeIVePFQQkb0FkmjaZtA=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:03.519690 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-18e3d078-3f66-48a0-acb1-94fc4b870d0a tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Getting quotas for project a3e28475953e4546abdc202260ffba7f. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:03.525460 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c038e4a3-89e6-49c5-9f4c-dfdcef372ea0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:03.533044 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-18e3d078-3f66-48a0-acb1-94fc4b870d0a tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Getting quotas for user 5b24018bdf2744359c7d8ff9c6182660 and project a3e28475953e4546abdc202260ffba7f. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:03.561339 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c038e4a3-89e6-49c5-9f4c-dfdcef372ea0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1316 microversion: 2.1 time: 1.366974 Jun 16 14:45:03.581593 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 738/1485] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:02 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1316 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:03.603890 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-18e3d078-3f66-48a0-acb1-94fc4b870d0a tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.432378 Jun 16 14:45:03.605506 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 748/1486] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:45:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:03.614724 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9104bf19-a2c6-453e-a92b-a6e21d9a8896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:03.616364 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9104bf19-a2c6-453e-a92b-a6e21d9a8896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:03.623028 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-472750b5-a51b-48a2-88fa-5957c4cc63d1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:03.623300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-472750b5-a51b-48a2-88fa-5957c4cc63d1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:03.645742 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-472750b5-a51b-48a2-88fa-5957c4cc63d1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:03.646858 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-472750b5-a51b-48a2-88fa-5957c4cc63d1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:03.649915 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-472750b5-a51b-48a2-88fa-5957c4cc63d1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:03.650925 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-472750b5-a51b-48a2-88fa-5957c4cc63d1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:03.659620 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9104bf19-a2c6-453e-a92b-a6e21d9a8896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:03.671715 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9104bf19-a2c6-453e-a92b-a6e21d9a8896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:03.675451 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9104bf19-a2c6-453e-a92b-a6e21d9a8896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:03.676556 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9104bf19-a2c6-453e-a92b-a6e21d9a8896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:03.783000 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-472750b5-a51b-48a2-88fa-5957c4cc63d1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.172805 Jun 16 14:45:03.788597 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 749/1487] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jun 16 14:45:03 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:03.813180 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8d09028d-fb59-4baa-9c2f-7affcb866631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:03.816161 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8d09028d-fb59-4baa-9c2f-7affcb866631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:03.847949 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8d09028d-fb59-4baa-9c2f-7affcb866631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:03.849559 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8d09028d-fb59-4baa-9c2f-7affcb866631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:03.851110 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8d09028d-fb59-4baa-9c2f-7affcb866631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:03.853115 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8d09028d-fb59-4baa-9c2f-7affcb866631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:04.103350 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9104bf19-a2c6-453e-a92b-a6e21d9a8896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:04.132575 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9104bf19-a2c6-453e-a92b-a6e21d9a8896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1535 microversion: 2.1 time: 0.548311 Jun 16 14:45:04.133532 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 739/1488] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:03 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1535 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:04.175708 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-07c54b2c-4d93-42d3-893e-6cf8c2ef9a8f tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Calling method '.version_select at 0x7fdf0c1a0a60>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:04.203075 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-07c54b2c-4d93-42d3-893e-6cf8c2ef9a8f tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] 10.222.0.57 "GET /compute/v2.1/os-keypairs/tempest-keypair-1051454349" status: 200 len: 498 microversion: 2.1 time: 0.036684 Jun 16 14:45:04.216079 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 740/1489] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jun 16 14:45:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1051454349 => generated 498 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:04.226686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1b3f1ba1-4d91-4251-8285-08a684f27d06 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:04.228228 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1b3f1ba1-4d91-4251-8285-08a684f27d06 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:04.247675 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1b3f1ba1-4d91-4251-8285-08a684f27d06 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:04.248816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1b3f1ba1-4d91-4251-8285-08a684f27d06 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:04.252724 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1b3f1ba1-4d91-4251-8285-08a684f27d06 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:04.253710 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1b3f1ba1-4d91-4251-8285-08a684f27d06 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:04.545317 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8d09028d-fb59-4baa-9c2f-7affcb866631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:04.569127 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:04.582363 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8d09028d-fb59-4baa-9c2f-7affcb866631 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 0.782716 Jun 16 14:45:04.586066 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 750/1490] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:03 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:04.620571 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4b51d74b-76da-49e2-a344-fdca78c7f932 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Calling method '.version_select at 0x7fdf0c3360d0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:04.701041 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4b51d74b-76da-49e2-a344-fdca78c7f932 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051454349" status: 202 len: 0 microversion: 2.1 time: 0.111237 Jun 16 14:45:04.701818 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 751/1491] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jun 16 14:45:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051454349 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:45:04.724488 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-aafd68f3-f9cc-48ac-97c9-b06658942e06 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:04.726916 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-aafd68f3-f9cc-48ac-97c9-b06658942e06 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:04.745238 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aafd68f3-f9cc-48ac-97c9-b06658942e06 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:04.746071 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aafd68f3-f9cc-48ac-97c9-b06658942e06 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:04.749499 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aafd68f3-f9cc-48ac-97c9-b06658942e06 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:04.751120 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aafd68f3-f9cc-48ac-97c9-b06658942e06 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:04.771958 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1b3f1ba1-4d91-4251-8285-08a684f27d06 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:04.823848 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1b3f1ba1-4d91-4251-8285-08a684f27d06 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1308 microversion: 2.1 time: 0.605479 Jun 16 14:45:04.831125 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 741/1492] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:04 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1308 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:04.855924 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c8f503d2-bcbd-4549-8a2f-e63407f05042 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Action: 'create', calling method: .version_select at 0x7fdf0c243280>, body: {"keypair": {"name": "tempest-keypair-208305557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGO4BzZTbAH5P+3aftyksMM5h4TQzTeuRW8QIjYXi4Mnr9j1FvBuwhlBO3VD35euR0thud4rbMfR67+YEQDZi1uM/WtFlYnAiVmJkVENbs6dZqyzK54uB3wQQ3DjgumXsg=="}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:04.913763 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c8f503d2-bcbd-4549-8a2f-e63407f05042 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Getting quotas for project a3e28475953e4546abdc202260ffba7f. Resources: {'key_pairs'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:04.929298 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c8f503d2-bcbd-4549-8a2f-e63407f05042 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Getting quotas for user 5b24018bdf2744359c7d8ff9c6182660 and project a3e28475953e4546abdc202260ffba7f. Resources: {'key_pairs'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:05.014428 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c8f503d2-bcbd-4549-8a2f-e63407f05042 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.176102 Jun 16 14:45:05.021182 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 742/1493] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:45:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:05.056988 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-af54b51b-e649-4454-9c82-bdf492502a97 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:05.065472 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-af54b51b-e649-4454-9c82-bdf492502a97 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:05.083355 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af54b51b-e649-4454-9c82-bdf492502a97 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:05.083835 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af54b51b-e649-4454-9c82-bdf492502a97 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:05.084706 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af54b51b-e649-4454-9c82-bdf492502a97 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:05.085162 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af54b51b-e649-4454-9c82-bdf492502a97 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:05.169703 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-af54b51b-e649-4454-9c82-bdf492502a97 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.144355 Jun 16 14:45:05.177925 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 743/1494] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jun 16 14:45:05 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:05.183516 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dbd8e252-31a1-40c4-954e-e7bf504c4e18 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Calling method '.version_select at 0x7fdeffe58820>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:05.204082 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-aafd68f3-f9cc-48ac-97c9-b06658942e06 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:05.235691 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-aafd68f3-f9cc-48ac-97c9-b06658942e06 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1316 microversion: 2.1 time: 0.531578 Jun 16 14:45:05.239457 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 752/1495] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:04 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:05.245428 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-78e1d584-6788-4b62-a354-ff12ba73c282 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:05.246563 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-78e1d584-6788-4b62-a354-ff12ba73c282 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:05.258747 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-78e1d584-6788-4b62-a354-ff12ba73c282 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:05.261535 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-78e1d584-6788-4b62-a354-ff12ba73c282 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:05.263839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-78e1d584-6788-4b62-a354-ff12ba73c282 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:05.267518 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-78e1d584-6788-4b62-a354-ff12ba73c282 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:05.277905 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-dbd8e252-31a1-40c4-954e-e7bf504c4e18 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208305557" status: 202 len: 0 microversion: 2.1 time: 0.097719 Jun 16 14:45:05.279655 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 744/1496] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jun 16 14:45:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208305557 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:45:05.319338 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8dd6b569-8b22-4236-9a82-78d3aaa9a5f3 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Action: 'create', calling method: .version_select at 0x7fdf0c243b80>, body: {"keypair": {"name": "tempest-keypair-575252255", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:05.477202 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-8dd6b569-8b22-4236-9a82-78d3aaa9a5f3 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Getting quotas for project a3e28475953e4546abdc202260ffba7f. Resources: {'key_pairs'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:05.517991 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-8dd6b569-8b22-4236-9a82-78d3aaa9a5f3 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Getting quotas for user 5b24018bdf2744359c7d8ff9c6182660 and project a3e28475953e4546abdc202260ffba7f. Resources: {'key_pairs'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:05.580823 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:05.599377 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-78e1d584-6788-4b62-a354-ff12ba73c282 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:05.623960 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-78e1d584-6788-4b62-a354-ff12ba73c282 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1535 microversion: 2.1 time: 0.382769 Jun 16 14:45:05.634475 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 753/1497] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:05 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1535 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:05.638207 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8dd6b569-8b22-4236-9a82-78d3aaa9a5f3 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.339958 Jun 16 14:45:05.648017 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 745/1498] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:45:05 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:05.692705 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-77e9164a-045a-4e1c-8d5a-840cc38e9f6f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:05.701127 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-77e9164a-045a-4e1c-8d5a-840cc38e9f6f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:05.724803 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-77e9164a-045a-4e1c-8d5a-840cc38e9f6f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:05.728907 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-77e9164a-045a-4e1c-8d5a-840cc38e9f6f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:05.729975 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-77e9164a-045a-4e1c-8d5a-840cc38e9f6f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:05.730567 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-77e9164a-045a-4e1c-8d5a-840cc38e9f6f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:05.767067 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1248046423", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "487c2811-25df-4e80-8a06-b782ae938f03"}]}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:05.902512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] validate_networks() for [('487c2811-25df-4e80-8a06-b782ae938f03', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:45:07.514592 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-77e9164a-045a-4e1c-8d5a-840cc38e9f6f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:07.535281 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-77e9164a-045a-4e1c-8d5a-840cc38e9f6f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 1.880250 Jun 16 14:45:07.536291 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 746/1499] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:05 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:07.543790 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dd8941a4-c204-4019-a071-6cbc34be646b tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Calling method '.version_select at 0x7fdf0cb45940>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:07.581901 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-dd8941a4-c204-4019-a071-6cbc34be646b tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-575252255" status: 202 len: 0 microversion: 2.1 time: 0.043307 Jun 16 14:45:07.607257 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:45:07.608755 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:45:07.610292 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:45:07.613117 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:45:07.614007 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:45:07.617863 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 747/1500] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jun 16 14:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-575252255 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:45:07.639267 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1ce779af-29b1-40fb-a050-8317433a25a3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:07.639749 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:07.640489 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:07.641211 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1ce779af-29b1-40fb-a050-8317433a25a3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:07.642547 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:07.643235 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:07.657589 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1ce779af-29b1-40fb-a050-8317433a25a3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:07.661637 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1ce779af-29b1-40fb-a050-8317433a25a3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:07.663372 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1ce779af-29b1-40fb-a050-8317433a25a3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:07.664025 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1ce779af-29b1-40fb-a050-8317433a25a3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:07.680750 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Getting quotas for project b46102b0fb544d118e324f7fcf654eb2. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:07.713097 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Getting quotas for user 8fc694c86102467bb97072ca4972b223 and project b46102b0fb544d118e324f7fcf654eb2. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:07.757134 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:45:07.759658 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:45:07.875701 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1fdd4d99-f294-4c39-85c6-1d7082e96939 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.239354 Jun 16 14:45:07.877980 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 754/1501] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:45:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:45:07.887334 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8703f852-9862-4adb-b1eb-24d55e573ca5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:07.888891 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8703f852-9862-4adb-b1eb-24d55e573ca5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:07.903132 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8703f852-9862-4adb-b1eb-24d55e573ca5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:07.904631 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8703f852-9862-4adb-b1eb-24d55e573ca5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:07.906013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8703f852-9862-4adb-b1eb-24d55e573ca5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:07.907394 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8703f852-9862-4adb-b1eb-24d55e573ca5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:07.999475 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8703f852-9862-4adb-b1eb-24d55e573ca5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.116693 Jun 16 14:45:08.002019 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 755/1502] 10.222.0.57 () {60 vars in 1342 bytes} [Thu Jun 16 14:45:07 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:08.019422 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d65c2158-bbdc-4681-b2bb-88b95baa79a4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:08.021233 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d65c2158-bbdc-4681-b2bb-88b95baa79a4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:08.041896 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d65c2158-bbdc-4681-b2bb-88b95baa79a4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:08.045433 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d65c2158-bbdc-4681-b2bb-88b95baa79a4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:08.051344 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d65c2158-bbdc-4681-b2bb-88b95baa79a4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:08.053083 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d65c2158-bbdc-4681-b2bb-88b95baa79a4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:08.416243 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d65c2158-bbdc-4681-b2bb-88b95baa79a4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:08.430735 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d65c2158-bbdc-4681-b2bb-88b95baa79a4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1316 microversion: 2.1 time: 0.425697 Jun 16 14:45:08.435422 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 756/1503] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:08 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:08.447313 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ab773c1e-9e8d-4849-a6f2-ee1ab0909226 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:08.452674 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ab773c1e-9e8d-4849-a6f2-ee1ab0909226 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:08.468610 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ab773c1e-9e8d-4849-a6f2-ee1ab0909226 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:08.473169 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ab773c1e-9e8d-4849-a6f2-ee1ab0909226 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:08.474817 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ab773c1e-9e8d-4849-a6f2-ee1ab0909226 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:08.475483 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ab773c1e-9e8d-4849-a6f2-ee1ab0909226 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:08.870169 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ab773c1e-9e8d-4849-a6f2-ee1ab0909226 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:08.889973 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ab773c1e-9e8d-4849-a6f2-ee1ab0909226 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1528 microversion: 2.1 time: 0.447978 Jun 16 14:45:08.891907 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 757/1504] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:08 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1528 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:08.893878 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1ce779af-29b1-40fb-a050-8317433a25a3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:08.903084 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-84c0e564-b766-4425-96f4-834701e24c70 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Action: 'create', calling method: .version_select at 0x7fdf0c0b5e50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1726735796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlWHQhi8xXdWNdvs5gCLE819HkNl7KkEM4xLc2EGEvJfIgNqHSbAR1V6VI/SR28FmSQDUnfIkVtLwSfz9ySQoKvNIFInwNlQ9hFRn8J/oDUW5YG/8Tatz/yYwbcAY8XJQ=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:08.907847 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1ce779af-29b1-40fb-a050-8317433a25a3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1308 microversion: 2.1 time: 1.282661 Jun 16 14:45:08.908469 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 748/1505] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:07 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1308 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:08.931379 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f431e026-c371-4402-ada9-ad2a722c9890 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:08.932047 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f431e026-c371-4402-ada9-ad2a722c9890 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:08.965010 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-84c0e564-b766-4425-96f4-834701e24c70 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Getting quotas for project a3e28475953e4546abdc202260ffba7f. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:08.982296 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-84c0e564-b766-4425-96f4-834701e24c70 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Getting quotas for user 5b24018bdf2744359c7d8ff9c6182660 and project a3e28475953e4546abdc202260ffba7f. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:09.001371 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:09.056015 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-84c0e564-b766-4425-96f4-834701e24c70 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.162501 Jun 16 14:45:09.069078 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 758/1506] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:45:08 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:09.081358 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-53265a7e-4af4-4b53-b7b8-a4e0b0733d1c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '.version_select at 0x7fdf0c39b4c0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:09.149771 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-53265a7e-4af4-4b53-b7b8-a4e0b0733d1c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-420159285" status: 204 len: 0 microversion: 2.25 time: 0.078881 Jun 16 14:45:09.151956 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 759/1507] 10.222.0.57 () {60 vars in 1258 bytes} [Thu Jun 16 14:45:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-420159285 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 14:45:09.193271 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-649ab92c-9b6f-4f0f-a0cc-d256c48a397f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:09.198286 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-649ab92c-9b6f-4f0f-a0cc-d256c48a397f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:09.202899 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f431e026-c371-4402-ada9-ad2a722c9890 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:09.216844 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f431e026-c371-4402-ada9-ad2a722c9890 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1225 microversion: 2.1 time: 0.307072 Jun 16 14:45:09.219577 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-649ab92c-9b6f-4f0f-a0cc-d256c48a397f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:09.220228 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 749/1508] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:08 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1225 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:09.229147 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-649ab92c-9b6f-4f0f-a0cc-d256c48a397f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:09.229147 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-649ab92c-9b6f-4f0f-a0cc-d256c48a397f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:09.229147 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-649ab92c-9b6f-4f0f-a0cc-d256c48a397f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:09.235843 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-94c35a48-35ac-4e80-80c8-1879026057af tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:09.247398 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-94c35a48-35ac-4e80-80c8-1879026057af tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:09.261223 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-94c35a48-35ac-4e80-80c8-1879026057af tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:09.262000 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-94c35a48-35ac-4e80-80c8-1879026057af tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:09.265537 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-94c35a48-35ac-4e80-80c8-1879026057af tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:09.268111 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-94c35a48-35ac-4e80-80c8-1879026057af tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:09.742591 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-649ab92c-9b6f-4f0f-a0cc-d256c48a397f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:09.775323 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-649ab92c-9b6f-4f0f-a0cc-d256c48a397f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 0.620152 Jun 16 14:45:09.776000 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 760/1509] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:09 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:09.807761 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7a499098-35be-4b68-8301-08e26c6bb0a1 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Action: 'create', calling method: .version_select at 0x7fdf0c2b0820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1824900208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMX+4njDHQcA33ck5nxxJWdSm6eVMphaw3oWS3MVlgZg3oJNwwbgpu4HIxjgiu7fe1YnPORydRWVwsPZJkPVT192jKsW++pftdF98wuafSFrKi4XLjDxEC1Woatpmabkzg=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:09.866445 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-7a499098-35be-4b68-8301-08e26c6bb0a1 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Getting quotas for project a3e28475953e4546abdc202260ffba7f. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:09.895302 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-7a499098-35be-4b68-8301-08e26c6bb0a1 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Getting quotas for user 5b24018bdf2744359c7d8ff9c6182660 and project a3e28475953e4546abdc202260ffba7f. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:09.974597 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7a499098-35be-4b68-8301-08e26c6bb0a1 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.197363 Jun 16 14:45:09.976017 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 761/1510] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:45:09 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:09.987634 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a896750c-96aa-4471-9feb-d8e535f5771e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:09.988799 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a896750c-96aa-4471-9feb-d8e535f5771e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:10.005391 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a896750c-96aa-4471-9feb-d8e535f5771e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:10.010949 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a896750c-96aa-4471-9feb-d8e535f5771e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:10.012316 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a896750c-96aa-4471-9feb-d8e535f5771e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:10.012955 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a896750c-96aa-4471-9feb-d8e535f5771e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:10.185153 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-94c35a48-35ac-4e80-80c8-1879026057af tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:10.196876 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-94c35a48-35ac-4e80-80c8-1879026057af tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1528 microversion: 2.1 time: 0.965155 Jun 16 14:45:10.214352 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 750/1511] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:09 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1528 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:10.226127 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f006f6e1-9fc7-41bc-98eb-445f4415ef78 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:10.226898 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f006f6e1-9fc7-41bc-98eb-445f4415ef78 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:10.269836 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f006f6e1-9fc7-41bc-98eb-445f4415ef78 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:10.270339 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f006f6e1-9fc7-41bc-98eb-445f4415ef78 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:10.271318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f006f6e1-9fc7-41bc-98eb-445f4415ef78 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:10.271777 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f006f6e1-9fc7-41bc-98eb-445f4415ef78 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:10.625632 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a896750c-96aa-4471-9feb-d8e535f5771e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:10.645267 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a896750c-96aa-4471-9feb-d8e535f5771e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1316 microversion: 2.1 time: 0.665654 Jun 16 14:45:10.646357 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 762/1512] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:09 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1316 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:10.672920 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-233d91cd-643a-4255-9a28-56b3e769312c tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Action: 'create', calling method: .version_select at 0x7fdeffb8b9d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1786949274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqoj7bXSt//6cr5NsBRryHev78Gv8Q3zoltOq5mo1inlryqA+YotpFdR0y8Kz+hkmFqimvSziTRo1bmwmE1QrkS2hba4vDuL+jG0M0aaUXrz/x7WCA3AVdcJDe5y7yx5w=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:10.725268 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-233d91cd-643a-4255-9a28-56b3e769312c tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Getting quotas for project a3e28475953e4546abdc202260ffba7f. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:10.759421 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-233d91cd-643a-4255-9a28-56b3e769312c tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Getting quotas for user 5b24018bdf2744359c7d8ff9c6182660 and project a3e28475953e4546abdc202260ffba7f. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:10.831318 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-233d91cd-643a-4255-9a28-56b3e769312c tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.170496 Jun 16 14:45:10.832388 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 763/1513] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:45:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:10.840173 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-82a07a4c-ef89-4a5d-9a96-4038738bd6b6 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:10.841434 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:45:10.841434 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:45:10.850677 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-82a07a4c-ef89-4a5d-9a96-4038738bd6b6 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] HTTP exception thrown: Flavor e9e21919-a01a-42b3-957e-76b9e7ce107e could not be found. Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-82a07a4c-ef89-4a5d-9a96-4038738bd6b6 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Request method failure captured: Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/flavors/e9e21919-a01a-42b3-957e-76b9e7ce107e HTTP/1.1 Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0DYnUL1yn2hqkdrtWUKRcGc24PKkmIqQG-th_QiOC2uMofrx0dMgaOADbnvzO4VZpSsxQ77jNVAAp_yn738X8yzYErNqW-LV2BlDwvETlloRq8RcoWoloM4R0Xxa2Ms5zDU2SQ2nxkTkIF1ETSW2r8LJCSDA_tjOdxhJJkBitrACVw Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: acfd3583f5c54aa9b355c861148731b3 Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-MigrationsAdminTest-1251561143 Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:45:10.861355 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:45:10.864351 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_acfd3583f5c54aa9b355c861148731b3", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/acfd3583f5c54aa9b355c861148731b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/acfd3583f5c54aa9b355c861148731b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/acfd3583f5c54aa9b355c861148731b3"}]}] Jun 16 14:45:10.864351 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-MigrationsAdminTest-1251561143 Jun 16 14:45:10.864351 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: acfd3583f5c54aa9b355c861148731b3 Jun 16 14:45:10.864351 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-MigrationsAdminTest-1251561143 Jun 16 14:45:10.864351 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-MigrationsAdminTest-1251561143-project-admin Jun 16 14:45:10.864351 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:45:10.864351 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:45:10.864351 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 7027abf25d204ad0920f6fbf5ae3d8a1 Jun 16 14:45:10.864351 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-MigrationsAdminTest-1251561143-project-admin Jun 16 14:45:10.864351 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:45:10.864351 n-d-836830-4 devstack@n-api.service[125863]: exception: Flavor e9e21919-a01a-42b3-957e-76b9e7ce107e could not be found. Jun 16 14:45:10.864351 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'e9e21919-a01a-42b3-957e-76b9e7ce107e'} Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi flavor.destroy() Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor e9e21919-a01a-42b3-957e-76b9e7ce107e could not be found. Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:10.866299 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor e9e21919-a01a-42b3-957e-76b9e7ce107e could not be found. Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor e9e21919-a01a-42b3-957e-76b9e7ce107e could not be found. Jun 16 14:45:10.868280 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:10.872268 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-82a07a4c-ef89-4a5d-9a96-4038738bd6b6 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Returning 404 to user: Flavor e9e21919-a01a-42b3-957e-76b9e7ce107e could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:45:10.878597 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-82a07a4c-ef89-4a5d-9a96-4038738bd6b6 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] 10.222.0.57 "DELETE /compute/v2.1/flavors/e9e21919-a01a-42b3-957e-76b9e7ce107e" status: 404 len: 109 microversion: 2.1 time: 0.044384 Jun 16 14:45:10.879978 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 764/1514] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:45:10 2022] DELETE /compute/v2.1/flavors/e9e21919-a01a-42b3-957e-76b9e7ce107e => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:45:10.892282 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2a7ed08c-865a-41cd-8387-153803abb8c7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:10.893288 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2a7ed08c-865a-41cd-8387-153803abb8c7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:10.903275 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a7ed08c-865a-41cd-8387-153803abb8c7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:10.904608 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a7ed08c-865a-41cd-8387-153803abb8c7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:10.905667 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a7ed08c-865a-41cd-8387-153803abb8c7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:10.907229 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a7ed08c-865a-41cd-8387-153803abb8c7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:10.973133 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f006f6e1-9fc7-41bc-98eb-445f4415ef78 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:11.002144 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f006f6e1-9fc7-41bc-98eb-445f4415ef78 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1308 microversion: 2.1 time: 0.793227 Jun 16 14:45:11.003265 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 751/1515] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:10 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1308 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:11.019897 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-5a45483b-e8a5-4212-a2d5-3d36cf73b6f0 req-c9f494ce-b802-467b-be35-9d9b8e8a469e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc", "name": "network-vif-plugged", "status": "completed", "tag": "05c0eff0-1b94-46e0-bbf5-a7cf99df002c"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:11.063860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-5a45483b-e8a5-4212-a2d5-3d36cf73b6f0 req-c9f494ce-b802-467b-be35-9d9b8e8a469e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:11.064651 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-5a45483b-e8a5-4212-a2d5-3d36cf73b6f0 req-c9f494ce-b802-467b-be35-9d9b8e8a469e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:11.129124 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-5a45483b-e8a5-4212-a2d5-3d36cf73b6f0 req-c9f494ce-b802-467b-be35-9d9b8e8a469e service nova] Creating event network-vif-plugged:05c0eff0-1b94-46e0-bbf5-a7cf99df002c for instance 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc on n-h2-836830-4 Jun 16 14:45:11.150035 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-5a45483b-e8a5-4212-a2d5-3d36cf73b6f0 req-c9f494ce-b802-467b-be35-9d9b8e8a469e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141588 Jun 16 14:45:11.152144 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 752/1516] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:11.172519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3fa795e4-5a2b-4a9e-9f0d-3858058047b8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:11.174297 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3fa795e4-5a2b-4a9e-9f0d-3858058047b8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:11.217200 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3fa795e4-5a2b-4a9e-9f0d-3858058047b8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:11.220173 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3fa795e4-5a2b-4a9e-9f0d-3858058047b8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:11.228089 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3fa795e4-5a2b-4a9e-9f0d-3858058047b8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:11.229539 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3fa795e4-5a2b-4a9e-9f0d-3858058047b8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:11.470075 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2a7ed08c-865a-41cd-8387-153803abb8c7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:11.493872 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2a7ed08c-865a-41cd-8387-153803abb8c7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1283 microversion: 2.1 time: 0.609216 Jun 16 14:45:11.510432 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 765/1517] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:10 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1283 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:11.522552 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7268d6b9-d29e-4120-9360-dbcb1166dea7 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Calling method '.version_select at 0x7fdf0c6c74c0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:11.533168 n-d-836830-4 devstack@n-api.service[125863]: WARNING oslo_db.sqlalchemy.utils [None req-7268d6b9-d29e-4120-9360-dbcb1166dea7 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 16 14:45:11.551625 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7268d6b9-d29e-4120-9360-dbcb1166dea7 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] 10.222.0.57 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.053252 Jun 16 14:45:11.552667 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 766/1518] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:45:11 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:11.566682 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1144129926", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:11.681134 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:45:12.121654 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3fa795e4-5a2b-4a9e-9f0d-3858058047b8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:12.140930 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3fa795e4-5a2b-4a9e-9f0d-3858058047b8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 0.986745 Jun 16 14:45:12.141528 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 753/1519] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:11 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:12.165984 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1d83cf39-ec5a-40ad-8401-e51a0a2aa3e9 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Calling method '.version_select at 0x7fdeffedd8b0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:12.221655 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1d83cf39-ec5a-40ad-8401-e51a0a2aa3e9 tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1786949274" status: 202 len: 0 microversion: 2.1 time: 0.070078 Jun 16 14:45:12.227592 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 754/1520] 10.222.0.57 () {58 vars in 1277 bytes} [Thu Jun 16 14:45:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1786949274 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:45:12.244127 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7a59c797-654b-4413-b629-f1ac2961a754 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:12.246201 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7a59c797-654b-4413-b629-f1ac2961a754 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:12.281979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7a59c797-654b-4413-b629-f1ac2961a754 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:12.283576 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7a59c797-654b-4413-b629-f1ac2961a754 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:12.288758 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7a59c797-654b-4413-b629-f1ac2961a754 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:12.295828 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7a59c797-654b-4413-b629-f1ac2961a754 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:12.766329 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7a59c797-654b-4413-b629-f1ac2961a754 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:12.778260 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7a59c797-654b-4413-b629-f1ac2961a754 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1316 microversion: 2.1 time: 0.554358 Jun 16 14:45:12.783802 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 755/1521] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:12 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1316 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:12.795805 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e99d2b0a-7ea4-4784-a566-5a73513bad1b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:12.797204 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e99d2b0a-7ea4-4784-a566-5a73513bad1b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:12.815863 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e99d2b0a-7ea4-4784-a566-5a73513bad1b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:12.818476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e99d2b0a-7ea4-4784-a566-5a73513bad1b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:12.821017 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e99d2b0a-7ea4-4784-a566-5a73513bad1b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:12.825313 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e99d2b0a-7ea4-4784-a566-5a73513bad1b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:12.848114 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:45:12.849362 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:45:12.849866 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:45:12.850516 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:45:12.850947 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:45:12.868655 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:12.869120 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:12.870043 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:12.870731 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:12.954825 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Getting quotas for project 414e3b792647435daa2ecce22a2c6132. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:12.967397 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Getting quotas for user 65cde69f3b52448c8b08297b548bb377 and project 414e3b792647435daa2ecce22a2c6132. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:13.011513 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:45:13.013852 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:45:13.166523 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6676acbb-b262-4266-b4a6-05f64ee8270a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.611897 Jun 16 14:45:13.167453 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 767/1522] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:45:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:45:13.196706 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9bdc907c-f595-4f14-b1b3-33de43e6b87b tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Calling method '.version_select at 0x7fdf0c32e430>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:13.266163 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9bdc907c-f595-4f14-b1b3-33de43e6b87b tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1824900208" status: 202 len: 0 microversion: 2.1 time: 0.096494 Jun 16 14:45:13.267766 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 768/1523] 10.222.0.57 () {58 vars in 1277 bytes} [Thu Jun 16 14:45:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1824900208 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:45:13.293597 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cfa43ccc-16bd-43fe-a297-f695895dff1d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:13.294833 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cfa43ccc-16bd-43fe-a297-f695895dff1d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:13.337289 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cfa43ccc-16bd-43fe-a297-f695895dff1d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:13.338255 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cfa43ccc-16bd-43fe-a297-f695895dff1d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:13.340079 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cfa43ccc-16bd-43fe-a297-f695895dff1d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:13.347946 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cfa43ccc-16bd-43fe-a297-f695895dff1d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:13.452528 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e99d2b0a-7ea4-4784-a566-5a73513bad1b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:13.502012 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e99d2b0a-7ea4-4784-a566-5a73513bad1b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1308 microversion: 2.1 time: 0.705539 Jun 16 14:45:13.505706 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 756/1524] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:12 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1308 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:13.535581 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b016e143-f096-4bf7-8cf9-36c561536f10 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:13.536949 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b016e143-f096-4bf7-8cf9-36c561536f10 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:13.560668 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b016e143-f096-4bf7-8cf9-36c561536f10 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:13.564267 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b016e143-f096-4bf7-8cf9-36c561536f10 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:13.569285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b016e143-f096-4bf7-8cf9-36c561536f10 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:13.569858 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b016e143-f096-4bf7-8cf9-36c561536f10 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:14.205028 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-cfa43ccc-16bd-43fe-a297-f695895dff1d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:14.239813 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cfa43ccc-16bd-43fe-a297-f695895dff1d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1325 microversion: 2.1 time: 0.963196 Jun 16 14:45:14.241227 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 769/1525] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:13 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1325 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:14.263440 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-96d072d1-7dc1-4685-bc38-1121933463d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:14.264394 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-96d072d1-7dc1-4685-bc38-1121933463d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:14.287873 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-96d072d1-7dc1-4685-bc38-1121933463d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:14.291069 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-96d072d1-7dc1-4685-bc38-1121933463d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:14.293681 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-96d072d1-7dc1-4685-bc38-1121933463d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:14.294686 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-96d072d1-7dc1-4685-bc38-1121933463d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:14.527792 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-96d072d1-7dc1-4685-bc38-1121933463d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:14.548982 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-96d072d1-7dc1-4685-bc38-1121933463d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1217 microversion: 2.1 time: 0.296513 Jun 16 14:45:14.550013 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 770/1526] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:14 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1217 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:14.572949 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5f1afc51-8bd6-4129-a74e-10f82b25055b tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] Calling method '.version_select at 0x7fdeffbb7a60>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:14.660453 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5f1afc51-8bd6-4129-a74e-10f82b25055b tempest-KeyPairsV2TestJSON-924155855 tempest-KeyPairsV2TestJSON-924155855-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1726735796" status: 202 len: 0 microversion: 2.1 time: 0.106261 Jun 16 14:45:14.665477 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 771/1527] 10.222.0.57 () {58 vars in 1277 bytes} [Thu Jun 16 14:45:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1726735796 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:45:14.684319 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-977c2a3b-be97-4b61-946e-93c0c1fe4552 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:14.686332 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-977c2a3b-be97-4b61-946e-93c0c1fe4552 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:14.706465 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-977c2a3b-be97-4b61-946e-93c0c1fe4552 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:14.708524 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-977c2a3b-be97-4b61-946e-93c0c1fe4552 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:14.712282 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-977c2a3b-be97-4b61-946e-93c0c1fe4552 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:14.714431 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-977c2a3b-be97-4b61-946e-93c0c1fe4552 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:15.437135 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-977c2a3b-be97-4b61-946e-93c0c1fe4552 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:15.455122 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-977c2a3b-be97-4b61-946e-93c0c1fe4552 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1466 microversion: 2.1 time: 0.785546 Jun 16 14:45:15.461343 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 772/1528] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:14 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1466 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:15.466971 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-346a50f9-02e2-4104-b0ed-a5430e575eef tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:15.479433 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-346a50f9-02e2-4104-b0ed-a5430e575eef tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:15.504102 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-346a50f9-02e2-4104-b0ed-a5430e575eef tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:15.505918 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-346a50f9-02e2-4104-b0ed-a5430e575eef tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:15.507840 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-346a50f9-02e2-4104-b0ed-a5430e575eef tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:15.509511 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-346a50f9-02e2-4104-b0ed-a5430e575eef tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:15.556125 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b016e143-f096-4bf7-8cf9-36c561536f10 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:15.571996 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b016e143-f096-4bf7-8cf9-36c561536f10 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 2.062846 Jun 16 14:45:15.581718 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 757/1529] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:13 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 2074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:15.606992 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-f73d6e00-d427-445c-9ebe-15ff93b66f3f req-7a979bb8-6f4a-4c06-8418-7deb26624d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b628388b-e782-439f-b76a-ab248b22404a", "name": "network-vif-plugged", "status": "completed", "tag": "8bb810a3-e086-4b58-bef2-f3a96202f1cd"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:15.632747 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-f73d6e00-d427-445c-9ebe-15ff93b66f3f req-7a979bb8-6f4a-4c06-8418-7deb26624d70 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:15.636462 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-f73d6e00-d427-445c-9ebe-15ff93b66f3f req-7a979bb8-6f4a-4c06-8418-7deb26624d70 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:15.677166 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-f73d6e00-d427-445c-9ebe-15ff93b66f3f req-7a979bb8-6f4a-4c06-8418-7deb26624d70 service nova] Creating event network-vif-plugged:8bb810a3-e086-4b58-bef2-f3a96202f1cd for instance b628388b-e782-439f-b76a-ab248b22404a on n-h2-836830-4 Jun 16 14:45:15.697027 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-f73d6e00-d427-445c-9ebe-15ff93b66f3f req-7a979bb8-6f4a-4c06-8418-7deb26624d70 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106226 Jun 16 14:45:15.709039 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 758/1530] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:15.722875 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8abb71a5-dbd8-4cd5-b183-d038fd36c4bb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:15.724822 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8abb71a5-dbd8-4cd5-b183-d038fd36c4bb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:15.741115 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8abb71a5-dbd8-4cd5-b183-d038fd36c4bb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:15.742366 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8abb71a5-dbd8-4cd5-b183-d038fd36c4bb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:15.745222 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8abb71a5-dbd8-4cd5-b183-d038fd36c4bb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:15.747733 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8abb71a5-dbd8-4cd5-b183-d038fd36c4bb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:16.059702 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-346a50f9-02e2-4104-b0ed-a5430e575eef tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:16.072525 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-346a50f9-02e2-4104-b0ed-a5430e575eef tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1308 microversion: 2.1 time: 0.609534 Jun 16 14:45:16.076809 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 773/1531] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:15 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1308 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:17.028231 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d8602dd0-918e-4b1d-938c-fcaf074178ff tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:17.043048 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d8602dd0-918e-4b1d-938c-fcaf074178ff tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:17.075023 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d8602dd0-918e-4b1d-938c-fcaf074178ff tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:17.076310 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d8602dd0-918e-4b1d-938c-fcaf074178ff tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:17.084251 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d8602dd0-918e-4b1d-938c-fcaf074178ff tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:17.089861 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d8602dd0-918e-4b1d-938c-fcaf074178ff tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:17.482095 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8abb71a5-dbd8-4cd5-b183-d038fd36c4bb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:17.505228 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8abb71a5-dbd8-4cd5-b183-d038fd36c4bb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1325 microversion: 2.1 time: 1.793381 Jun 16 14:45:17.506115 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 759/1532] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:15 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1325 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:17.523014 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-829def61-fbbf-47f2-8c58-63b3f0d121fb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:17.524215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-829def61-fbbf-47f2-8c58-63b3f0d121fb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:17.536503 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-829def61-fbbf-47f2-8c58-63b3f0d121fb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:17.539669 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-829def61-fbbf-47f2-8c58-63b3f0d121fb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:17.542039 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-829def61-fbbf-47f2-8c58-63b3f0d121fb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:17.545553 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-829def61-fbbf-47f2-8c58-63b3f0d121fb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:17.733377 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-829def61-fbbf-47f2-8c58-63b3f0d121fb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:17.770839 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-829def61-fbbf-47f2-8c58-63b3f0d121fb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1271 microversion: 2.1 time: 0.263024 Jun 16 14:45:17.781764 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 760/1533] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:17 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1271 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:17.790978 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-2e3af725-8a77-425c-a38f-870e8c3a77ec req-32f0fae1-6d3a-4002-8b83-ddb25dee7a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4855363-724b-4eff-a76e-915e440af995", "tag": "f4722aca-79de-427f-b18d-882b6697a114"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:17.831604 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-2e3af725-8a77-425c-a38f-870e8c3a77ec req-32f0fae1-6d3a-4002-8b83-ddb25dee7a41 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:17.832136 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-2e3af725-8a77-425c-a38f-870e8c3a77ec req-32f0fae1-6d3a-4002-8b83-ddb25dee7a41 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:17.858731 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-2e3af725-8a77-425c-a38f-870e8c3a77ec req-32f0fae1-6d3a-4002-8b83-ddb25dee7a41 service nova] Creating event network-changed:f4722aca-79de-427f-b18d-882b6697a114 for instance e4855363-724b-4eff-a76e-915e440af995 on n-h1-836830-4 Jun 16 14:45:17.879106 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-2e3af725-8a77-425c-a38f-870e8c3a77ec req-32f0fae1-6d3a-4002-8b83-ddb25dee7a41 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093091 Jun 16 14:45:17.881654 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 761/1534] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:17.889312 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3f0ecf19-967c-4ed3-b0ad-b13041ad8de5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:17.891198 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3f0ecf19-967c-4ed3-b0ad-b13041ad8de5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:17.905112 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3f0ecf19-967c-4ed3-b0ad-b13041ad8de5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:17.906810 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3f0ecf19-967c-4ed3-b0ad-b13041ad8de5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:17.908189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3f0ecf19-967c-4ed3-b0ad-b13041ad8de5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:17.908876 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3f0ecf19-967c-4ed3-b0ad-b13041ad8de5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:17.942931 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:18.655918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3f0ecf19-967c-4ed3-b0ad-b13041ad8de5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:18.668753 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3f0ecf19-967c-4ed3-b0ad-b13041ad8de5 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 0.785514 Jun 16 14:45:18.691007 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 762/1535] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:17 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:18.698013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0466a7dd-de14-4159-9d52-99d6e57de386 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:18.699165 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0466a7dd-de14-4159-9d52-99d6e57de386 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:18.712912 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0466a7dd-de14-4159-9d52-99d6e57de386 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:18.713827 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0466a7dd-de14-4159-9d52-99d6e57de386 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:18.716929 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0466a7dd-de14-4159-9d52-99d6e57de386 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:18.719580 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0466a7dd-de14-4159-9d52-99d6e57de386 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:19.169508 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d8602dd0-918e-4b1d-938c-fcaf074178ff tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1617 microversion: 2.1 time: 3.082658 Jun 16 14:45:19.173642 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 774/1536] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:16 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1617 bytes in 3096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:19.181844 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0466a7dd-de14-4159-9d52-99d6e57de386 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:19.201191 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0466a7dd-de14-4159-9d52-99d6e57de386 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1308 microversion: 2.1 time: 0.507855 Jun 16 14:45:19.204773 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-6d4c303f-8627-4531-a3b8-a100f044d6a0 req-9f31d692-bdcb-4fb7-9ca7-b608cf4cb30d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26234dd2-d806-4819-ac5a-651c8dd442ef", "name": "network-vif-plugged", "status": "completed", "tag": "ec234d03-baa1-4218-9879-5938404785e9"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:19.213170 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 763/1537] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:18 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1308 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:19.219880 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-58e77cf2-3887-4217-8015-d84a614b0dfc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:19.220721 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-58e77cf2-3887-4217-8015-d84a614b0dfc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:19.222774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=10 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:19.239693 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-6d4c303f-8627-4531-a3b8-a100f044d6a0 req-9f31d692-bdcb-4fb7-9ca7-b608cf4cb30d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:19.243750 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-6d4c303f-8627-4531-a3b8-a100f044d6a0 req-9f31d692-bdcb-4fb7-9ca7-b608cf4cb30d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:19.250284 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-58e77cf2-3887-4217-8015-d84a614b0dfc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:19.253023 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-58e77cf2-3887-4217-8015-d84a614b0dfc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:19.254212 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-58e77cf2-3887-4217-8015-d84a614b0dfc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:19.254906 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-58e77cf2-3887-4217-8015-d84a614b0dfc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:19.300567 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-6d4c303f-8627-4531-a3b8-a100f044d6a0 req-9f31d692-bdcb-4fb7-9ca7-b608cf4cb30d service nova] Creating event network-vif-plugged:ec234d03-baa1-4218-9879-5938404785e9 for instance 26234dd2-d806-4819-ac5a-651c8dd442ef on n-h1-836830-4 Jun 16 14:45:19.323945 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-6d4c303f-8627-4531-a3b8-a100f044d6a0 req-9f31d692-bdcb-4fb7-9ca7-b608cf4cb30d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147775 Jun 16 14:45:19.329824 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 775/1538] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:19.344494 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2ffdc9ed-f097-4d41-b856-4f2ec317560a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:19.347548 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2ffdc9ed-f097-4d41-b856-4f2ec317560a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:19.362946 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ffdc9ed-f097-4d41-b856-4f2ec317560a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:19.364322 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ffdc9ed-f097-4d41-b856-4f2ec317560a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:19.367687 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ffdc9ed-f097-4d41-b856-4f2ec317560a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:19.368987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ffdc9ed-f097-4d41-b856-4f2ec317560a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:19.556484 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2ffdc9ed-f097-4d41-b856-4f2ec317560a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:19.570040 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2ffdc9ed-f097-4d41-b856-4f2ec317560a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1271 microversion: 2.1 time: 0.237624 Jun 16 14:45:19.572146 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 776/1539] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:19 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1271 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:19.773734 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-58e77cf2-3887-4217-8015-d84a614b0dfc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:19.785224 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-58e77cf2-3887-4217-8015-d84a614b0dfc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1325 microversion: 2.1 time: 0.570394 Jun 16 14:45:19.785863 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 764/1540] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:19 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1325 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:19.802182 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6786db9e-eae7-4c9e-957b-1e42d2d6721c tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Action: 'create', calling method: .version_select at 0x7fdf0c72c790>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-599293564", "policies": ["affinity"]}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:19.880110 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-6786db9e-eae7-4c9e-957b-1e42d2d6721c tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_groups'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:19.908773 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-6786db9e-eae7-4c9e-957b-1e42d2d6721c tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_groups'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:20.068259 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-6786db9e-eae7-4c9e-957b-1e42d2d6721c tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_groups'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:20.087395 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-6786db9e-eae7-4c9e-957b-1e42d2d6721c tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_groups'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:20.125582 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6786db9e-eae7-4c9e-957b-1e42d2d6721c tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.338463 Jun 16 14:45:20.127127 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 765/1541] 10.222.0.57 () {60 vars in 1173 bytes} [Thu Jun 16 14:45:19 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:20.141753 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-efb54d58-a350-4f94-b43c-87e6b2c22f68 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:20.142855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-efb54d58-a350-4f94-b43c-87e6b2c22f68 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:20.150076 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efb54d58-a350-4f94-b43c-87e6b2c22f68 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:20.151000 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efb54d58-a350-4f94-b43c-87e6b2c22f68 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:20.152093 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efb54d58-a350-4f94-b43c-87e6b2c22f68 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:20.152811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efb54d58-a350-4f94-b43c-87e6b2c22f68 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:20.347495 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ba680e7a-87e1-4eb3-9de5-356ec43385b0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Action: 'create', calling method: .version_select at 0x7fdf0c2dea60>, body: {"keypair": {"name": "tempest-keypair-1053520011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJRHyP+k8E9AnYgrETYIhydUcdpkaruKYELldOW+TVdXf8PeBaA2IG24gFGWNE9Rcu0jt5uAh01l7+dJG+dIrZxiJjtrnjZ6c69DfiBPqjuM20xAm+fw5z0T6wkjKzwBw=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:20.448188 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-ba680e7a-87e1-4eb3-9de5-356ec43385b0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Getting quotas for project f7683609ebb347cf82d4b2d7ed3198eb. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:20.497823 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-ba680e7a-87e1-4eb3-9de5-356ec43385b0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Getting quotas for user 4fb6234a28c1437d97f356504163406b and project f7683609ebb347cf82d4b2d7ed3198eb. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:20.629682 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-efb54d58-a350-4f94-b43c-87e6b2c22f68 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:20.641723 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-efb54d58-a350-4f94-b43c-87e6b2c22f68 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 0.513120 Jun 16 14:45:20.660441 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 766/1542] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:20 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:20.666804 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-c8d67f6c-9861-4211-8b7d-021993a4b6f4 req-200f647f-02c8-4d33-8f09-fed355d71cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a4bc09-c518-4934-842c-4ab2b5a50e0d", "tag": "9b779512-66fc-4a6a-a2ed-896ac2a82125"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:20.668857 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ba680e7a-87e1-4eb3-9de5-356ec43385b0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.091974 Jun 16 14:45:20.674608 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 777/1543] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:45:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:20.678539 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-c8d67f6c-9861-4211-8b7d-021993a4b6f4 req-200f647f-02c8-4d33-8f09-fed355d71cea service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:20.679543 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-c8d67f6c-9861-4211-8b7d-021993a4b6f4 req-200f647f-02c8-4d33-8f09-fed355d71cea service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:20.701968 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e35c9091-b8e8-4dc6-bf58-0abbd5d7dfc5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:20.706179 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e35c9091-b8e8-4dc6-bf58-0abbd5d7dfc5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:20.737268 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-c8d67f6c-9861-4211-8b7d-021993a4b6f4 req-200f647f-02c8-4d33-8f09-fed355d71cea service nova] Creating event network-changed:9b779512-66fc-4a6a-a2ed-896ac2a82125 for instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d on n-h2-836830-4 Jun 16 14:45:20.763798 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e35c9091-b8e8-4dc6-bf58-0abbd5d7dfc5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:20.764897 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e35c9091-b8e8-4dc6-bf58-0abbd5d7dfc5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:20.777908 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-c8d67f6c-9861-4211-8b7d-021993a4b6f4 req-200f647f-02c8-4d33-8f09-fed355d71cea service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113074 Jun 16 14:45:20.780832 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e35c9091-b8e8-4dc6-bf58-0abbd5d7dfc5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:20.782303 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 767/1544] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:20.784379 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e35c9091-b8e8-4dc6-bf58-0abbd5d7dfc5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:20.820284 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1440470186", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "1559d51e-ea8d-42f2-8628-45af7c1cb09b"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:20.959267 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] validate_networks() for None {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:45:22.026011 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:45:22.027144 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:45:22.027834 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:45:22.028865 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:45:22.031229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:45:22.210306 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:22.211274 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:22.213823 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:22.225533 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:22.242845 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e35c9091-b8e8-4dc6-bf58-0abbd5d7dfc5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:22.266951 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e35c9091-b8e8-4dc6-bf58-0abbd5d7dfc5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1308 microversion: 2.1 time: 1.590312 Jun 16 14:45:22.268863 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 778/1545] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:20 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1308 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:22.274887 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1d70754e-7dad-4c2f-b8ce-6e3bd4dcb080 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:22.276636 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1d70754e-7dad-4c2f-b8ce-6e3bd4dcb080 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:22.289076 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1d70754e-7dad-4c2f-b8ce-6e3bd4dcb080 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:22.291366 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1d70754e-7dad-4c2f-b8ce-6e3bd4dcb080 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:22.292552 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1d70754e-7dad-4c2f-b8ce-6e3bd4dcb080 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:22.293528 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1d70754e-7dad-4c2f-b8ce-6e3bd4dcb080 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:22.310582 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:22.326223 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:22.339841 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:22.354063 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Going to run 2 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:45:22.363560 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: ebabcdb6-1a81-4841-a33e-921e67a0d2f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:45:22.460592 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=125862) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jun 16 14:45:22.484553 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:22.513282 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:22.525401 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:22.646037 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:22.669934 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:22.714839 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=ebabcdb6-1a81-4841-a33e-921e67a0d2f6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:45:22.829534 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1d70754e-7dad-4c2f-b8ce-6e3bd4dcb080 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:22.853209 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1d70754e-7dad-4c2f-b8ce-6e3bd4dcb080 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1313 microversion: 2.1 time: 0.582374 Jun 16 14:45:22.867260 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 779/1546] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:22 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:22.877090 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b0940804-8f69-4179-8e76-b6efa134a77c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:22.888379 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b0940804-8f69-4179-8e76-b6efa134a77c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:22.914281 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b0940804-8f69-4179-8e76-b6efa134a77c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:22.915976 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b0940804-8f69-4179-8e76-b6efa134a77c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:22.925715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b0940804-8f69-4179-8e76-b6efa134a77c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:22.927120 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b0940804-8f69-4179-8e76-b6efa134a77c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:22.928346 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=4 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:22.942434 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:22.963216 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:23.075768 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:45:23.106207 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:45:23.174517 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c5e3d4c1-27ce-4283-a391-a4de59a9393a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.386239 Jun 16 14:45:23.178726 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 768/1547] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:45:20 2022] POST /compute/v2.1/servers => generated 32 bytes in 2392 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 16 14:45:23.189497 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-85ce68a4-b20c-4b68-b09c-705c8d817d02 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:23.196441 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-85ce68a4-b20c-4b68-b09c-705c8d817d02 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:23.219105 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85ce68a4-b20c-4b68-b09c-705c8d817d02 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:23.220354 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85ce68a4-b20c-4b68-b09c-705c8d817d02 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:23.227208 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85ce68a4-b20c-4b68-b09c-705c8d817d02 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:23.229866 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85ce68a4-b20c-4b68-b09c-705c8d817d02 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:23.582615 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b0940804-8f69-4179-8e76-b6efa134a77c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:23.598627 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b0940804-8f69-4179-8e76-b6efa134a77c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1325 microversion: 2.1 time: 0.729271 Jun 16 14:45:23.599567 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 780/1548] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:22 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1325 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:23.615223 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-318424e1-6670-44c7-9ce6-0117fd4d007f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:23.619123 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-318424e1-6670-44c7-9ce6-0117fd4d007f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:23.619947 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-318424e1-6670-44c7-9ce6-0117fd4d007f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Searching by: {'deleted': False, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8'} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:45:23.660014 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-318424e1-6670-44c7-9ce6-0117fd4d007f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:23.666109 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-318424e1-6670-44c7-9ce6-0117fd4d007f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:23.676079 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-318424e1-6670-44c7-9ce6-0117fd4d007f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:23.676682 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-318424e1-6670-44c7-9ce6-0117fd4d007f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:23.883877 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.multi_cell_list [None req-318424e1-6670-44c7-9ce6-0117fd4d007f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=125863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:45:24.049666 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-318424e1-6670-44c7-9ce6-0117fd4d007f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.448951 Jun 16 14:45:24.051144 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 781/1549] 10.222.0.57 () {58 vars in 1124 bytes} [Thu Jun 16 14:45:23 2022] GET /compute/v2.1/servers => generated 1003 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:24.057168 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-03f0cd64-a730-4303-ad15-af3715295424 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:24.058335 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-03f0cd64-a730-4303-ad15-af3715295424 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:24.062481 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:24.091823 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-03f0cd64-a730-4303-ad15-af3715295424 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:24.094153 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-03f0cd64-a730-4303-ad15-af3715295424 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:24.095608 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-03f0cd64-a730-4303-ad15-af3715295424 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:24.098879 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-03f0cd64-a730-4303-ad15-af3715295424 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:24.708955 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-85ce68a4-b20c-4b68-b09c-705c8d817d02 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:24.766159 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-85ce68a4-b20c-4b68-b09c-705c8d817d02 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 1.577741 Jun 16 14:45:24.769944 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 769/1550] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:23 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:24.797391 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-50ffadb4-63d7-4a71-9f36-cf5c8ed667a7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:24.802407 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-50ffadb4-63d7-4a71-9f36-cf5c8ed667a7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:24.844048 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50ffadb4-63d7-4a71-9f36-cf5c8ed667a7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:24.850877 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50ffadb4-63d7-4a71-9f36-cf5c8ed667a7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:24.854799 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50ffadb4-63d7-4a71-9f36-cf5c8ed667a7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:24.856392 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50ffadb4-63d7-4a71-9f36-cf5c8ed667a7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:24.929117 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-03f0cd64-a730-4303-ad15-af3715295424 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:24.950228 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-03f0cd64-a730-4303-ad15-af3715295424 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1488 microversion: 2.1 time: 0.897563 Jun 16 14:45:24.963714 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 782/1551] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:24 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1488 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:24.983997 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-32f5b4f7-e5ae-45c2-9380-49c7c2ec0999 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:24.985257 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-32f5b4f7-e5ae-45c2-9380-49c7c2ec0999 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:25.354493 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-32f5b4f7-e5ae-45c2-9380-49c7c2ec0999 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:25.357148 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=33 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:25.369023 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-32f5b4f7-e5ae-45c2-9380-49c7c2ec0999 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76" status: 200 len: 1219 microversion: 2.1 time: 0.403763 Jun 16 14:45:25.370412 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 783/1552] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:24 2022] GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 => generated 1219 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:25.393094 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fc75a264-7105-4ed2-ae33-9de3535ced22 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:25.394140 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fc75a264-7105-4ed2-ae33-9de3535ced22 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:25.408140 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fc75a264-7105-4ed2-ae33-9de3535ced22 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:25.409489 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fc75a264-7105-4ed2-ae33-9de3535ced22 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:25.412766 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fc75a264-7105-4ed2-ae33-9de3535ced22 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:25.415123 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fc75a264-7105-4ed2-ae33-9de3535ced22 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:25.877169 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fc75a264-7105-4ed2-ae33-9de3535ced22 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:25.886322 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fc75a264-7105-4ed2-ae33-9de3535ced22 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1325 microversion: 2.1 time: 0.514294 Jun 16 14:45:25.891571 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 784/1553] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:25 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1325 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:25.902180 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-77975e22-bd12-4e44-94f7-a78e447deac7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:25.938886 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-77975e22-bd12-4e44-94f7-a78e447deac7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:25.940255 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-77975e22-bd12-4e44-94f7-a78e447deac7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:26.366911 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-77975e22-bd12-4e44-94f7-a78e447deac7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Going to try to stop instance {{(pid=125863) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 14:45:26.556140 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-77975e22-bd12-4e44-94f7-a78e447deac7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "POST /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef/action" status: 202 len: 0 microversion: 2.1 time: 0.662830 Jun 16 14:45:26.557144 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 785/1554] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:45:25 2022] POST /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:45:26.592441 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ec90f571-d608-453d-9a3f-f96f656bcbf1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:26.605089 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ec90f571-d608-453d-9a3f-f96f656bcbf1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:26.646002 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ec90f571-d608-453d-9a3f-f96f656bcbf1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:26.651853 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ec90f571-d608-453d-9a3f-f96f656bcbf1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:26.653852 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ec90f571-d608-453d-9a3f-f96f656bcbf1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:26.654740 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ec90f571-d608-453d-9a3f-f96f656bcbf1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:27.106416 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-50ffadb4-63d7-4a71-9f36-cf5c8ed667a7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:27.141394 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-50ffadb4-63d7-4a71-9f36-cf5c8ed667a7 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1313 microversion: 2.1 time: 2.369251 Jun 16 14:45:27.142089 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 770/1555] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:24 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1313 bytes in 2372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:27.151734 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-13b2e888-4c03-4c80-8991-b8b2596e990e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:27.152372 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-13b2e888-4c03-4c80-8991-b8b2596e990e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:27.172511 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-13b2e888-4c03-4c80-8991-b8b2596e990e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:27.183243 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-13b2e888-4c03-4c80-8991-b8b2596e990e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:27.184403 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-13b2e888-4c03-4c80-8991-b8b2596e990e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:27.185085 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-13b2e888-4c03-4c80-8991-b8b2596e990e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:27.697394 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-13b2e888-4c03-4c80-8991-b8b2596e990e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:27.723441 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-13b2e888-4c03-4c80-8991-b8b2596e990e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76" status: 200 len: 1289 microversion: 2.1 time: 0.561014 Jun 16 14:45:27.724496 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 771/1556] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:27 2022] GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 => generated 1289 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:27.741899 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3f2aa8c6-d9e3-4820-baf9-00b211097393 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:27.742566 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3f2aa8c6-d9e3-4820-baf9-00b211097393 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:27.762799 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3f2aa8c6-d9e3-4820-baf9-00b211097393 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:27.763545 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3f2aa8c6-d9e3-4820-baf9-00b211097393 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:27.765330 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3f2aa8c6-d9e3-4820-baf9-00b211097393 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:27.768545 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3f2aa8c6-d9e3-4820-baf9-00b211097393 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:27.992400 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ec90f571-d608-453d-9a3f-f96f656bcbf1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:28.005257 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ec90f571-d608-453d-9a3f-f96f656bcbf1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 1.444751 Jun 16 14:45:28.022898 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 786/1557] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:26 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:28.038313 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-b32ffe63-89f5-425f-9943-abca345597a9 req-c51be1a1-fb99-4788-94d1-0be4929a818b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d49ca2-5a83-4054-bedf-0c06897d6b07", "name": "network-vif-unplugged", "status": "completed", "tag": "ad00f43d-1679-420a-90e5-decadf4b3c3e"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:28.064071 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-b32ffe63-89f5-425f-9943-abca345597a9 req-c51be1a1-fb99-4788-94d1-0be4929a818b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:28.066284 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-b32ffe63-89f5-425f-9943-abca345597a9 req-c51be1a1-fb99-4788-94d1-0be4929a818b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:28.089257 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-b32ffe63-89f5-425f-9943-abca345597a9 req-c51be1a1-fb99-4788-94d1-0be4929a818b service nova] Creating event network-vif-unplugged:ad00f43d-1679-420a-90e5-decadf4b3c3e for instance 34d49ca2-5a83-4054-bedf-0c06897d6b07 on n-h1-836830-4 Jun 16 14:45:28.095632 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-b32ffe63-89f5-425f-9943-abca345597a9 req-c51be1a1-fb99-4788-94d1-0be4929a818b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070972 Jun 16 14:45:28.096928 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 787/1558] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:28.103015 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b9cc0f4b-41d5-4365-a7ea-bfaadac3c696 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:28.104350 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b9cc0f4b-41d5-4365-a7ea-bfaadac3c696 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:28.113895 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b9cc0f4b-41d5-4365-a7ea-bfaadac3c696 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:28.114630 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b9cc0f4b-41d5-4365-a7ea-bfaadac3c696 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:28.115761 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b9cc0f4b-41d5-4365-a7ea-bfaadac3c696 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:28.116429 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b9cc0f4b-41d5-4365-a7ea-bfaadac3c696 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:28.539547 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b9cc0f4b-41d5-4365-a7ea-bfaadac3c696 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:28.564882 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b9cc0f4b-41d5-4365-a7ea-bfaadac3c696 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1325 microversion: 2.1 time: 0.466416 Jun 16 14:45:28.576623 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 788/1559] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:28 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1325 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:28.582703 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-ca800989-ae37-4163-99e6-5dba8e4a96fe req-ec4b12f4-edf2-4215-bdd6-fbc8d06aed1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a4bc09-c518-4934-842c-4ab2b5a50e0d", "name": "network-vif-plugged", "status": "completed", "tag": "9b779512-66fc-4a6a-a2ed-896ac2a82125"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:28.619475 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-ca800989-ae37-4163-99e6-5dba8e4a96fe req-ec4b12f4-edf2-4215-bdd6-fbc8d06aed1d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:28.623303 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-ca800989-ae37-4163-99e6-5dba8e4a96fe req-ec4b12f4-edf2-4215-bdd6-fbc8d06aed1d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:28.663646 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-ca800989-ae37-4163-99e6-5dba8e4a96fe req-ec4b12f4-edf2-4215-bdd6-fbc8d06aed1d service nova] Creating event network-vif-plugged:9b779512-66fc-4a6a-a2ed-896ac2a82125 for instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d on n-h2-836830-4 Jun 16 14:45:28.678520 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-ca800989-ae37-4163-99e6-5dba8e4a96fe req-ec4b12f4-edf2-4215-bdd6-fbc8d06aed1d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097910 Jun 16 14:45:28.682288 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 789/1560] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:28.692492 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3f2aa8c6-d9e3-4820-baf9-00b211097393 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:28.722023 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3f2aa8c6-d9e3-4820-baf9-00b211097393 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1498 microversion: 2.1 time: 0.994941 Jun 16 14:45:28.724680 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 772/1561] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:27 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1498 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:28.742676 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-38807d33-9dc2-484e-9f6f-12675b1db202 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:28.744087 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-38807d33-9dc2-484e-9f6f-12675b1db202 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:28.758416 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38807d33-9dc2-484e-9f6f-12675b1db202 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:28.760088 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38807d33-9dc2-484e-9f6f-12675b1db202 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:28.763940 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38807d33-9dc2-484e-9f6f-12675b1db202 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:28.765016 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e05d2b94-ece4-41e4-870d-e214fe465d39 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:28.766359 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e05d2b94-ece4-41e4-870d-e214fe465d39 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:28.766711 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38807d33-9dc2-484e-9f6f-12675b1db202 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:28.793425 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e05d2b94-ece4-41e4-870d-e214fe465d39 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:28.794352 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e05d2b94-ece4-41e4-870d-e214fe465d39 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:28.802502 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e05d2b94-ece4-41e4-870d-e214fe465d39 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:28.803656 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e05d2b94-ece4-41e4-870d-e214fe465d39 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:29.069604 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e05d2b94-ece4-41e4-870d-e214fe465d39 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:29.120733 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e05d2b94-ece4-41e4-870d-e214fe465d39 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76" status: 200 len: 1277 microversion: 2.1 time: 0.381372 Jun 16 14:45:29.126333 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 773/1562] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:28 2022] GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 => generated 1277 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:29.148858 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a646b222-fe4c-4181-bbe7-48f697f7421c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:29.151715 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a646b222-fe4c-4181-bbe7-48f697f7421c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:29.190677 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a646b222-fe4c-4181-bbe7-48f697f7421c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:29.197686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a646b222-fe4c-4181-bbe7-48f697f7421c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:29.201495 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a646b222-fe4c-4181-bbe7-48f697f7421c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:29.205482 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a646b222-fe4c-4181-bbe7-48f697f7421c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:29.680418 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-38807d33-9dc2-484e-9f6f-12675b1db202 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:29.724677 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-38807d33-9dc2-484e-9f6f-12675b1db202 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1313 microversion: 2.1 time: 1.038804 Jun 16 14:45:29.727738 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 790/1563] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:28 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1313 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:29.753759 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-002af162-0c29-4171-8772-b2a9a1374f38 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:29.755426 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-002af162-0c29-4171-8772-b2a9a1374f38 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:29.778480 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-002af162-0c29-4171-8772-b2a9a1374f38 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:29.789193 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-002af162-0c29-4171-8772-b2a9a1374f38 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:29.791558 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-002af162-0c29-4171-8772-b2a9a1374f38 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:29.792801 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-002af162-0c29-4171-8772-b2a9a1374f38 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:29.908215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a646b222-fe4c-4181-bbe7-48f697f7421c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:29.961979 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a646b222-fe4c-4181-bbe7-48f697f7421c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 0.831345 Jun 16 14:45:29.963778 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 774/1564] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:29 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:29.988189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a32f8cb8-d7c7-4202-9844-85cd30393559 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:29.988918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a32f8cb8-d7c7-4202-9844-85cd30393559 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:30.006180 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a32f8cb8-d7c7-4202-9844-85cd30393559 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:30.007158 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a32f8cb8-d7c7-4202-9844-85cd30393559 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:30.010810 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a32f8cb8-d7c7-4202-9844-85cd30393559 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:30.011411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a32f8cb8-d7c7-4202-9844-85cd30393559 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:30.762025 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-002af162-0c29-4171-8772-b2a9a1374f38 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:30.787044 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-002af162-0c29-4171-8772-b2a9a1374f38 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1325 microversion: 2.1 time: 1.054943 Jun 16 14:45:30.790975 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 791/1565] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:29 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1325 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:30.805968 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e571f2cd-e0f4-49f5-ae51-4cae6bd1c83f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:30.808940 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e571f2cd-e0f4-49f5-ae51-4cae6bd1c83f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:30.871219 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e571f2cd-e0f4-49f5-ae51-4cae6bd1c83f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:30.875676 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e571f2cd-e0f4-49f5-ae51-4cae6bd1c83f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:30.878297 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e571f2cd-e0f4-49f5-ae51-4cae6bd1c83f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:30.880043 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e571f2cd-e0f4-49f5-ae51-4cae6bd1c83f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:31.407782 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a32f8cb8-d7c7-4202-9844-85cd30393559 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:31.441911 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a32f8cb8-d7c7-4202-9844-85cd30393559 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1498 microversion: 2.1 time: 1.474876 Jun 16 14:45:31.459790 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 775/1566] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:29 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1498 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:31.476453 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-94784069-caf9-4d81-a4a2-a6b740624e06 req-10c6570a-e2bb-4cd8-9f21-ae064eda6eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e774f1-5f0b-44fc-999d-0d4473971cef", "tag": "be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0"}, {"name": "network-changed", "server_uuid": "34d49ca2-5a83-4054-bedf-0c06897d6b07", "tag": "ad00f43d-1679-420a-90e5-decadf4b3c3e"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:31.506139 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e571f2cd-e0f4-49f5-ae51-4cae6bd1c83f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:31.513448 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-94784069-caf9-4d81-a4a2-a6b740624e06 req-10c6570a-e2bb-4cd8-9f21-ae064eda6eff service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:31.515345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-94784069-caf9-4d81-a4a2-a6b740624e06 req-10c6570a-e2bb-4cd8-9f21-ae064eda6eff service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:31.518228 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e571f2cd-e0f4-49f5-ae51-4cae6bd1c83f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76" status: 200 len: 1319 microversion: 2.1 time: 0.725469 Jun 16 14:45:31.523478 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 792/1567] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:30 2022] GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 => generated 1319 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:31.533708 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3f80447d-5e66-4ed6-b6b2-bf819ba7a9f6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:31.537079 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3f80447d-5e66-4ed6-b6b2-bf819ba7a9f6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:31.553769 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3f80447d-5e66-4ed6-b6b2-bf819ba7a9f6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:31.557941 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3f80447d-5e66-4ed6-b6b2-bf819ba7a9f6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:31.559087 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3f80447d-5e66-4ed6-b6b2-bf819ba7a9f6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:31.559671 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3f80447d-5e66-4ed6-b6b2-bf819ba7a9f6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:31.576057 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-94784069-caf9-4d81-a4a2-a6b740624e06 req-10c6570a-e2bb-4cd8-9f21-ae064eda6eff service nova] Creating event network-changed:be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0 for instance d0e774f1-5f0b-44fc-999d-0d4473971cef on n-h1-836830-4 Jun 16 14:45:31.577442 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-94784069-caf9-4d81-a4a2-a6b740624e06 req-10c6570a-e2bb-4cd8-9f21-ae064eda6eff service nova] Creating event network-changed:ad00f43d-1679-420a-90e5-decadf4b3c3e for instance 34d49ca2-5a83-4054-bedf-0c06897d6b07 on n-h1-836830-4 Jun 16 14:45:31.615923 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-94784069-caf9-4d81-a4a2-a6b740624e06 req-10c6570a-e2bb-4cd8-9f21-ae064eda6eff service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.153857 Jun 16 14:45:31.617766 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 776/1568] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:31.628539 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-efa8c955-278e-44fe-8837-4ac0aed649b1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:31.630524 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-efa8c955-278e-44fe-8837-4ac0aed649b1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:31.650196 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efa8c955-278e-44fe-8837-4ac0aed649b1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:31.651401 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efa8c955-278e-44fe-8837-4ac0aed649b1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:31.653462 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efa8c955-278e-44fe-8837-4ac0aed649b1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:31.654790 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-efa8c955-278e-44fe-8837-4ac0aed649b1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:31.883515 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3f80447d-5e66-4ed6-b6b2-bf819ba7a9f6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:31.897149 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3f80447d-5e66-4ed6-b6b2-bf819ba7a9f6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1313 microversion: 2.1 time: 0.372079 Jun 16 14:45:31.914674 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 793/1569] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:31 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:31.928397 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-de61a088-e705-4a38-a71e-7aa7b4059ab4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:31.930592 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-de61a088-e705-4a38-a71e-7aa7b4059ab4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:31.940972 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de61a088-e705-4a38-a71e-7aa7b4059ab4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:31.941740 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de61a088-e705-4a38-a71e-7aa7b4059ab4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:31.943164 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de61a088-e705-4a38-a71e-7aa7b4059ab4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:31.943845 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de61a088-e705-4a38-a71e-7aa7b4059ab4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:32.215387 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-de61a088-e705-4a38-a71e-7aa7b4059ab4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:32.258250 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-de61a088-e705-4a38-a71e-7aa7b4059ab4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1522 microversion: 2.1 time: 0.341549 Jun 16 14:45:32.262968 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 794/1570] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:31 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:32.284744 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:32.285077 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-73485c22-1e66-4031-81d1-91a3e006d396 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:32.300213 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-73485c22-1e66-4031-81d1-91a3e006d396 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:32.332156 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-73485c22-1e66-4031-81d1-91a3e006d396 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:32.334684 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-73485c22-1e66-4031-81d1-91a3e006d396 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:32.336924 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-73485c22-1e66-4031-81d1-91a3e006d396 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:32.338567 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-73485c22-1e66-4031-81d1-91a3e006d396 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:32.804590 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-73485c22-1e66-4031-81d1-91a3e006d396 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:32.818551 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-73485c22-1e66-4031-81d1-91a3e006d396 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1522 microversion: 2.1 time: 0.544308 Jun 16 14:45:32.830371 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 795/1571] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:32 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1522 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:32.838286 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ca565178-78ae-4901-ac9d-0d5590ae5c64 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:32.848259 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ca565178-78ae-4901-ac9d-0d5590ae5c64 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:32.885863 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ca565178-78ae-4901-ac9d-0d5590ae5c64 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:32.888967 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ca565178-78ae-4901-ac9d-0d5590ae5c64 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:32.891597 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ca565178-78ae-4901-ac9d-0d5590ae5c64 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:32.892445 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ca565178-78ae-4901-ac9d-0d5590ae5c64 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:33.118767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=30 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:33.178125 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-efa8c955-278e-44fe-8837-4ac0aed649b1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:33.204078 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-efa8c955-278e-44fe-8837-4ac0aed649b1 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 1.582236 Jun 16 14:45:33.205615 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 777/1572] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:31 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:33.223544 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a5fcff4d-b0da-468d-af4b-ccb9b459066a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:33.224476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a5fcff4d-b0da-468d-af4b-ccb9b459066a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:33.251720 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5fcff4d-b0da-468d-af4b-ccb9b459066a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:33.253196 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5fcff4d-b0da-468d-af4b-ccb9b459066a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:33.254343 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5fcff4d-b0da-468d-af4b-ccb9b459066a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:33.257483 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5fcff4d-b0da-468d-af4b-ccb9b459066a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:33.658367 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ca565178-78ae-4901-ac9d-0d5590ae5c64 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:33.688974 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ca565178-78ae-4901-ac9d-0d5590ae5c64 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1498 microversion: 2.1 time: 0.857048 Jun 16 14:45:33.690163 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 796/1573] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:32 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1498 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:33.695331 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f9a5e507-28d9-41e5-ba1b-3b69148f7950 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1451779111", "metadata": {"": ""}}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f9a5e507-28d9-41e5-ba1b-3b69148f7950 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Request method failure captured: Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d/action HTTP/1.1 Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 107 Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0HwzjjfEOzwOCijJMwAIM9bloQokdG738AdmO2AfwSY4wjVjyQLh9lWAzH4Rn8UCfDe9NW9edyGFTRe1GgDBY6cMZzBwN1dffuTKMcXrVyPL7r_AJ0308sfSN5YHtB5BJ4xC8C7QdPv6xOmwCbcFwnW04fPzhAdrkooBYSucmrM6SQ Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:45:33.700683 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:45:33.703376 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b46102b0fb544d118e324f7fcf654eb2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b46102b0fb544d118e324f7fcf654eb2"}]}] Jun 16 14:45:33.703376 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:45:33.703376 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:45:33.703376 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:45:33.703376 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:45:33.703376 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:45:33.703376 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:45:33.703376 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 8fc694c86102467bb97072ca4972b223 Jun 16 14:45:33.703376 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:45:33.703376 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:45:33.703376 n-d-836830-4 devstack@n-api.service[125863]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1451779111", "metadata": {"": ""}}} Jun 16 14:45:33.703376 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '93a4bc09-c518-4934-842c-4ab2b5a50e0d', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1451779111', 'metadata': {'': ''}}}} Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi {'': ''} Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:33.704457 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:33.706480 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:33.709755 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:33.709755 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:33.709755 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:45:33.709755 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:45:33.709755 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 14:45:33.709755 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:33.716544 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f9a5e507-28d9-41e5-ba1b-3b69148f7950 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:45:33.716544 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f9a5e507-28d9-41e5-ba1b-3b69148f7950 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "POST /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d/action" status: 400 len: 170 microversion: 2.1 time: 0.020553 Jun 16 14:45:33.716544 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 797/1574] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Jun 16 14:45:33 2022] POST /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d/action => generated 170 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:45:33.727241 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-12301e6b-6e4e-45ee-bd80-b44c7f987180 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:33.732392 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-12301e6b-6e4e-45ee-bd80-b44c7f987180 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:33.766947 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:33.775402 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-12301e6b-6e4e-45ee-bd80-b44c7f987180 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:33.783231 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-12301e6b-6e4e-45ee-bd80-b44c7f987180 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:33.786257 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-12301e6b-6e4e-45ee-bd80-b44c7f987180 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:33.786894 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-12301e6b-6e4e-45ee-bd80-b44c7f987180 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:33.796572 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:33.816151 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a5fcff4d-b0da-468d-af4b-ccb9b459066a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:33.849757 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a5fcff4d-b0da-468d-af4b-ccb9b459066a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76" status: 200 len: 1319 microversion: 2.1 time: 0.627467 Jun 16 14:45:33.852774 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 778/1575] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:33 2022] GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 => generated 1319 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:33.894653 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0b1af65d-0d5f-47cd-8236-828d18b5e26a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:33.898331 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0b1af65d-0d5f-47cd-8236-828d18b5e26a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:33.935910 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b1af65d-0d5f-47cd-8236-828d18b5e26a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:33.940170 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b1af65d-0d5f-47cd-8236-828d18b5e26a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:33.946295 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b1af65d-0d5f-47cd-8236-828d18b5e26a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:33.947285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b1af65d-0d5f-47cd-8236-828d18b5e26a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:34.193950 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-12301e6b-6e4e-45ee-bd80-b44c7f987180 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:34.244479 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-12301e6b-6e4e-45ee-bd80-b44c7f987180 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1313 microversion: 2.1 time: 0.507083 Jun 16 14:45:34.271935 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 798/1576] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:33 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1313 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:34.306257 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-233413cc-1d7c-4572-ad10-89e1fac4c251 req-f3d747dc-8951-4b76-8a51-73cff2db3f64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459d1e53-76b9-48a6-819b-9718e32f6f76", "tag": "710e4f94-9261-4fcb-9d50-6b753fda429f"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:34.362830 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-233413cc-1d7c-4572-ad10-89e1fac4c251 req-f3d747dc-8951-4b76-8a51-73cff2db3f64 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:34.365628 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-233413cc-1d7c-4572-ad10-89e1fac4c251 req-f3d747dc-8951-4b76-8a51-73cff2db3f64 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:34.429525 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-233413cc-1d7c-4572-ad10-89e1fac4c251 req-f3d747dc-8951-4b76-8a51-73cff2db3f64 service nova] Creating event network-changed:710e4f94-9261-4fcb-9d50-6b753fda429f for instance 459d1e53-76b9-48a6-819b-9718e32f6f76 on n-h1-836830-4 Jun 16 14:45:34.457634 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-233413cc-1d7c-4572-ad10-89e1fac4c251 req-f3d747dc-8951-4b76-8a51-73cff2db3f64 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182634 Jun 16 14:45:34.477854 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 799/1577] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:34.488618 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-81d9f52c-425b-4f0b-8a0e-079b2b9b759e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:34.490408 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-81d9f52c-425b-4f0b-8a0e-079b2b9b759e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:34.503764 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81d9f52c-425b-4f0b-8a0e-079b2b9b759e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:34.504937 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81d9f52c-425b-4f0b-8a0e-079b2b9b759e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:34.506801 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81d9f52c-425b-4f0b-8a0e-079b2b9b759e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:34.508123 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81d9f52c-425b-4f0b-8a0e-079b2b9b759e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:35.399918 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:35.524411 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-81d9f52c-425b-4f0b-8a0e-079b2b9b759e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:35.541907 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-81d9f52c-425b-4f0b-8a0e-079b2b9b759e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 1.060829 Jun 16 14:45:35.558794 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 800/1578] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:34 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:35.569556 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d18af0a5-7867-46fb-bfc5-a9901ee5b88d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:35.570646 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d18af0a5-7867-46fb-bfc5-a9901ee5b88d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:35.573219 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0b1af65d-0d5f-47cd-8236-828d18b5e26a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:35.582857 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d18af0a5-7867-46fb-bfc5-a9901ee5b88d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:35.583852 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d18af0a5-7867-46fb-bfc5-a9901ee5b88d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:35.587473 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0b1af65d-0d5f-47cd-8236-828d18b5e26a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1522 microversion: 2.1 time: 1.731857 Jun 16 14:45:35.596228 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d18af0a5-7867-46fb-bfc5-a9901ee5b88d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:35.600428 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d18af0a5-7867-46fb-bfc5-a9901ee5b88d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:35.605102 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 779/1579] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:33 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1522 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:35.630476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-454c0572-81a9-47fd-993a-2f1d341a27d0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:35.631229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-454c0572-81a9-47fd-993a-2f1d341a27d0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:35.673658 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-454c0572-81a9-47fd-993a-2f1d341a27d0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:35.674492 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-454c0572-81a9-47fd-993a-2f1d341a27d0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:35.675856 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-454c0572-81a9-47fd-993a-2f1d341a27d0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:35.676599 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-454c0572-81a9-47fd-993a-2f1d341a27d0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:37.169183 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-454c0572-81a9-47fd-993a-2f1d341a27d0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:37.191083 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-454c0572-81a9-47fd-993a-2f1d341a27d0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76" status: 200 len: 1319 microversion: 2.1 time: 1.570096 Jun 16 14:45:37.191638 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 780/1580] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:35 2022] GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 => generated 1319 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:37.200670 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ba186441-27a5-442d-b833-781d5c44efa8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:37.201352 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ba186441-27a5-442d-b833-781d5c44efa8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:37.230105 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba186441-27a5-442d-b833-781d5c44efa8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:37.231420 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba186441-27a5-442d-b833-781d5c44efa8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:37.234870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba186441-27a5-442d-b833-781d5c44efa8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:37.236332 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba186441-27a5-442d-b833-781d5c44efa8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:37.411952 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d18af0a5-7867-46fb-bfc5-a9901ee5b88d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:37.476940 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d18af0a5-7867-46fb-bfc5-a9901ee5b88d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1498 microversion: 2.1 time: 1.924586 Jun 16 14:45:37.482587 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 801/1581] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:35 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1498 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:37.492590 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4b118a7d-96cf-4c12-92e1-6f9920c5ea2b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:37.493716 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4b118a7d-96cf-4c12-92e1-6f9920c5ea2b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:37.503912 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b118a7d-96cf-4c12-92e1-6f9920c5ea2b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:37.508767 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b118a7d-96cf-4c12-92e1-6f9920c5ea2b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:37.510026 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b118a7d-96cf-4c12-92e1-6f9920c5ea2b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:37.510779 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4b118a7d-96cf-4c12-92e1-6f9920c5ea2b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:38.478673 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4b118a7d-96cf-4c12-92e1-6f9920c5ea2b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:38.500106 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4b118a7d-96cf-4c12-92e1-6f9920c5ea2b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1522 microversion: 2.1 time: 1.008499 Jun 16 14:45:38.501441 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 802/1582] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:37 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1522 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:38.519261 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b7fe2cab-372b-421e-a423-ad89ec4c4179 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:38.520755 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b7fe2cab-372b-421e-a423-ad89ec4c4179 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:38.530305 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b7fe2cab-372b-421e-a423-ad89ec4c4179 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:38.531945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b7fe2cab-372b-421e-a423-ad89ec4c4179 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:38.544725 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b7fe2cab-372b-421e-a423-ad89ec4c4179 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:38.545063 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b7fe2cab-372b-421e-a423-ad89ec4c4179 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:38.746213 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ba186441-27a5-442d-b833-781d5c44efa8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:38.761037 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ba186441-27a5-442d-b833-781d5c44efa8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1313 microversion: 2.1 time: 1.567802 Jun 16 14:45:38.771910 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 781/1583] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:37 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1313 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:38.787206 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-2cd05a09-4ea3-4f91-ae62-54e9bbe6cd1d req-f7bcea95-7790-454c-ab5f-21e07fb7f159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d49ca2-5a83-4054-bedf-0c06897d6b07", "name": "network-vif-unplugged", "status": "completed", "tag": "ad00f43d-1679-420a-90e5-decadf4b3c3e"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:38.802489 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-2cd05a09-4ea3-4f91-ae62-54e9bbe6cd1d req-f7bcea95-7790-454c-ab5f-21e07fb7f159 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:38.803335 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-2cd05a09-4ea3-4f91-ae62-54e9bbe6cd1d req-f7bcea95-7790-454c-ab5f-21e07fb7f159 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:38.819241 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:38.822522 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-2cd05a09-4ea3-4f91-ae62-54e9bbe6cd1d req-f7bcea95-7790-454c-ab5f-21e07fb7f159 service nova] Creating event network-vif-unplugged:ad00f43d-1679-420a-90e5-decadf4b3c3e for instance 34d49ca2-5a83-4054-bedf-0c06897d6b07 on n-h1-836830-4 Jun 16 14:45:38.840252 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-2cd05a09-4ea3-4f91-ae62-54e9bbe6cd1d req-f7bcea95-7790-454c-ab5f-21e07fb7f159 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055829 Jun 16 14:45:38.841685 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 782/1584] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:38.850957 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c0e8a4dc-af2a-4ed1-b0df-40eadf26e1c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:38.852150 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c0e8a4dc-af2a-4ed1-b0df-40eadf26e1c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:38.862519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c0e8a4dc-af2a-4ed1-b0df-40eadf26e1c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:38.863519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c0e8a4dc-af2a-4ed1-b0df-40eadf26e1c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:38.864755 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c0e8a4dc-af2a-4ed1-b0df-40eadf26e1c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:38.865490 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c0e8a4dc-af2a-4ed1-b0df-40eadf26e1c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:38.977377 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b7fe2cab-372b-421e-a423-ad89ec4c4179 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:38.997158 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b7fe2cab-372b-421e-a423-ad89ec4c4179 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 0.493056 Jun 16 14:45:39.015824 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 803/1585] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:38 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:39.021299 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-30a21eaa-ef82-4475-bf46-1398ea4b5cb0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:39.021920 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-30a21eaa-ef82-4475-bf46-1398ea4b5cb0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:39.060590 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-30a21eaa-ef82-4475-bf46-1398ea4b5cb0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:39.062535 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-30a21eaa-ef82-4475-bf46-1398ea4b5cb0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:39.063835 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-30a21eaa-ef82-4475-bf46-1398ea4b5cb0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:39.064515 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-30a21eaa-ef82-4475-bf46-1398ea4b5cb0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:39.419804 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-30a21eaa-ef82-4475-bf46-1398ea4b5cb0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:39.432349 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-30a21eaa-ef82-4475-bf46-1398ea4b5cb0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1498 microversion: 2.1 time: 0.414931 Jun 16 14:45:39.435427 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 804/1586] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:39 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1498 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:39.447757 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a2b85607-fbf9-4a2a-b512-5ee45708a493 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-651494661", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a2b85607-fbf9-4a2a-b512-5ee45708a493 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Request method failure captured: Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d/action HTTP/1.1 Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 618 Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0HwzjjfEOzwOCijJMwAIM9bloQokdG738AdmO2AfwSY4wjVjyQLh9lWAzH4Rn8UCfDe9NW9edyGFTRe1GgDBY6cMZzBwN1dffuTKMcXrVyPL7r_AJ0308sfSN5YHtB5BJ4xC8C7QdPv6xOmwCbcFwnW04fPzhAdrkooBYSucmrM6SQ Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:45:39.454908 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:45:39.456680 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b46102b0fb544d118e324f7fcf654eb2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b46102b0fb544d118e324f7fcf654eb2"}]}] Jun 16 14:45:39.456680 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:45:39.456680 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:45:39.456680 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:45:39.456680 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:45:39.456680 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:45:39.456680 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:45:39.456680 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 8fc694c86102467bb97072ca4972b223 Jun 16 14:45:39.456680 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:45:39.456680 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:45:39.457457 n-d-836830-4 devstack@n-api.service[125863]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-651494661", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jun 16 14:45:39.457457 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:45:39.457457 n-d-836830-4 devstack@n-api.service[125863]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 14:45:39.457731 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '93a4bc09-c518-4934-842c-4ab2b5a50e0d', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-651494661', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jun 16 14:45:39.457731 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:45:39.457731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:39.457731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:45:39.457731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:45:39.457731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:45:39.457731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:45:39.457731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 14:45:39.457731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:39.457731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jun 16 14:45:39.457731 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:45:39.458681 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:45:39.459948 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:45:39.459948 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:45:39.459948 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:45:39.459948 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:45:39.459948 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:45:39.459948 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:45:39.459948 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:45:39.459948 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 14:45:39.459948 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:39.459948 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:39.459948 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:39.459948 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:39.460902 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:39.460902 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:39.460902 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:45:39.460902 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:45:39.460902 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 16 14:45:39.460902 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:39.470301 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a2b85607-fbf9-4a2a-b512-5ee45708a493 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:45:39.471599 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a2b85607-fbf9-4a2a-b512-5ee45708a493 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "POST /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d/action" status: 400 len: 938 microversion: 2.1 time: 0.032571 Jun 16 14:45:39.472354 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 805/1587] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Jun 16 14:45:39 2022] POST /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d/action => generated 938 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:45:39.474969 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c0e8a4dc-af2a-4ed1-b0df-40eadf26e1c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:39.506593 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-97a23a69-d82b-413d-9550-ef1c31bfdcfe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:39.516711 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-97a23a69-d82b-413d-9550-ef1c31bfdcfe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:39.527405 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c0e8a4dc-af2a-4ed1-b0df-40eadf26e1c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76" status: 200 len: 1319 microversion: 2.1 time: 0.677748 Jun 16 14:45:39.536726 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 783/1588] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:38 2022] GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 => generated 1319 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:39.552004 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97a23a69-d82b-413d-9550-ef1c31bfdcfe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:39.558496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97a23a69-d82b-413d-9550-ef1c31bfdcfe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:39.558496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97a23a69-d82b-413d-9550-ef1c31bfdcfe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:39.558496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97a23a69-d82b-413d-9550-ef1c31bfdcfe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:39.808190 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a8a56701-65c1-4f67-a0a6-b0cb96bbc79e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:39.818338 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a8a56701-65c1-4f67-a0a6-b0cb96bbc79e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:39.848541 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a8a56701-65c1-4f67-a0a6-b0cb96bbc79e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:39.849861 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a8a56701-65c1-4f67-a0a6-b0cb96bbc79e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:39.851707 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a8a56701-65c1-4f67-a0a6-b0cb96bbc79e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:39.853864 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a8a56701-65c1-4f67-a0a6-b0cb96bbc79e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:40.008775 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-97a23a69-d82b-413d-9550-ef1c31bfdcfe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:40.029959 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-97a23a69-d82b-413d-9550-ef1c31bfdcfe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1522 microversion: 2.1 time: 0.539208 Jun 16 14:45:40.050722 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 806/1589] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:39 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1522 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:45:40.058235 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-0e840955-99e0-4e16-bbd9-fe4e6ae41e9f req-864ab2c4-5082-49ac-8bb3-6ce1944184ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebabcdb6-1a81-4841-a33e-921e67a0d2f6", "tag": "8f89bbb6-77f8-45b7-9492-458a024a5387"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:40.072383 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-0e840955-99e0-4e16-bbd9-fe4e6ae41e9f req-864ab2c4-5082-49ac-8bb3-6ce1944184ca service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:40.073161 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-0e840955-99e0-4e16-bbd9-fe4e6ae41e9f req-864ab2c4-5082-49ac-8bb3-6ce1944184ca service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:40.112282 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-0e840955-99e0-4e16-bbd9-fe4e6ae41e9f req-864ab2c4-5082-49ac-8bb3-6ce1944184ca service nova] Creating event network-changed:8f89bbb6-77f8-45b7-9492-458a024a5387 for instance ebabcdb6-1a81-4841-a33e-921e67a0d2f6 on n-h1-836830-4 Jun 16 14:45:40.129161 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-0e840955-99e0-4e16-bbd9-fe4e6ae41e9f req-864ab2c4-5082-49ac-8bb3-6ce1944184ca service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076658 Jun 16 14:45:40.134001 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 807/1590] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:40.143707 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-15727ea0-89ac-463b-9f94-81ee74c98ad0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:40.144696 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-15727ea0-89ac-463b-9f94-81ee74c98ad0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:40.155542 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15727ea0-89ac-463b-9f94-81ee74c98ad0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:40.156164 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15727ea0-89ac-463b-9f94-81ee74c98ad0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:40.157392 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15727ea0-89ac-463b-9f94-81ee74c98ad0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:40.157970 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-15727ea0-89ac-463b-9f94-81ee74c98ad0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:40.378560 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-15727ea0-89ac-463b-9f94-81ee74c98ad0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:40.387856 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-15727ea0-89ac-463b-9f94-81ee74c98ad0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 0.251659 Jun 16 14:45:40.394601 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 808/1591] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:40 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:40.394601 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-604e5421-2c9b-4ad3-b4a8-8b4e0ebae5e8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:40.394601 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-604e5421-2c9b-4ad3-b4a8-8b4e0ebae5e8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:40.401804 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-604e5421-2c9b-4ad3-b4a8-8b4e0ebae5e8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:40.402450 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-604e5421-2c9b-4ad3-b4a8-8b4e0ebae5e8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:40.403401 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-604e5421-2c9b-4ad3-b4a8-8b4e0ebae5e8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:40.403959 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-604e5421-2c9b-4ad3-b4a8-8b4e0ebae5e8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:40.575402 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-604e5421-2c9b-4ad3-b4a8-8b4e0ebae5e8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:40.585832 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-604e5421-2c9b-4ad3-b4a8-8b4e0ebae5e8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1522 microversion: 2.1 time: 0.195672 Jun 16 14:45:40.586969 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 809/1592] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:40 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:40.592598 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ae1fe78f-4477-4c70-bc86-ea2b543398a7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:40.593329 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ae1fe78f-4477-4c70-bc86-ea2b543398a7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:40.603842 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ae1fe78f-4477-4c70-bc86-ea2b543398a7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:40.604406 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ae1fe78f-4477-4c70-bc86-ea2b543398a7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:40.605423 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ae1fe78f-4477-4c70-bc86-ea2b543398a7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:40.605937 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ae1fe78f-4477-4c70-bc86-ea2b543398a7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:40.676643 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a8a56701-65c1-4f67-a0a6-b0cb96bbc79e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:40.692709 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a8a56701-65c1-4f67-a0a6-b0cb96bbc79e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1313 microversion: 2.1 time: 0.903849 Jun 16 14:45:40.705737 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 784/1593] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:39 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1313 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:45:40.705737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8294fe19-ace8-4d28-9f9f-4d5ef8420b8a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:40.705737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8294fe19-ace8-4d28-9f9f-4d5ef8420b8a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:40.708939 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8294fe19-ace8-4d28-9f9f-4d5ef8420b8a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:40.709420 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8294fe19-ace8-4d28-9f9f-4d5ef8420b8a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:40.710469 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8294fe19-ace8-4d28-9f9f-4d5ef8420b8a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:40.711170 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8294fe19-ace8-4d28-9f9f-4d5ef8420b8a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:40.843732 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ae1fe78f-4477-4c70-bc86-ea2b543398a7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:40.861916 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ae1fe78f-4477-4c70-bc86-ea2b543398a7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1498 microversion: 2.1 time: 0.273764 Jun 16 14:45:40.862868 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 810/1594] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:40 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1498 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:40.867953 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2956ff34-0d0f-4459-a1fa-e0cd496d774c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2956ff34-0d0f-4459-a1fa-e0cd496d774c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Request method failure captured: Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d/action HTTP/1.1 Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 285 Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0HwzjjfEOzwOCijJMwAIM9bloQokdG738AdmO2AfwSY4wjVjyQLh9lWAzH4Rn8UCfDe9NW9edyGFTRe1GgDBY6cMZzBwN1dffuTKMcXrVyPL7r_AJ0308sfSN5YHtB5BJ4xC8C7QdPv6xOmwCbcFwnW04fPzhAdrkooBYSucmrM6SQ Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:45:40.876562 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:45:40.879478 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b46102b0fb544d118e324f7fcf654eb2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b46102b0fb544d118e324f7fcf654eb2"}]}] Jun 16 14:45:40.879478 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:45:40.879478 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:45:40.879478 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:45:40.879478 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:45:40.879478 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:45:40.879478 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:45:40.879478 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 8fc694c86102467bb97072ca4972b223 Jun 16 14:45:40.879478 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:45:40.879478 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:45:40.879478 n-d-836830-4 devstack@n-api.service[125863]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 16 14:45:40.882715 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:45:40.882715 n-d-836830-4 devstack@n-api.service[125863]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 14:45:40.882715 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '93a4bc09-c518-4934-842c-4ab2b5a50e0d', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 16 14:45:40.882715 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:45:40.882715 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:40.882715 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:45:40.882715 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:45:40.882715 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:45:40.882715 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:45:40.882715 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:45:40.885443 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:45:40.892642 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:45:40.892642 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:45:40.892642 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:45:40.892642 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:45:40.892642 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 14:45:40.892642 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:40.892642 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:40.892642 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:40.892642 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:40.892642 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:40.892642 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:40.892642 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:45:40.892642 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:45:40.898297 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 16 14:45:40.898297 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:40.898297 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2956ff34-0d0f-4459-a1fa-e0cd496d774c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:45:40.898297 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2956ff34-0d0f-4459-a1fa-e0cd496d774c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "POST /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d/action" status: 400 len: 619 microversion: 2.1 time: 0.014330 Jun 16 14:45:40.900052 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 811/1595] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Jun 16 14:45:40 2022] POST /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d/action => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:45:40.900052 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d8ca8919-8f65-4779-9d31-b27de36ad23c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:40.900052 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d8ca8919-8f65-4779-9d31-b27de36ad23c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:40.917256 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d8ca8919-8f65-4779-9d31-b27de36ad23c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:40.917731 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d8ca8919-8f65-4779-9d31-b27de36ad23c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:40.918596 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d8ca8919-8f65-4779-9d31-b27de36ad23c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:40.919049 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d8ca8919-8f65-4779-9d31-b27de36ad23c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:40.985308 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8294fe19-ace8-4d28-9f9f-4d5ef8420b8a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:41.009320 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8294fe19-ace8-4d28-9f9f-4d5ef8420b8a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76" status: 200 len: 1319 microversion: 2.1 time: 0.312538 Jun 16 14:45:41.025770 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 785/1596] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:40 2022] GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:41.406563 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e03f2f92-ddf5-4421-8cab-0a37b7a0d0e6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:41.408238 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e03f2f92-ddf5-4421-8cab-0a37b7a0d0e6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:41.423077 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e03f2f92-ddf5-4421-8cab-0a37b7a0d0e6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:41.426018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e03f2f92-ddf5-4421-8cab-0a37b7a0d0e6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:41.429623 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e03f2f92-ddf5-4421-8cab-0a37b7a0d0e6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:41.431054 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e03f2f92-ddf5-4421-8cab-0a37b7a0d0e6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:41.561971 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d8ca8919-8f65-4779-9d31-b27de36ad23c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:41.585942 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d8ca8919-8f65-4779-9d31-b27de36ad23c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1522 microversion: 2.1 time: 0.691268 Jun 16 14:45:41.587028 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 812/1597] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:40 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1522 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:41.620424 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a0bc8bc0-ef82-4390-a09d-47a8ac69eb04 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:41.622095 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a0bc8bc0-ef82-4390-a09d-47a8ac69eb04 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:41.653462 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0bc8bc0-ef82-4390-a09d-47a8ac69eb04 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:41.659529 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0bc8bc0-ef82-4390-a09d-47a8ac69eb04 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:41.661851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0bc8bc0-ef82-4390-a09d-47a8ac69eb04 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:41.663004 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0bc8bc0-ef82-4390-a09d-47a8ac69eb04 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:42.022943 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e03f2f92-ddf5-4421-8cab-0a37b7a0d0e6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:42.047610 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e03f2f92-ddf5-4421-8cab-0a37b7a0d0e6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 0.644184 Jun 16 14:45:42.059894 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 786/1598] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:41 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:42.077866 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6fc4a8f5-0bfd-4fb6-b78a-7b27492b08b8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:42.083951 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6fc4a8f5-0bfd-4fb6-b78a-7b27492b08b8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:42.113274 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6fc4a8f5-0bfd-4fb6-b78a-7b27492b08b8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:42.113770 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6fc4a8f5-0bfd-4fb6-b78a-7b27492b08b8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:42.120223 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6fc4a8f5-0bfd-4fb6-b78a-7b27492b08b8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:42.121198 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6fc4a8f5-0bfd-4fb6-b78a-7b27492b08b8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:42.677594 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6fc4a8f5-0bfd-4fb6-b78a-7b27492b08b8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:42.717226 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6fc4a8f5-0bfd-4fb6-b78a-7b27492b08b8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1313 microversion: 2.1 time: 0.653739 Jun 16 14:45:42.725113 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 787/1599] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:42 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1313 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:42.742277 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4d3901be-065b-4cfd-b961-7f2e1fcb3951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:42.749393 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4d3901be-065b-4cfd-b961-7f2e1fcb3951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:42.784236 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d3901be-065b-4cfd-b961-7f2e1fcb3951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:42.785761 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d3901be-065b-4cfd-b961-7f2e1fcb3951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:42.787599 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d3901be-065b-4cfd-b961-7f2e1fcb3951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:42.788921 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d3901be-065b-4cfd-b961-7f2e1fcb3951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:43.251238 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-4d3901be-065b-4cfd-b961-7f2e1fcb3951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:43.268591 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4d3901be-065b-4cfd-b961-7f2e1fcb3951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1498 microversion: 2.1 time: 0.540024 Jun 16 14:45:43.269580 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 788/1600] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:42 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1498 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:43.287664 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ec84a0cf-b92a-4bc7-a579-d38f84f58d5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:43.291995 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ec84a0cf-b92a-4bc7-a579-d38f84f58d5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:43.323368 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec84a0cf-b92a-4bc7-a579-d38f84f58d5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:43.324192 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec84a0cf-b92a-4bc7-a579-d38f84f58d5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:43.331249 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec84a0cf-b92a-4bc7-a579-d38f84f58d5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:43.332216 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec84a0cf-b92a-4bc7-a579-d38f84f58d5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:43.422990 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a0bc8bc0-ef82-4390-a09d-47a8ac69eb04 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:43.473975 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a0bc8bc0-ef82-4390-a09d-47a8ac69eb04 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1522 microversion: 2.1 time: 1.868016 Jun 16 14:45:43.498985 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 813/1601] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:41 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1522 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:43.509823 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-faaca0bd-9333-45f6-af72-33b0d1e63bb0 req-c3618eff-5015-4f26-83fa-3c7f384dbec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e774f1-5f0b-44fc-999d-0d4473971cef", "name": "network-vif-plugged", "status": "completed", "tag": "be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:43.530209 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-faaca0bd-9333-45f6-af72-33b0d1e63bb0 req-c3618eff-5015-4f26-83fa-3c7f384dbec7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:43.531313 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-faaca0bd-9333-45f6-af72-33b0d1e63bb0 req-c3618eff-5015-4f26-83fa-3c7f384dbec7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:43.562774 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-faaca0bd-9333-45f6-af72-33b0d1e63bb0 req-c3618eff-5015-4f26-83fa-3c7f384dbec7 service nova] Creating event network-vif-plugged:be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0 for instance d0e774f1-5f0b-44fc-999d-0d4473971cef on n-h1-836830-4 Jun 16 14:45:43.575621 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-faaca0bd-9333-45f6-af72-33b0d1e63bb0 req-c3618eff-5015-4f26-83fa-3c7f384dbec7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073670 Jun 16 14:45:43.577980 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 814/1602] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:43.599591 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-37f67c6e-964e-4a9a-bd65-92bd7b4d7422 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:43.605137 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-37f67c6e-964e-4a9a-bd65-92bd7b4d7422 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:43.631488 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-37f67c6e-964e-4a9a-bd65-92bd7b4d7422 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:43.632959 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-37f67c6e-964e-4a9a-bd65-92bd7b4d7422 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:43.635230 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-37f67c6e-964e-4a9a-bd65-92bd7b4d7422 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:43.637183 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-37f67c6e-964e-4a9a-bd65-92bd7b4d7422 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:43.817237 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ec84a0cf-b92a-4bc7-a579-d38f84f58d5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:43.837659 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ec84a0cf-b92a-4bc7-a579-d38f84f58d5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76" status: 200 len: 1319 microversion: 2.1 time: 0.565271 Jun 16 14:45:43.855596 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 789/1603] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:43 2022] GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 => generated 1319 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:43.861862 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-00be5dd5-bd81-41c1-832d-c595752af832 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-537827953"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:43.867790 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-00be5dd5-bd81-41c1-832d-c595752af832 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:43.882160 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00be5dd5-bd81-41c1-832d-c595752af832 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:43.882646 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00be5dd5-bd81-41c1-832d-c595752af832 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:43.883519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00be5dd5-bd81-41c1-832d-c595752af832 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:43.883970 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00be5dd5-bd81-41c1-832d-c595752af832 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:44.696146 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-37f67c6e-964e-4a9a-bd65-92bd7b4d7422 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:44.746412 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-37f67c6e-964e-4a9a-bd65-92bd7b4d7422 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1391 microversion: 2.1 time: 1.161809 Jun 16 14:45:44.747777 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 815/1604] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:43 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1391 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:44.763233 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5c8d606e-e90d-4bcc-85ff-ecb4e8dba896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:44.766056 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5c8d606e-e90d-4bcc-85ff-ecb4e8dba896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:44.788296 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c8d606e-e90d-4bcc-85ff-ecb4e8dba896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:44.790015 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c8d606e-e90d-4bcc-85ff-ecb4e8dba896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:44.792952 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c8d606e-e90d-4bcc-85ff-ecb4e8dba896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:44.794399 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c8d606e-e90d-4bcc-85ff-ecb4e8dba896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:46.469186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5c8d606e-e90d-4bcc-85ff-ecb4e8dba896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:46.492433 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5c8d606e-e90d-4bcc-85ff-ecb4e8dba896 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1313 microversion: 2.1 time: 1.737046 Jun 16 14:45:46.495961 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 816/1605] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:44 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1313 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:46.509476 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bbcfd754-982a-4397-ba0a-4b449b07700a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:46.517287 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bbcfd754-982a-4397-ba0a-4b449b07700a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:46.536964 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bbcfd754-982a-4397-ba0a-4b449b07700a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:46.541576 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bbcfd754-982a-4397-ba0a-4b449b07700a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:46.543102 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bbcfd754-982a-4397-ba0a-4b449b07700a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:46.544110 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bbcfd754-982a-4397-ba0a-4b449b07700a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:47.023185 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bbcfd754-982a-4397-ba0a-4b449b07700a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:47.059773 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bbcfd754-982a-4397-ba0a-4b449b07700a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1498 microversion: 2.1 time: 0.554454 Jun 16 14:45:47.068962 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 817/1606] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:46 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1498 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:47.084581 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8193075c-3a44-4d3d-8568-9b247dcd3e2f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:47.086411 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8193075c-3a44-4d3d-8568-9b247dcd3e2f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:47.101754 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8193075c-3a44-4d3d-8568-9b247dcd3e2f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:47.102245 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8193075c-3a44-4d3d-8568-9b247dcd3e2f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:47.104391 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8193075c-3a44-4d3d-8568-9b247dcd3e2f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:47.105132 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8193075c-3a44-4d3d-8568-9b247dcd3e2f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:47.745888 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8193075c-3a44-4d3d-8568-9b247dcd3e2f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:47.753478 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:47.778568 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8193075c-3a44-4d3d-8568-9b247dcd3e2f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76" status: 200 len: 1319 microversion: 2.1 time: 0.706388 Jun 16 14:45:47.780688 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 818/1607] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:47 2022] GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 => generated 1319 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:47.806397 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-65a0bf6d-70e8-4057-90f4-b6453d331df0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:47.811619 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-65a0bf6d-70e8-4057-90f4-b6453d331df0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:47.859119 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65a0bf6d-70e8-4057-90f4-b6453d331df0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:47.860998 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65a0bf6d-70e8-4057-90f4-b6453d331df0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:47.863381 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65a0bf6d-70e8-4057-90f4-b6453d331df0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:47.864331 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65a0bf6d-70e8-4057-90f4-b6453d331df0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:48.316818 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-65a0bf6d-70e8-4057-90f4-b6453d331df0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:48.344234 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-65a0bf6d-70e8-4057-90f4-b6453d331df0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1381 microversion: 2.1 time: 0.558033 Jun 16 14:45:48.346105 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 819/1608] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:47 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1381 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:48.357869 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e4ce247b-0a5d-4abe-b781-1bbbfdbf172f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:48.360531 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e4ce247b-0a5d-4abe-b781-1bbbfdbf172f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:48.380921 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4ce247b-0a5d-4abe-b781-1bbbfdbf172f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:48.381755 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4ce247b-0a5d-4abe-b781-1bbbfdbf172f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:48.383289 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4ce247b-0a5d-4abe-b781-1bbbfdbf172f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:48.384042 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4ce247b-0a5d-4abe-b781-1bbbfdbf172f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:48.780607 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e4ce247b-0a5d-4abe-b781-1bbbfdbf172f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:48.833597 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e4ce247b-0a5d-4abe-b781-1bbbfdbf172f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1463 microversion: 2.1 time: 0.485260 Jun 16 14:45:48.840575 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 820/1609] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:48 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1463 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:48.854527 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-87f2b90a-ecd7-4281-9cc7-c5a8e0a9200f req-989aee11-b705-4446-9942-153584fba2ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459d1e53-76b9-48a6-819b-9718e32f6f76", "name": "network-vif-plugged", "status": "completed", "tag": "710e4f94-9261-4fcb-9d50-6b753fda429f"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:48.871582 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-87f2b90a-ecd7-4281-9cc7-c5a8e0a9200f req-989aee11-b705-4446-9942-153584fba2ed service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:48.872406 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-87f2b90a-ecd7-4281-9cc7-c5a8e0a9200f req-989aee11-b705-4446-9942-153584fba2ed service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:48.897453 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-87f2b90a-ecd7-4281-9cc7-c5a8e0a9200f req-989aee11-b705-4446-9942-153584fba2ed service nova] Creating event network-vif-plugged:710e4f94-9261-4fcb-9d50-6b753fda429f for instance 459d1e53-76b9-48a6-819b-9718e32f6f76 on n-h1-836830-4 Jun 16 14:45:48.916593 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-87f2b90a-ecd7-4281-9cc7-c5a8e0a9200f req-989aee11-b705-4446-9942-153584fba2ed service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064951 Jun 16 14:45:48.918666 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 821/1610] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:48.931066 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1a884623-bee4-4af1-8642-dce743bc93d3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:48.932306 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1a884623-bee4-4af1-8642-dce743bc93d3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:48.945877 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a884623-bee4-4af1-8642-dce743bc93d3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:48.946714 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a884623-bee4-4af1-8642-dce743bc93d3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:48.948089 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a884623-bee4-4af1-8642-dce743bc93d3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:48.948907 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a884623-bee4-4af1-8642-dce743bc93d3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:49.452950 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1a884623-bee4-4af1-8642-dce743bc93d3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:49.482794 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1a884623-bee4-4af1-8642-dce743bc93d3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1498 microversion: 2.1 time: 0.553874 Jun 16 14:45:49.482794 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 822/1611] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:48 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1498 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:49.508091 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-23be93b2-9d7e-49be-b770-38b62b1c4ad4 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '.version_select at 0x7fdf110a1670>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:49.518136 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-23be93b2-9d7e-49be-b770-38b62b1c4ad4 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:49.518637 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-23be93b2-9d7e-49be-b770-38b62b1c4ad4 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:49.565760 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-23be93b2-9d7e-49be-b770-38b62b1c4ad4 tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 3881 microversion: 2.1 time: 0.087728 Jun 16 14:45:49.567932 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 823/1612] 10.222.0.57 () {58 vars in 1142 bytes} [Thu Jun 16 14:45:49 2022] GET /compute/v2.1/os-migrations => generated 3881 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:49.580161 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a0a9818d-a339-426b-ad30-a042282bb074 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:49.581751 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a0a9818d-a339-426b-ad30-a042282bb074 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:49.597711 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0a9818d-a339-426b-ad30-a042282bb074 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:49.599409 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0a9818d-a339-426b-ad30-a042282bb074 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:49.604956 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0a9818d-a339-426b-ad30-a042282bb074 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:49.605264 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a0a9818d-a339-426b-ad30-a042282bb074 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:49.891071 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a0a9818d-a339-426b-ad30-a042282bb074 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:49.903092 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a0a9818d-a339-426b-ad30-a042282bb074 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76" status: 200 len: 1319 microversion: 2.1 time: 0.332748 Jun 16 14:45:49.905149 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 824/1613] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:49 2022] GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:50.464026 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a14a65e9-80c5-44b5-a1af-629091b46d52 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:50.470314 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a14a65e9-80c5-44b5-a1af-629091b46d52 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:50.477785 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a14a65e9-80c5-44b5-a1af-629091b46d52 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:50.478593 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a14a65e9-80c5-44b5-a1af-629091b46d52 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:50.479570 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a14a65e9-80c5-44b5-a1af-629091b46d52 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:50.480418 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a14a65e9-80c5-44b5-a1af-629091b46d52 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:50.740896 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a14a65e9-80c5-44b5-a1af-629091b46d52 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1614 microversion: 2.1 time: 0.818566 Jun 16 14:45:50.744293 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 825/1614] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:49 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1614 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:50.754157 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-38a7cf36-bf00-48e7-b4d3-00ece16e157f tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:50.754991 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-38a7cf36-bf00-48e7-b4d3-00ece16e157f tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:50.777990 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38a7cf36-bf00-48e7-b4d3-00ece16e157f tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:50.778553 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38a7cf36-bf00-48e7-b4d3-00ece16e157f tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:50.780846 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38a7cf36-bf00-48e7-b4d3-00ece16e157f tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:50.781846 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38a7cf36-bf00-48e7-b4d3-00ece16e157f tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:51.066862 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-38a7cf36-bf00-48e7-b4d3-00ece16e157f tempest-LiveMigrationTest-868419717 tempest-LiveMigrationTest-868419717-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1532 microversion: 2.1 time: 0.315919 Jun 16 14:45:51.073355 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 826/1615] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:50 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1532 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:51.477884 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c8e9f694-2f3c-4230-b4a4-8797e1db3d87 tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Calling method '.version_select at 0x7fdf0c6554c0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:51.496288 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-00be5dd5-bd81-41c1-832d-c595752af832 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "POST /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d/action" status: 202 len: 0 microversion: 2.1 time: 7.638999 Jun 16 14:45:51.496920 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 790/1616] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:45:43 2022] POST /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d/action => generated 0 bytes in 7641 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 14:45:51.528749 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f868e760-c459-41c8-baa8-908064dbb8bc tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:51.539721 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f868e760-c459-41c8-baa8-908064dbb8bc tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:51.540731 n-d-836830-4 devstack@n-api.service[125863]: DEBUG neutronclient.v2_0.client [None req-c8e9f694-2f3c-4230-b4a4-8797e1db3d87 tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9f1de9f3-8c6c-4a9e-a12e-ce32971305e6 does not exist", "detail": ""}} {{(pid=125863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:45:51.541610 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.security_group_api [None req-c8e9f694-2f3c-4230-b4a4-8797e1db3d87 tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Neutron security group 9f1de9f3-8c6c-4a9e-a12e-ce32971305e6 not found {{(pid=125863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 14:45:51.542615 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-c8e9f694-2f3c-4230-b4a4-8797e1db3d87 tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] HTTP exception thrown: Security group 9f1de9f3-8c6c-4a9e-a12e-ce32971305e6 does not exist Jun 16 14:45:51.542615 n-d-836830-4 devstack@n-api.service[125863]: Neutron server returns request_ids: ['req-c2371dee-dcb9-485f-9c67-f3dd8e2c0621'] Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c8e9f694-2f3c-4230-b4a4-8797e1db3d87 tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Request method failure captured: Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/os-security-groups/9f1de9f3-8c6c-4a9e-a12e-ce32971305e6 HTTP/1.1 Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0IdO7l9KYuGQD4g7yMH1Rz1Ww7IeuGWvPFo8mt6GAelpoIlvkZKIAqE4V5m1fYYruye6UaFkPXGpe1nWHmooEHc7Nc6BP_ioYCKFj6SbPItWaihcT8crL4UBA-n9LKGWAdonr0xNAIIgrp-dGdCTqqf2g6svMsayt2K0aUHEa3a1w8 Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: e569cfe6eb93439ba253fa28bf5ede15 Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-197265659 Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:45:51.545926 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:45:51.547610 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e569cfe6eb93439ba253fa28bf5ede15", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e569cfe6eb93439ba253fa28bf5ede15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e569cfe6eb93439ba253fa28bf5ede15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e569cfe6eb93439ba253fa28bf5ede15"}]}] Jun 16 14:45:51.547610 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-197265659 Jun 16 14:45:51.547610 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: e569cfe6eb93439ba253fa28bf5ede15 Jun 16 14:45:51.547610 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-197265659 Jun 16 14:45:51.547610 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-SecurityGroupsNegativeTestJSON-197265659-project Jun 16 14:45:51.547610 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:45:51.547610 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:45:51.547610 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 97a1d77eacca4e0fbf5f39d2bc001741 Jun 16 14:45:51.547610 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-197265659-project Jun 16 14:45:51.547610 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:45:51.547610 n-d-836830-4 devstack@n-api.service[125863]: exception: Security group 9f1de9f3-8c6c-4a9e-a12e-ce32971305e6 does not exist Jun 16 14:45:51.547610 n-d-836830-4 devstack@n-api.service[125863]: Neutron server returns request_ids: ['req-c2371dee-dcb9-485f-9c67-f3dd8e2c0621'] Jun 16 14:45:51.547610 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '9f1de9f3-8c6c-4a9e-a12e-ce32971305e6'} Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:51.548818 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9f1de9f3-8c6c-4a9e-a12e-ce32971305e6 does not exist Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2371dee-dcb9-485f-9c67-f3dd8e2c0621'] Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 14:45:51.550420 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9f1de9f3-8c6c-4a9e-a12e-ce32971305e6 does not exist Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2371dee-dcb9-485f-9c67-f3dd8e2c0621'] Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9f1de9f3-8c6c-4a9e-a12e-ce32971305e6 does not exist Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2371dee-dcb9-485f-9c67-f3dd8e2c0621'] Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:51.551946 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:51.553724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:51.553724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:51.553724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:45:51.553724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:45:51.553724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9f1de9f3-8c6c-4a9e-a12e-ce32971305e6 does not exist Jun 16 14:45:51.553724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c2371dee-dcb9-485f-9c67-f3dd8e2c0621'] Jun 16 14:45:51.553724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:51.555677 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c8e9f694-2f3c-4230-b4a4-8797e1db3d87 tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Returning 404 to user: Security group 9f1de9f3-8c6c-4a9e-a12e-ce32971305e6 does not exist Jun 16 14:45:51.555677 n-d-836830-4 devstack@n-api.service[125863]: Neutron server returns request_ids: ['req-c2371dee-dcb9-485f-9c67-f3dd8e2c0621'] {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:45:51.556867 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c8e9f694-2f3c-4230-b4a4-8797e1db3d87 tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/9f1de9f3-8c6c-4a9e-a12e-ce32971305e6" status: 404 len: 194 microversion: 2.1 time: 0.479069 Jun 16 14:45:51.557937 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 827/1617] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:45:51 2022] DELETE /compute/v2.1/os-security-groups/9f1de9f3-8c6c-4a9e-a12e-ce32971305e6 => generated 194 bytes in 484 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:45:51.562972 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f868e760-c459-41c8-baa8-908064dbb8bc tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:51.568052 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1994620a-2370-4858-a9a1-21898d120df9 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:51.571135 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f868e760-c459-41c8-baa8-908064dbb8bc tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:51.572049 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1994620a-2370-4858-a9a1-21898d120df9 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:51.581674 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f868e760-c459-41c8-baa8-908064dbb8bc tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:51.584000 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f868e760-c459-41c8-baa8-908064dbb8bc tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:51.589261 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1994620a-2370-4858-a9a1-21898d120df9 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:51.593245 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1994620a-2370-4858-a9a1-21898d120df9 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:51.596497 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1994620a-2370-4858-a9a1-21898d120df9 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:51.598240 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1994620a-2370-4858-a9a1-21898d120df9 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:51.709475 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1994620a-2370-4858-a9a1-21898d120df9 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7027abf25d204ad0920f6fbf5ae3d8a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd3583f5c54aa9b355c861148731b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:51.711866 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1994620a-2370-4858-a9a1-21898d120df9 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] flavor_id is None. Assuming migration. {{(pid=125863) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 16 14:45:51.712174 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1994620a-2370-4858-a9a1-21898d120df9 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125863) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 16 14:45:51.821197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f868e760-c459-41c8-baa8-908064dbb8bc tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:51.833154 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f868e760-c459-41c8-baa8-908064dbb8bc tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1498 microversion: 2.1 time: 0.335004 Jun 16 14:45:51.834363 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 791/1618] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:51 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1498 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:51.839752 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a410c590-61b1-441f-b260-9fa6e29a33fe tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:51.840682 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a410c590-61b1-441f-b260-9fa6e29a33fe tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:51.849528 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a410c590-61b1-441f-b260-9fa6e29a33fe tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:51.850462 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a410c590-61b1-441f-b260-9fa6e29a33fe tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:51.851964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a410c590-61b1-441f-b260-9fa6e29a33fe tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:51.852964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a410c590-61b1-441f-b260-9fa6e29a33fe tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:52.031246 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a410c590-61b1-441f-b260-9fa6e29a33fe tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:52.040070 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a410c590-61b1-441f-b260-9fa6e29a33fe tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76" status: 200 len: 1468 microversion: 2.1 time: 0.204362 Jun 16 14:45:52.042079 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 792/1619] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:51 2022] GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 => generated 1468 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:52.047861 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0f5d124a-690f-402c-9710-6909566c5ddf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:52.048842 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0f5d124a-690f-402c-9710-6909566c5ddf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:52.055078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:52.068348 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0f5d124a-690f-402c-9710-6909566c5ddf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:52.069175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0f5d124a-690f-402c-9710-6909566c5ddf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:52.070751 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0f5d124a-690f-402c-9710-6909566c5ddf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:52.071541 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0f5d124a-690f-402c-9710-6909566c5ddf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:52.087051 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1994620a-2370-4858-a9a1-21898d120df9 tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef/action" status: 202 len: 0 microversion: 2.1 time: 0.527092 Jun 16 14:45:52.088166 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 828/1620] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:45:51 2022] POST /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:45:52.095396 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0343293c-554e-45b4-a858-08c2e27e12da tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-234924692"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:52.097951 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0343293c-554e-45b4-a858-08c2e27e12da tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:52.107067 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0f5d124a-690f-402c-9710-6909566c5ddf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:45:52.108342 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0343293c-554e-45b4-a858-08c2e27e12da tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:52.108945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0343293c-554e-45b4-a858-08c2e27e12da tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:52.109967 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0343293c-554e-45b4-a858-08c2e27e12da tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:52.111346 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0343293c-554e-45b4-a858-08c2e27e12da tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:52.154951 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-0343293c-554e-45b4-a858-08c2e27e12da tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] HTTP exception thrown: Cannot 'createImage' instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d while it is in task_state image_snapshot Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0343293c-554e-45b4-a858-08c2e27e12da tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Request method failure captured: Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d/action HTTP/1.1 Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 84 Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0HwzjjfEOzwOCijJMwAIM9bloQokdG738AdmO2AfwSY4wjVjyQLh9lWAzH4Rn8UCfDe9NW9edyGFTRe1GgDBY6cMZzBwN1dffuTKMcXrVyPL7r_AJ0308sfSN5YHtB5BJ4xC8C7QdPv6xOmwCbcFwnW04fPzhAdrkooBYSucmrM6SQ Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:45:52.156964 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:45:52.158965 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b46102b0fb544d118e324f7fcf654eb2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b46102b0fb544d118e324f7fcf654eb2"}]}] Jun 16 14:45:52.158965 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:45:52.158965 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:45:52.158965 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:45:52.158965 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:45:52.158965 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:45:52.158965 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:45:52.158965 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 8fc694c86102467bb97072ca4972b223 Jun 16 14:45:52.158965 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:45:52.158965 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:45:52.158965 n-d-836830-4 devstack@n-api.service[125863]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-234924692"}} Jun 16 14:45:52.158965 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: exception: Cannot 'createImage' instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d while it is in task_state image_snapshot Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '93a4bc09-c518-4934-842c-4ab2b5a50e0d', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-234924692'}}} Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d in task_state image_snapshot. Cannot snapshot while the instance is in this state. Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:45:52.159849 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d while it is in task_state image_snapshot Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d while it is in task_state image_snapshot Jun 16 14:45:52.161284 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:52.162798 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0343293c-554e-45b4-a858-08c2e27e12da tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Returning 409 to user: Cannot 'createImage' instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d while it is in task_state image_snapshot {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:45:52.162798 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0343293c-554e-45b4-a858-08c2e27e12da tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "POST /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d/action" status: 409 len: 159 microversion: 2.1 time: 0.072057 Jun 16 14:45:52.164508 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 829/1621] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:45:52 2022] POST /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d/action => generated 159 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:45:52.174159 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-200216c7-191b-47cf-a1d7-b0326a0a530d tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004944 Jun 16 14:45:52.175047 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 830/1622] 10.222.0.57 () {58 vars in 1163 bytes} [Thu Jun 16 14:45:52 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 14:45:52.180453 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4d62766c-216f-4416-b212-1f687adf40f8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:52.181106 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4d62766c-216f-4416-b212-1f687adf40f8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: ebabcdb6-1a81-4841-a33e-921e67a0d2f6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:52.189727 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d62766c-216f-4416-b212-1f687adf40f8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:52.190352 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d62766c-216f-4416-b212-1f687adf40f8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:52.191570 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d62766c-216f-4416-b212-1f687adf40f8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:52.192049 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d62766c-216f-4416-b212-1f687adf40f8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:52.384748 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0f5d124a-690f-402c-9710-6909566c5ddf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "DELETE /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 204 len: 0 microversion: 2.1 time: 0.341173 Jun 16 14:45:52.386086 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 793/1623] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:45:52 2022] DELETE /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:45:52.393734 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7e81bf1d-e918-4b76-973d-d34be9490da4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:52.394825 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7e81bf1d-e918-4b76-973d-d34be9490da4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:52.403075 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7e81bf1d-e918-4b76-973d-d34be9490da4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:52.403865 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7e81bf1d-e918-4b76-973d-d34be9490da4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:52.406355 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7e81bf1d-e918-4b76-973d-d34be9490da4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:52.407188 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7e81bf1d-e918-4b76-973d-d34be9490da4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:52.577586 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4d62766c-216f-4416-b212-1f687adf40f8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:52.590591 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4d62766c-216f-4416-b212-1f687adf40f8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6" status: 200 len: 1319 microversion: 2.1 time: 0.414696 Jun 16 14:45:52.592244 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 831/1624] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:52 2022] GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6 => generated 1319 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:52.598809 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3ade97ff-7378-4bbf-92b0-b0054da7a629 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '.version_select at 0x7fdeffb5e3a0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:52.813934 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7e81bf1d-e918-4b76-973d-d34be9490da4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:52.827781 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7e81bf1d-e918-4b76-973d-d34be9490da4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1472 microversion: 2.1 time: 0.439568 Jun 16 14:45:52.841584 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 794/1625] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:52 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1472 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:52.861548 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ea80c2ca-73eb-49ac-872b-de16f440521c tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Calling method '.version_select at 0x7fdf0c4575e0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:53.094656 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3ade97ff-7378-4bbf-92b0-b0054da7a629 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "DELETE /compute/v2.1/images/3eafe73e-7326-4aeb-b70f-0901aed35135" status: 204 len: 0 microversion: 2.1 time: 0.500866 Jun 16 14:45:53.095921 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 832/1626] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:52 2022] DELETE /compute/v2.1/images/3eafe73e-7326-4aeb-b70f-0901aed35135 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:45:53.101563 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7b3a2a99-8338-4319-ae7c-396c8562f64c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:53.109703 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7b3a2a99-8338-4319-ae7c-396c8562f64c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:53.141215 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7b3a2a99-8338-4319-ae7c-396c8562f64c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:53.142137 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7b3a2a99-8338-4319-ae7c-396c8562f64c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:53.143333 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7b3a2a99-8338-4319-ae7c-396c8562f64c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:53.148242 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7b3a2a99-8338-4319-ae7c-396c8562f64c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:53.327242 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ea80c2ca-73eb-49ac-872b-de16f440521c tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.483397 Jun 16 14:45:53.328323 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 795/1627] 10.222.0.57 () {58 vars in 1157 bytes} [Thu Jun 16 14:45:52 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:53.343827 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-286a06aa-a4cb-45f8-ac2e-508b49ebb312 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:53.344477 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-286a06aa-a4cb-45f8-ac2e-508b49ebb312 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:53.358009 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-286a06aa-a4cb-45f8-ac2e-508b49ebb312 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:53.366021 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-286a06aa-a4cb-45f8-ac2e-508b49ebb312 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:53.378251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-286a06aa-a4cb-45f8-ac2e-508b49ebb312 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:53.386028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-286a06aa-a4cb-45f8-ac2e-508b49ebb312 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:53.616842 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7b3a2a99-8338-4319-ae7c-396c8562f64c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:53.641053 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7b3a2a99-8338-4319-ae7c-396c8562f64c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1387 microversion: 2.1 time: 0.543840 Jun 16 14:45:53.641684 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 833/1628] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:53 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1387 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:53.668999 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f51bf2d9-2d49-47bd-bc38-d34816695883 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:53.670280 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f51bf2d9-2d49-47bd-bc38-d34816695883 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:53.700180 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f51bf2d9-2d49-47bd-bc38-d34816695883 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:53.700677 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f51bf2d9-2d49-47bd-bc38-d34816695883 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:53.702275 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f51bf2d9-2d49-47bd-bc38-d34816695883 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:53.702762 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f51bf2d9-2d49-47bd-bc38-d34816695883 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:53.959261 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-286a06aa-a4cb-45f8-ac2e-508b49ebb312 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:53.973990 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-286a06aa-a4cb-45f8-ac2e-508b49ebb312 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1498 microversion: 2.1 time: 0.644376 Jun 16 14:45:53.980154 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 796/1629] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:53 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1498 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:53.990305 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-99d56dac-bf5e-4255-8829-7f00cffcd39e tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Calling method '.version_select at 0x7fdf0c4575e0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:54.327245 n-d-836830-4 devstack@n-api.service[125862]: DEBUG neutronclient.v2_0.client [None req-99d56dac-bf5e-4255-8829-7f00cffcd39e tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=125862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:45:54.328591 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-99d56dac-bf5e-4255-8829-7f00cffcd39e tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] HTTP exception thrown: Insufficient rights for removing default security group. Jun 16 14:45:54.328591 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-ba414570-97e5-4590-835f-3c9f58aea118'] Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-99d56dac-bf5e-4255-8829-7f00cffcd39e tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Request method failure captured: Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/os-security-groups/de29a65b-03a3-4b07-a31c-6d63aef395f6 HTTP/1.1 Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0IdO7l9KYuGQD4g7yMH1Rz1Ww7IeuGWvPFo8mt6GAelpoIlvkZKIAqE4V5m1fYYruye6UaFkPXGpe1nWHmooEHc7Nc6BP_ioYCKFj6SbPItWaihcT8crL4UBA-n9LKGWAdonr0xNAIIgrp-dGdCTqqf2g6svMsayt2K0aUHEa3a1w8 Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: e569cfe6eb93439ba253fa28bf5ede15 Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-197265659 Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:45:54.333454 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:45:54.335135 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e569cfe6eb93439ba253fa28bf5ede15", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e569cfe6eb93439ba253fa28bf5ede15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e569cfe6eb93439ba253fa28bf5ede15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e569cfe6eb93439ba253fa28bf5ede15"}]}] Jun 16 14:45:54.335135 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-197265659 Jun 16 14:45:54.335135 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: e569cfe6eb93439ba253fa28bf5ede15 Jun 16 14:45:54.335135 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-197265659 Jun 16 14:45:54.335135 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupsNegativeTestJSON-197265659-project Jun 16 14:45:54.335135 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:45:54.335135 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:45:54.335135 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 97a1d77eacca4e0fbf5f39d2bc001741 Jun 16 14:45:54.335135 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-197265659-project Jun 16 14:45:54.335135 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:45:54.335135 n-d-836830-4 devstack@n-api.service[125862]: exception: Insufficient rights for removing default security group. Jun 16 14:45:54.335135 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-ba414570-97e5-4590-835f-3c9f58aea118'] Jun 16 14:45:54.335135 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'de29a65b-03a3-4b07-a31c-6d63aef395f6'} Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:54.336081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba414570-97e5-4590-835f-3c9f58aea118'] Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jun 16 14:45:54.337483 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba414570-97e5-4590-835f-3c9f58aea118'] Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba414570-97e5-4590-835f-3c9f58aea118'] Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:54.338927 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:54.341697 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:54.341697 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:45:54.341697 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:45:54.341697 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jun 16 14:45:54.341697 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba414570-97e5-4590-835f-3c9f58aea118'] Jun 16 14:45:54.341697 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:45:54.344137 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-99d56dac-bf5e-4255-8829-7f00cffcd39e tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Returning 400 to user: Insufficient rights for removing default security group. Jun 16 14:45:54.344137 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-ba414570-97e5-4590-835f-3c9f58aea118'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:45:54.345583 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-99d56dac-bf5e-4255-8829-7f00cffcd39e tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/de29a65b-03a3-4b07-a31c-6d63aef395f6" status: 400 len: 182 microversion: 2.1 time: 0.363968 Jun 16 14:45:54.346820 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 797/1630] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:45:53 2022] DELETE /compute/v2.1/os-security-groups/de29a65b-03a3-4b07-a31c-6d63aef395f6 => generated 182 bytes in 366 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:45:54.363931 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-52df6fa1-c1ca-4a2d-9835-8b927e20b0c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:54.364998 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-52df6fa1-c1ca-4a2d-9835-8b927e20b0c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: ebabcdb6-1a81-4841-a33e-921e67a0d2f6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:54.382271 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-52df6fa1-c1ca-4a2d-9835-8b927e20b0c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:54.383172 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-52df6fa1-c1ca-4a2d-9835-8b927e20b0c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:54.384609 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-52df6fa1-c1ca-4a2d-9835-8b927e20b0c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:54.386123 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-52df6fa1-c1ca-4a2d-9835-8b927e20b0c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:54.407997 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:54.751909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-52df6fa1-c1ca-4a2d-9835-8b927e20b0c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:54.785781 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-52df6fa1-c1ca-4a2d-9835-8b927e20b0c8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6" status: 200 len: 1319 microversion: 2.1 time: 0.435398 Jun 16 14:45:54.803891 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 798/1631] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:54 2022] GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6 => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:54.835615 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f51bf2d9-2d49-47bd-bc38-d34816695883 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:54.849140 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f5817258-5bcd-4050-b063-12987f2565a9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:54.854961 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f5817258-5bcd-4050-b063-12987f2565a9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:54.889950 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f51bf2d9-2d49-47bd-bc38-d34816695883 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1540 microversion: 2.1 time: 1.231585 Jun 16 14:45:54.892488 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 834/1632] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:53 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1540 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:54.894067 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f5817258-5bcd-4050-b063-12987f2565a9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:54.899138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f5817258-5bcd-4050-b063-12987f2565a9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:54.900160 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f5817258-5bcd-4050-b063-12987f2565a9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:54.900703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f5817258-5bcd-4050-b063-12987f2565a9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:54.930560 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0407ee16-0f8c-4da2-89fc-e01a525afd73 tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Calling method '.version_select at 0x7fdeffbdf0d0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:55.020893 n-d-836830-4 devstack@n-api.service[125863]: DEBUG neutronclient.v2_0.client [None req-0407ee16-0f8c-4da2-89fc-e01a525afd73 tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e4180716-e337-4a46-9632-670696c53c0d does not exist", "detail": ""}} {{(pid=125863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:45:55.042328 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.security_group_api [None req-0407ee16-0f8c-4da2-89fc-e01a525afd73 tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Neutron security group e4180716-e337-4a46-9632-670696c53c0d not found {{(pid=125863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 14:45:55.046401 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-0407ee16-0f8c-4da2-89fc-e01a525afd73 tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] HTTP exception thrown: Security group e4180716-e337-4a46-9632-670696c53c0d does not exist Jun 16 14:45:55.046401 n-d-836830-4 devstack@n-api.service[125863]: Neutron server returns request_ids: ['req-05bddf54-a7df-4582-8182-237d52e42570'] Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0407ee16-0f8c-4da2-89fc-e01a525afd73 tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Request method failure captured: Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/os-security-groups/e4180716-e337-4a46-9632-670696c53c0d HTTP/1.1 Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0IdO7l9KYuGQD4g7yMH1Rz1Ww7IeuGWvPFo8mt6GAelpoIlvkZKIAqE4V5m1fYYruye6UaFkPXGpe1nWHmooEHc7Nc6BP_ioYCKFj6SbPItWaihcT8crL4UBA-n9LKGWAdonr0xNAIIgrp-dGdCTqqf2g6svMsayt2K0aUHEa3a1w8 Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: e569cfe6eb93439ba253fa28bf5ede15 Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-197265659 Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:45:55.056045 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:45:55.058148 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e569cfe6eb93439ba253fa28bf5ede15", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e569cfe6eb93439ba253fa28bf5ede15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e569cfe6eb93439ba253fa28bf5ede15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e569cfe6eb93439ba253fa28bf5ede15"}]}] Jun 16 14:45:55.058148 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-197265659 Jun 16 14:45:55.058148 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: e569cfe6eb93439ba253fa28bf5ede15 Jun 16 14:45:55.058148 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-197265659 Jun 16 14:45:55.058148 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-SecurityGroupsNegativeTestJSON-197265659-project Jun 16 14:45:55.058148 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:45:55.058148 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:45:55.058148 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 97a1d77eacca4e0fbf5f39d2bc001741 Jun 16 14:45:55.058148 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-197265659-project Jun 16 14:45:55.058148 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:45:55.058148 n-d-836830-4 devstack@n-api.service[125863]: exception: Security group e4180716-e337-4a46-9632-670696c53c0d does not exist Jun 16 14:45:55.058148 n-d-836830-4 devstack@n-api.service[125863]: Neutron server returns request_ids: ['req-05bddf54-a7df-4582-8182-237d52e42570'] Jun 16 14:45:55.058148 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'e4180716-e337-4a46-9632-670696c53c0d'} Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:55.059351 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e4180716-e337-4a46-9632-670696c53c0d does not exist Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05bddf54-a7df-4582-8182-237d52e42570'] Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 14:45:55.061402 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e4180716-e337-4a46-9632-670696c53c0d does not exist Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05bddf54-a7df-4582-8182-237d52e42570'] Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e4180716-e337-4a46-9632-670696c53c0d does not exist Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05bddf54-a7df-4582-8182-237d52e42570'] Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:55.063853 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:55.067301 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:55.067301 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:55.067301 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:45:55.067301 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:45:55.067301 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e4180716-e337-4a46-9632-670696c53c0d does not exist Jun 16 14:45:55.067301 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05bddf54-a7df-4582-8182-237d52e42570'] Jun 16 14:45:55.067301 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:45:55.067301 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0407ee16-0f8c-4da2-89fc-e01a525afd73 tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Returning 404 to user: Security group e4180716-e337-4a46-9632-670696c53c0d does not exist Jun 16 14:45:55.067301 n-d-836830-4 devstack@n-api.service[125863]: Neutron server returns request_ids: ['req-05bddf54-a7df-4582-8182-237d52e42570'] {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:45:55.067301 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0407ee16-0f8c-4da2-89fc-e01a525afd73 tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] 10.222.0.57 "GET /compute/v2.1/os-security-groups/e4180716-e337-4a46-9632-670696c53c0d" status: 404 len: 194 microversion: 2.1 time: 0.165526 Jun 16 14:45:55.074968 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 835/1633] 10.222.0.57 () {58 vars in 1268 bytes} [Thu Jun 16 14:45:54 2022] GET /compute/v2.1/os-security-groups/e4180716-e337-4a46-9632-670696c53c0d => generated 194 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:45:55.091790 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-540bdf94-b686-44f1-a1b2-dd681ffd2cb6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:55.092376 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-540bdf94-b686-44f1-a1b2-dd681ffd2cb6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:55.103778 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=95 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:55.108188 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-540bdf94-b686-44f1-a1b2-dd681ffd2cb6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:55.109283 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-540bdf94-b686-44f1-a1b2-dd681ffd2cb6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:55.110869 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-540bdf94-b686-44f1-a1b2-dd681ffd2cb6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:55.111960 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-540bdf94-b686-44f1-a1b2-dd681ffd2cb6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:55.321746 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f5817258-5bcd-4050-b063-12987f2565a9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:55.346865 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f5817258-5bcd-4050-b063-12987f2565a9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1472 microversion: 2.1 time: 0.534537 Jun 16 14:45:55.348129 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 799/1634] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:54 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1472 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:55.354090 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f790e6b6-2eec-4b06-9b20-da207999e55b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:55.359998 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f790e6b6-2eec-4b06-9b20-da207999e55b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:55.387617 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f790e6b6-2eec-4b06-9b20-da207999e55b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:55.391679 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f790e6b6-2eec-4b06-9b20-da207999e55b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:55.392687 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f790e6b6-2eec-4b06-9b20-da207999e55b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:55.393161 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f790e6b6-2eec-4b06-9b20-da207999e55b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:55.808651 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f790e6b6-2eec-4b06-9b20-da207999e55b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:55.824473 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f790e6b6-2eec-4b06-9b20-da207999e55b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 200 len: 1475 microversion: 2.1 time: 0.474591 Jun 16 14:45:55.825091 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 800/1635] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:55 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 1475 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:55.833669 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5a8d9777-4bb3-49e5-9d53-91ec9a34717d tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Action: 'update', calling method: .version_select at 0x7fdf0c5885e0>, body: {"security_group": {"name": "tempest-sg-1493067682", "description": "tempest-description-1671600769"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:55.908891 n-d-836830-4 devstack@n-api.service[125862]: DEBUG neutronclient.v2_0.client [None req-5a8d9777-4bb3-49e5-9d53-91ec9a34717d tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2490d347-014c-41b3-b4ae-34b32533e4a8 does not exist", "detail": ""}} {{(pid=125862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:45:55.910546 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.security_group_api [None req-5a8d9777-4bb3-49e5-9d53-91ec9a34717d tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Neutron security group 2490d347-014c-41b3-b4ae-34b32533e4a8 not found {{(pid=125862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 14:45:55.910964 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-5a8d9777-4bb3-49e5-9d53-91ec9a34717d tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] HTTP exception thrown: Security group 2490d347-014c-41b3-b4ae-34b32533e4a8 does not exist Jun 16 14:45:55.910964 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-deefc45b-b2d5-40a2-a4dd-d7fb061b8bb8'] Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5a8d9777-4bb3-49e5-9d53-91ec9a34717d tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Request method failure captured: Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: request: PUT /compute/v2.1/os-security-groups/2490d347-014c-41b3-b4ae-34b32533e4a8 HTTP/1.1 Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 102 Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0IdO7l9KYuGQD4g7yMH1Rz1Ww7IeuGWvPFo8mt6GAelpoIlvkZKIAqE4V5m1fYYruye6UaFkPXGpe1nWHmooEHc7Nc6BP_ioYCKFj6SbPItWaihcT8crL4UBA-n9LKGWAdonr0xNAIIgrp-dGdCTqqf2g6svMsayt2K0aUHEa3a1w8 Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: e569cfe6eb93439ba253fa28bf5ede15 Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-197265659 Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:45:55.925891 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:45:55.928783 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e569cfe6eb93439ba253fa28bf5ede15", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e569cfe6eb93439ba253fa28bf5ede15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e569cfe6eb93439ba253fa28bf5ede15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e569cfe6eb93439ba253fa28bf5ede15"}]}] Jun 16 14:45:55.928783 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-197265659 Jun 16 14:45:55.928783 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: e569cfe6eb93439ba253fa28bf5ede15 Jun 16 14:45:55.928783 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-197265659 Jun 16 14:45:55.928783 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupsNegativeTestJSON-197265659-project Jun 16 14:45:55.928783 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:45:55.928783 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:45:55.928783 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 97a1d77eacca4e0fbf5f39d2bc001741 Jun 16 14:45:55.928783 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-197265659-project Jun 16 14:45:55.928783 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:45:55.928783 n-d-836830-4 devstack@n-api.service[125862]: {"security_group": {"name": "tempest-sg-1493067682", "description": "tempest-description-1671600769"}} Jun 16 14:45:55.928783 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:45:55.928783 n-d-836830-4 devstack@n-api.service[125862]: exception: Security group 2490d347-014c-41b3-b4ae-34b32533e4a8 does not exist Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-deefc45b-b2d5-40a2-a4dd-d7fb061b8bb8'] Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '2490d347-014c-41b3-b4ae-34b32533e4a8', 'body': {'security_group': {'name': 'tempest-sg-1493067682', 'description': 'tempest-description-1671600769'}}} Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:45:55.930456 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2490d347-014c-41b3-b4ae-34b32533e4a8 does not exist Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-deefc45b-b2d5-40a2-a4dd-d7fb061b8bb8'] Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 16 14:45:55.932951 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2490d347-014c-41b3-b4ae-34b32533e4a8 does not exist Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-deefc45b-b2d5-40a2-a4dd-d7fb061b8bb8'] Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2490d347-014c-41b3-b4ae-34b32533e4a8 does not exist Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-deefc45b-b2d5-40a2-a4dd-d7fb061b8bb8'] Jun 16 14:45:55.940599 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:45:55.944624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:45:55.944624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:45:55.944624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:45:55.944624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:45:55.944624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:45:55.944624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:45:55.944624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:45:55.944624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2490d347-014c-41b3-b4ae-34b32533e4a8 does not exist Jun 16 14:45:55.944624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-deefc45b-b2d5-40a2-a4dd-d7fb061b8bb8'] Jun 16 14:45:55.944624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:45:55.944624 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5a8d9777-4bb3-49e5-9d53-91ec9a34717d tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] Returning 404 to user: Security group 2490d347-014c-41b3-b4ae-34b32533e4a8 does not exist Jun 16 14:45:55.944624 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-deefc45b-b2d5-40a2-a4dd-d7fb061b8bb8'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:45:55.944624 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5a8d9777-4bb3-49e5-9d53-91ec9a34717d tempest-SecurityGroupsNegativeTestJSON-197265659 tempest-SecurityGroupsNegativeTestJSON-197265659-project] 10.222.0.57 "PUT /compute/v2.1/os-security-groups/2490d347-014c-41b3-b4ae-34b32533e4a8" status: 404 len: 194 microversion: 2.1 time: 0.106078 Jun 16 14:45:55.951916 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 801/1636] 10.222.0.57 () {60 vars in 1289 bytes} [Thu Jun 16 14:45:55 2022] PUT /compute/v2.1/os-security-groups/2490d347-014c-41b3-b4ae-34b32533e4a8 => generated 194 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:45:55.983383 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6ac1f517-dc68-44c2-87cf-9c353fe1545f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:55.991630 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6ac1f517-dc68-44c2-87cf-9c353fe1545f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: ebabcdb6-1a81-4841-a33e-921e67a0d2f6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:56.030887 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6ac1f517-dc68-44c2-87cf-9c353fe1545f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:56.042931 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6ac1f517-dc68-44c2-87cf-9c353fe1545f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:56.063025 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6ac1f517-dc68-44c2-87cf-9c353fe1545f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:56.064028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6ac1f517-dc68-44c2-87cf-9c353fe1545f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:56.696286 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6ac1f517-dc68-44c2-87cf-9c353fe1545f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:56.761142 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6ac1f517-dc68-44c2-87cf-9c353fe1545f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6" status: 200 len: 1319 microversion: 2.1 time: 0.804324 Jun 16 14:45:56.766670 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 802/1637] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:55 2022] GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6 => generated 1319 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:56.775803 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ea46f86e-996d-42bb-b837-70db0dc08981 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1262880170"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:56.781576 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ea46f86e-996d-42bb-b837-70db0dc08981 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:56.815569 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ea46f86e-996d-42bb-b837-70db0dc08981 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:56.816062 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ea46f86e-996d-42bb-b837-70db0dc08981 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:56.816927 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ea46f86e-996d-42bb-b837-70db0dc08981 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:56.819557 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ea46f86e-996d-42bb-b837-70db0dc08981 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:56.955378 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-540bdf94-b686-44f1-a1b2-dd681ffd2cb6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:56.975817 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-540bdf94-b686-44f1-a1b2-dd681ffd2cb6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1387 microversion: 2.1 time: 1.901595 Jun 16 14:45:56.991466 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 836/1638] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:55 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1387 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:57.012738 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bb8a5591-ded6-45ae-9cb9-599754c38fa7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:57.015150 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bb8a5591-ded6-45ae-9cb9-599754c38fa7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:57.043549 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb8a5591-ded6-45ae-9cb9-599754c38fa7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:57.047050 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb8a5591-ded6-45ae-9cb9-599754c38fa7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:57.048037 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb8a5591-ded6-45ae-9cb9-599754c38fa7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:57.048635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb8a5591-ded6-45ae-9cb9-599754c38fa7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:57.552744 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ea46f86e-996d-42bb-b837-70db0dc08981 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "POST /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef/action" status: 202 len: 0 microversion: 2.1 time: 0.781524 Jun 16 14:45:57.554020 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 803/1639] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:45:56 2022] POST /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef/action => generated 0 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 14:45:57.582360 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0633c3b4-2d31-4a3a-8d4e-497d787e5db4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:57.584052 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0633c3b4-2d31-4a3a-8d4e-497d787e5db4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:57.624353 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0633c3b4-2d31-4a3a-8d4e-497d787e5db4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:57.625047 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0633c3b4-2d31-4a3a-8d4e-497d787e5db4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:57.627396 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0633c3b4-2d31-4a3a-8d4e-497d787e5db4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:57.627954 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0633c3b4-2d31-4a3a-8d4e-497d787e5db4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:57.880519 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bb8a5591-ded6-45ae-9cb9-599754c38fa7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:57.894275 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bb8a5591-ded6-45ae-9cb9-599754c38fa7 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1522 microversion: 2.1 time: 0.901319 Jun 16 14:45:57.895933 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 837/1640] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:56 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1522 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:57.908945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-5547c953-39cd-4469-a78b-e9f3315fbb06 req-26661add-4fe0-4576-8307-ac1ed3f20368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebabcdb6-1a81-4841-a33e-921e67a0d2f6", "name": "network-vif-plugged", "status": "completed", "tag": "8f89bbb6-77f8-45b7-9492-458a024a5387"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:57.925232 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-5547c953-39cd-4469-a78b-e9f3315fbb06 req-26661add-4fe0-4576-8307-ac1ed3f20368 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:57.925992 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-5547c953-39cd-4469-a78b-e9f3315fbb06 req-26661add-4fe0-4576-8307-ac1ed3f20368 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:57.941829 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-5547c953-39cd-4469-a78b-e9f3315fbb06 req-26661add-4fe0-4576-8307-ac1ed3f20368 service nova] Creating event network-vif-plugged:8f89bbb6-77f8-45b7-9492-458a024a5387 for instance ebabcdb6-1a81-4841-a33e-921e67a0d2f6 on n-h1-836830-4 Jun 16 14:45:57.948244 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-5547c953-39cd-4469-a78b-e9f3315fbb06 req-26661add-4fe0-4576-8307-ac1ed3f20368 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049847 Jun 16 14:45:57.949152 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 838/1641] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:57.960287 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-25e13e0b-ff73-43e2-bcab-1ac313149f25 req-40b42c89-b39e-4e60-a83f-417c6929be38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d49ca2-5a83-4054-bedf-0c06897d6b07", "name": "network-vif-deleted", "tag": "ad00f43d-1679-420a-90e5-decadf4b3c3e"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:45:57.972973 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-25e13e0b-ff73-43e2-bcab-1ac313149f25 req-40b42c89-b39e-4e60-a83f-417c6929be38 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:57.973708 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-25e13e0b-ff73-43e2-bcab-1ac313149f25 req-40b42c89-b39e-4e60-a83f-417c6929be38 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:58.000964 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-25e13e0b-ff73-43e2-bcab-1ac313149f25 req-40b42c89-b39e-4e60-a83f-417c6929be38 service nova] Creating event network-vif-deleted:ad00f43d-1679-420a-90e5-decadf4b3c3e for instance 34d49ca2-5a83-4054-bedf-0c06897d6b07 on n-h2-836830-4 Jun 16 14:45:58.011917 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-25e13e0b-ff73-43e2-bcab-1ac313149f25 req-40b42c89-b39e-4e60-a83f-417c6929be38 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055188 Jun 16 14:45:58.015516 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 839/1642] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:45:58.027969 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-28fc6b77-f813-4df4-9add-6a2d613a12b4 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf110b0790>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:58.116751 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0633c3b4-2d31-4a3a-8d4e-497d787e5db4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:58.133769 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0633c3b4-2d31-4a3a-8d4e-497d787e5db4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1472 microversion: 2.1 time: 0.565857 Jun 16 14:45:58.138954 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 804/1643] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:57 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1472 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:58.145717 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-28fc6b77-f813-4df4-9add-6a2d613a12b4 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.126696 Jun 16 14:45:58.147252 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 840/1644] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:45:58 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:58.149872 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e0486409-5d37-4a21-b141-774f7ddc9f23 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:58.160089 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-eed9fccd-4b7c-4b51-a2bb-ddeda340970d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:58.161533 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-eed9fccd-4b7c-4b51-a2bb-ddeda340970d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:58.169224 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e0486409-5d37-4a21-b141-774f7ddc9f23 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: ebabcdb6-1a81-4841-a33e-921e67a0d2f6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:58.175719 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eed9fccd-4b7c-4b51-a2bb-ddeda340970d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:58.176970 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eed9fccd-4b7c-4b51-a2bb-ddeda340970d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:58.178710 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eed9fccd-4b7c-4b51-a2bb-ddeda340970d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:58.179909 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eed9fccd-4b7c-4b51-a2bb-ddeda340970d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:58.204992 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0486409-5d37-4a21-b141-774f7ddc9f23 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:58.215846 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0486409-5d37-4a21-b141-774f7ddc9f23 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:58.218694 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0486409-5d37-4a21-b141-774f7ddc9f23 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:58.222239 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0486409-5d37-4a21-b141-774f7ddc9f23 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:58.286286 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:58.307633 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-eed9fccd-4b7c-4b51-a2bb-ddeda340970d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:45:58.738972 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-eed9fccd-4b7c-4b51-a2bb-ddeda340970d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "DELETE /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 204 len: 0 microversion: 2.1 time: 0.587797 Jun 16 14:45:58.740531 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 841/1645] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:45:58 2022] DELETE /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:45:58.752409 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b651f2d9-c3a5-4ffb-8786-aabe13fe496a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:58.754522 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b651f2d9-c3a5-4ffb-8786-aabe13fe496a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:58.768057 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b651f2d9-c3a5-4ffb-8786-aabe13fe496a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:58.769691 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b651f2d9-c3a5-4ffb-8786-aabe13fe496a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:58.773398 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b651f2d9-c3a5-4ffb-8786-aabe13fe496a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:58.774288 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b651f2d9-c3a5-4ffb-8786-aabe13fe496a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:58.925031 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b651f2d9-c3a5-4ffb-8786-aabe13fe496a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:58.936627 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b651f2d9-c3a5-4ffb-8786-aabe13fe496a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1183 microversion: 2.1 time: 0.193791 Jun 16 14:45:58.940454 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 842/1646] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:58 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:58.946634 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3bd4f5bf-0b16-4f90-81cd-4734d9b9954a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:58.947193 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3bd4f5bf-0b16-4f90-81cd-4734d9b9954a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:58.972250 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3bd4f5bf-0b16-4f90-81cd-4734d9b9954a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:58.973301 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3bd4f5bf-0b16-4f90-81cd-4734d9b9954a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:58.973682 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3bd4f5bf-0b16-4f90-81cd-4734d9b9954a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:58.974023 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3bd4f5bf-0b16-4f90-81cd-4734d9b9954a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:59.041120 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e0486409-5d37-4a21-b141-774f7ddc9f23 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:59.091101 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e0486409-5d37-4a21-b141-774f7ddc9f23 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6" status: 200 len: 1319 microversion: 2.1 time: 0.948220 Jun 16 14:45:59.097071 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 805/1647] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:58 2022] GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6 => generated 1319 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:59.169294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-40fddd2e-35ac-4fbe-82b0-9f05fcc41814 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c588430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:59.415847 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3bd4f5bf-0b16-4f90-81cd-4734d9b9954a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:45:59.430250 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-40fddd2e-35ac-4fbe-82b0-9f05fcc41814 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.270436 Jun 16 14:45:59.431813 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3bd4f5bf-0b16-4f90-81cd-4734d9b9954a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1528 microversion: 2.1 time: 0.489858 Jun 16 14:45:59.432693 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 806/1648] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:45:59 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:45:59.444007 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d9e4913f-198a-46d7-8cfb-05521ff510d0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:59.446060 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d9e4913f-198a-46d7-8cfb-05521ff510d0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:45:59.454496 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 843/1649] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:58 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1528 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:45:59.465591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d9e4913f-198a-46d7-8cfb-05521ff510d0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:59.466937 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d9e4913f-198a-46d7-8cfb-05521ff510d0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:59.469395 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d9e4913f-198a-46d7-8cfb-05521ff510d0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:45:59.470688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d9e4913f-198a-46d7-8cfb-05521ff510d0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:45:59.973695 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ea103958-c197-47c1-a98d-4d248ec24ee0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:45:59.987761 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ea103958-c197-47c1-a98d-4d248ec24ee0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:00.022685 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ea103958-c197-47c1-a98d-4d248ec24ee0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:00.023513 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ea103958-c197-47c1-a98d-4d248ec24ee0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:00.041782 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ea103958-c197-47c1-a98d-4d248ec24ee0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:00.043099 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ea103958-c197-47c1-a98d-4d248ec24ee0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:00.290694 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ea103958-c197-47c1-a98d-4d248ec24ee0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:00.331742 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ea103958-c197-47c1-a98d-4d248ec24ee0 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1183 microversion: 2.1 time: 0.366558 Jun 16 14:46:00.351720 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 844/1650] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:59 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1183 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:00.373210 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f4d5c17b-4824-43af-9734-dbb2b37e5d17 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:00.375859 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f4d5c17b-4824-43af-9734-dbb2b37e5d17 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: ebabcdb6-1a81-4841-a33e-921e67a0d2f6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:00.389490 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f4d5c17b-4824-43af-9734-dbb2b37e5d17 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:00.390843 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f4d5c17b-4824-43af-9734-dbb2b37e5d17 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:00.393352 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f4d5c17b-4824-43af-9734-dbb2b37e5d17 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:00.399346 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d9e4913f-198a-46d7-8cfb-05521ff510d0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:00.408067 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f4d5c17b-4824-43af-9734-dbb2b37e5d17 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:00.430161 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d9e4913f-198a-46d7-8cfb-05521ff510d0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1472 microversion: 2.1 time: 0.994030 Jun 16 14:46:00.436048 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 807/1651] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:45:59 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1472 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:00.476478 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-55e25199-5a1c-4166-aa75-a553a1d5db1a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c38e940>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:00.665177 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-55e25199-5a1c-4166-aa75-a553a1d5db1a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.214480 Jun 16 14:46:00.676454 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 808/1652] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:00 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:00.689127 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8c2bd3b2-0fca-4636-9f90-d4386d655bf4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:00.690883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8c2bd3b2-0fca-4636-9f90-d4386d655bf4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:00.713360 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8c2bd3b2-0fca-4636-9f90-d4386d655bf4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:00.714788 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8c2bd3b2-0fca-4636-9f90-d4386d655bf4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:00.718179 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8c2bd3b2-0fca-4636-9f90-d4386d655bf4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:00.720187 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8c2bd3b2-0fca-4636-9f90-d4386d655bf4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:00.996618 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f4d5c17b-4824-43af-9734-dbb2b37e5d17 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:01.009675 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f4d5c17b-4824-43af-9734-dbb2b37e5d17 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6" status: 200 len: 1319 microversion: 2.1 time: 0.654957 Jun 16 14:46:01.016484 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 845/1653] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:00 2022] GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6 => generated 1319 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:01.360205 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-31eb3158-2848-4d99-b920-825baa348259 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:01.361327 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-31eb3158-2848-4d99-b920-825baa348259 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:01.372330 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31eb3158-2848-4d99-b920-825baa348259 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:01.379228 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31eb3158-2848-4d99-b920-825baa348259 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:01.380743 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31eb3158-2848-4d99-b920-825baa348259 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:01.381515 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31eb3158-2848-4d99-b920-825baa348259 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:01.562858 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8c2bd3b2-0fca-4636-9f90-d4386d655bf4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:01.589800 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-31eb3158-2848-4d99-b920-825baa348259 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:01.592928 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8c2bd3b2-0fca-4636-9f90-d4386d655bf4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1528 microversion: 2.1 time: 0.913828 Jun 16 14:46:01.594998 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 809/1654] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:00 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1528 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:01.609610 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0b95e5d6-09af-4031-8791-ad435a3d3109 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:01.616794 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0b95e5d6-09af-4031-8791-ad435a3d3109 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:01.629076 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-31eb3158-2848-4d99-b920-825baa348259 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1183 microversion: 2.1 time: 0.273254 Jun 16 14:46:01.632175 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 846/1655] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:01 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1183 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:46:01.648464 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b95e5d6-09af-4031-8791-ad435a3d3109 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:01.649472 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b95e5d6-09af-4031-8791-ad435a3d3109 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:01.651563 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b95e5d6-09af-4031-8791-ad435a3d3109 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:01.652555 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b95e5d6-09af-4031-8791-ad435a3d3109 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:01.684716 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6aa5f343-9e13-4dbc-8492-7586393caaf7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf11103160>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:01.791395 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6aa5f343-9e13-4dbc-8492-7586393caaf7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.110699 Jun 16 14:46:01.792659 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 847/1656] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:01 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:46:02.046803 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3488f049-ce97-492d-8d05-d2d7b4be6a29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:02.050139 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3488f049-ce97-492d-8d05-d2d7b4be6a29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: ebabcdb6-1a81-4841-a33e-921e67a0d2f6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:02.065808 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3488f049-ce97-492d-8d05-d2d7b4be6a29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:02.067033 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3488f049-ce97-492d-8d05-d2d7b4be6a29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:02.068214 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3488f049-ce97-492d-8d05-d2d7b4be6a29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:02.068935 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3488f049-ce97-492d-8d05-d2d7b4be6a29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:02.221943 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0b95e5d6-09af-4031-8791-ad435a3d3109 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:02.256832 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0b95e5d6-09af-4031-8791-ad435a3d3109 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1477 microversion: 2.1 time: 0.657670 Jun 16 14:46:02.284146 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 810/1657] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:01 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1477 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:02.574225 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-cc182ce4-d815-4832-b825-4f2feb7c3516 req-645bfb84-17a9-49a2-9f0f-661eefbd7bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a4bc09-c518-4934-842c-4ab2b5a50e0d", "name": "network-vif-deleted", "tag": "9b779512-66fc-4a6a-a2ed-896ac2a82125"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:02.644920 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-cc182ce4-d815-4832-b825-4f2feb7c3516 req-645bfb84-17a9-49a2-9f0f-661eefbd7bdf service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:02.646731 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-cc182ce4-d815-4832-b825-4f2feb7c3516 req-645bfb84-17a9-49a2-9f0f-661eefbd7bdf service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:02.717758 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-cc182ce4-d815-4832-b825-4f2feb7c3516 req-645bfb84-17a9-49a2-9f0f-661eefbd7bdf service nova] Creating event network-vif-deleted:9b779512-66fc-4a6a-a2ed-896ac2a82125 for instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d on n-h2-836830-4 Jun 16 14:46:02.742922 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-cc182ce4-d815-4832-b825-4f2feb7c3516 req-645bfb84-17a9-49a2-9f0f-661eefbd7bdf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174902 Jun 16 14:46:02.746712 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 811/1658] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:46:02.770986 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8366781d-ee4a-410e-b333-af6b1d3a8b42 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:02.774261 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8366781d-ee4a-410e-b333-af6b1d3a8b42 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:02.821602 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3488f049-ce97-492d-8d05-d2d7b4be6a29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:02.830080 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8366781d-ee4a-410e-b333-af6b1d3a8b42 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:02.833776 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8366781d-ee4a-410e-b333-af6b1d3a8b42 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:02.839890 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8366781d-ee4a-410e-b333-af6b1d3a8b42 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:02.842502 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8366781d-ee4a-410e-b333-af6b1d3a8b42 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:02.845842 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3488f049-ce97-492d-8d05-d2d7b4be6a29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6" status: 200 len: 1469 microversion: 2.1 time: 0.806129 Jun 16 14:46:02.864188 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 848/1659] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:02 2022] GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6 => generated 1469 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:02.882984 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-41c56d2f-ea71-4505-8421-7b0697fd1a3c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:02.884631 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-41c56d2f-ea71-4505-8421-7b0697fd1a3c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:02.899290 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-41c56d2f-ea71-4505-8421-7b0697fd1a3c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:02.900519 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-41c56d2f-ea71-4505-8421-7b0697fd1a3c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:02.919136 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-41c56d2f-ea71-4505-8421-7b0697fd1a3c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:02.922628 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-41c56d2f-ea71-4505-8421-7b0697fd1a3c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:02.964958 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8366781d-ee4a-410e-b333-af6b1d3a8b42 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:02.968623 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8366781d-ee4a-410e-b333-af6b1d3a8b42 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:02.971511 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-8366781d-ee4a-410e-b333-af6b1d3a8b42 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lazy-loading 'fault' on Instance uuid 93a4bc09-c518-4934-842c-4ab2b5a50e0d {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:46:03.159551 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-41c56d2f-ea71-4505-8421-7b0697fd1a3c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:03.178589 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-41c56d2f-ea71-4505-8421-7b0697fd1a3c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1183 microversion: 2.1 time: 0.312042 Jun 16 14:46:03.179810 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 849/1660] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:02 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:03.187560 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b5b5e43a-5d40-47d2-aee9-35fd724c4be8 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c077a60>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:03.321018 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b5b5e43a-5d40-47d2-aee9-35fd724c4be8 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.127454 Jun 16 14:46:03.328401 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 850/1661] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:03 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:03.360069 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6293a1ff-389f-4f81-b218-f3290f97caeb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:03.367503 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8366781d-ee4a-410e-b333-af6b1d3a8b42 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:03.383158 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6293a1ff-389f-4f81-b218-f3290f97caeb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:03.388928 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6293a1ff-389f-4f81-b218-f3290f97caeb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Searching by: {'reservation_id': 'r-fxa61xnl', 'deleted': False, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8'} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:46:03.409840 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8366781d-ee4a-410e-b333-af6b1d3a8b42 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 200 len: 1315 microversion: 2.1 time: 0.658032 Jun 16 14:46:03.410864 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 812/1662] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:02 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:03.411347 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6293a1ff-389f-4f81-b218-f3290f97caeb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:03.412609 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6293a1ff-389f-4f81-b218-f3290f97caeb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:03.415216 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6293a1ff-389f-4f81-b218-f3290f97caeb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:03.417530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6293a1ff-389f-4f81-b218-f3290f97caeb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:03.459401 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6d79942f-984b-4833-8e6f-9b33acf33638 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:03.472895 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6d79942f-984b-4833-8e6f-9b33acf33638 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:03.521002 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d79942f-984b-4833-8e6f-9b33acf33638 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:03.521772 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d79942f-984b-4833-8e6f-9b33acf33638 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:03.525578 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d79942f-984b-4833-8e6f-9b33acf33638 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:03.526430 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d79942f-984b-4833-8e6f-9b33acf33638 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:03.814457 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.multi_cell_list [None req-6293a1ff-389f-4f81-b218-f3290f97caeb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:46:04.210469 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6293a1ff-389f-4f81-b218-f3290f97caeb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:04.233466 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6d79942f-984b-4833-8e6f-9b33acf33638 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:04.250711 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6d79942f-984b-4833-8e6f-9b33acf33638 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1477 microversion: 2.1 time: 0.819423 Jun 16 14:46:04.251859 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6293a1ff-389f-4f81-b218-f3290f97caeb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:04.253023 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6293a1ff-389f-4f81-b218-f3290f97caeb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:04.265594 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 813/1663] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:03 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1477 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:04.275100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b08ef4a5-da80-42e1-8524-852a12143da6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:04.278348 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b08ef4a5-da80-42e1-8524-852a12143da6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:04.293049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b08ef4a5-da80-42e1-8524-852a12143da6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:04.297017 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b08ef4a5-da80-42e1-8524-852a12143da6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:04.301862 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b08ef4a5-da80-42e1-8524-852a12143da6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:04.305925 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b08ef4a5-da80-42e1-8524-852a12143da6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:04.522670 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b08ef4a5-da80-42e1-8524-852a12143da6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:04.540604 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b08ef4a5-da80-42e1-8524-852a12143da6 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1183 microversion: 2.1 time: 0.272800 Jun 16 14:46:04.566570 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 814/1664] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:04 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1183 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:04.574331 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-23c1ba36-9256-4e0f-b2e9-48cb90148e7a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c606280>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:04.737707 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-23c1ba36-9256-4e0f-b2e9-48cb90148e7a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.168935 Jun 16 14:46:04.754427 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6293a1ff-389f-4f81-b218-f3290f97caeb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/detail?reservation_id=r-fxa61xnl" status: 200 len: 2930 microversion: 2.1 time: 1.409444 Jun 16 14:46:04.754427 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 851/1665] 10.222.0.57 () {58 vars in 1196 bytes} [Thu Jun 16 14:46:03 2022] GET /compute/v2.1/servers/detail?reservation_id=r-fxa61xnl => generated 2930 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:04.757145 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 815/1666] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:04 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:04.770223 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-edbd27bf-c1de-4a17-980f-c7a004edd751 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:04.776358 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-edbd27bf-c1de-4a17-980f-c7a004edd751 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:04.778909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1fe12c79-dc28-4e0b-ba78-493b08ef271b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:04.800160 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-edbd27bf-c1de-4a17-980f-c7a004edd751 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:04.802948 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-edbd27bf-c1de-4a17-980f-c7a004edd751 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:04.810395 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-edbd27bf-c1de-4a17-980f-c7a004edd751 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:04.813694 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-edbd27bf-c1de-4a17-980f-c7a004edd751 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:04.816814 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.compute.server_groups [None req-1fe12c79-dc28-4e0b-ba78-493b08ef271b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Querying cell 5f79e34c-a163-4b02-a0e0-fa1420b72299(cell1) for 2 instances {{(pid=125862) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 16 14:46:04.822398 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1fe12c79-dc28-4e0b-ba78-493b08ef271b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:04.830421 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1fe12c79-dc28-4e0b-ba78-493b08ef271b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:04.898845 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-edbd27bf-c1de-4a17-980f-c7a004edd751 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] HTTP exception thrown: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. Jun 16 14:46:04.925812 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1fe12c79-dc28-4e0b-ba78-493b08ef271b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/os-server-groups/1559d51e-ea8d-42f2-8628-45af7c1cb09b" status: 200 len: 265 microversion: 2.1 time: 0.162187 Jun 16 14:46:04.927125 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 816/1667] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jun 16 14:46:04 2022] GET /compute/v2.1/os-server-groups/1559d51e-ea8d-42f2-8628-45af7c1cb09b => generated 265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-edbd27bf-c1de-4a17-980f-c7a004edd751 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Request method failure captured: Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d HTTP/1.1 Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0HwzjjfEOzwOCijJMwAIM9bloQokdG738AdmO2AfwSY4wjVjyQLh9lWAzH4Rn8UCfDe9NW9edyGFTRe1GgDBY6cMZzBwN1dffuTKMcXrVyPL7r_AJ0308sfSN5YHtB5BJ4xC8C7QdPv6xOmwCbcFwnW04fPzhAdrkooBYSucmrM6SQ Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:46:04.928855 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:46:04.931071 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b46102b0fb544d118e324f7fcf654eb2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b46102b0fb544d118e324f7fcf654eb2"}]}] Jun 16 14:46:04.931071 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:46:04.931071 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:46:04.931071 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:46:04.931071 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:46:04.931071 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:46:04.931071 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:46:04.931071 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 8fc694c86102467bb97072ca4972b223 Jun 16 14:46:04.931071 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:46:04.931071 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:46:04.931071 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. Jun 16 14:46:04.931071 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '93a4bc09-c518-4934-842c-4ab2b5a50e0d'} Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:46:04.932639 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. Jun 16 14:46:04.935636 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:46:04.939613 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-edbd27bf-c1de-4a17-980f-c7a004edd751 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Returning 404 to user: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:46:04.942897 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-edbd27bf-c1de-4a17-980f-c7a004edd751 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 404 len: 111 microversion: 2.1 time: 0.197263 Jun 16 14:46:04.946298 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 852/1668] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:04 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:46:04.970004 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-484865e6-5710-496b-8263-242fc7f5d4e2 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:04.972963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-484865e6-5710-496b-8263-242fc7f5d4e2 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:04.976895 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-88cc907d-ce58-41da-ad71-543d9bca8c63 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Action: 'create', calling method: .version_select at 0x7fdf11098160>, body: {"keypair": {"name": "tempest-keypair-1987501787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVnqEB61qctq5zENqLorfvbA9r659jl7qk7feciLHRoU2HqKAbs2Rtej/E2cYuGI8OB4KxmM4OtAzJduBbq8MckBFRW78KP79s3kNJZEHitbIPE+BlXbXmSUQOETah4aA=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:04.988738 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-484865e6-5710-496b-8263-242fc7f5d4e2 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:04.989928 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-484865e6-5710-496b-8263-242fc7f5d4e2 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:04.991478 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-484865e6-5710-496b-8263-242fc7f5d4e2 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:04.992354 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-484865e6-5710-496b-8263-242fc7f5d4e2 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:05.114628 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-88cc907d-ce58-41da-ad71-543d9bca8c63 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Getting quotas for project b46102b0fb544d118e324f7fcf654eb2. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:46:05.153050 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-88cc907d-ce58-41da-ad71-543d9bca8c63 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Getting quotas for user 8fc694c86102467bb97072ca4972b223 and project b46102b0fb544d118e324f7fcf654eb2. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:46:05.303852 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-88cc907d-ce58-41da-ad71-543d9bca8c63 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.338537 Jun 16 14:46:05.310772 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 853/1669] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:46:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:46:05.313932 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-af9b4097-5845-4a60-bf41-597d01e54b15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:05.314821 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-af9b4097-5845-4a60-bf41-597d01e54b15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:05.324120 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-af9b4097-5845-4a60-bf41-597d01e54b15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:05.324598 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-af9b4097-5845-4a60-bf41-597d01e54b15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:05.325437 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-af9b4097-5845-4a60-bf41-597d01e54b15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:05.326908 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-af9b4097-5845-4a60-bf41-597d01e54b15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:06.043856 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-484865e6-5710-496b-8263-242fc7f5d4e2 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76" status: 200 len: 1619 microversion: 2.1 time: 1.077249 Jun 16 14:46:06.045011 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 817/1670] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:04 2022] GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 => generated 1619 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:06.083263 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e37746fa-f356-4f37-af31-603e69b6c2ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:06.088792 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e37746fa-f356-4f37-af31-603e69b6c2ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:06.131598 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e37746fa-f356-4f37-af31-603e69b6c2ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:06.132309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e37746fa-f356-4f37-af31-603e69b6c2ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:06.144666 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e37746fa-f356-4f37-af31-603e69b6c2ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:06.145499 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e37746fa-f356-4f37-af31-603e69b6c2ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:06.258691 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:06.293499 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-af9b4097-5845-4a60-bf41-597d01e54b15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:06.356065 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-af9b4097-5845-4a60-bf41-597d01e54b15 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1477 microversion: 2.1 time: 1.048193 Jun 16 14:46:06.380647 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 854/1671] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:05 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1477 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:06.413837 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-726d4d78-11d3-4e76-9247-8265984a76d1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffb5e160>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:06.643557 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-726d4d78-11d3-4e76-9247-8265984a76d1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.258155 Jun 16 14:46:06.650826 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e37746fa-f356-4f37-af31-603e69b6c2ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:06.654326 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 855/1672] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:06 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:06.666079 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3172ceb7-58c6-4bfc-80ac-eba1ee1a4d7c tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:06.686528 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3172ceb7-58c6-4bfc-80ac-eba1ee1a4d7c tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] [instance: ebabcdb6-1a81-4841-a33e-921e67a0d2f6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:06.692382 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e37746fa-f356-4f37-af31-603e69b6c2ca tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1183 microversion: 2.1 time: 0.645669 Jun 16 14:46:06.699075 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 818/1673] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:06 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1183 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:06.720202 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-3b0dcfca-a21d-4e48-bd37-57676e9860a1 req-9250b48f-1fa1-4114-9d02-3da47a7301cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26234dd2-d806-4819-ac5a-651c8dd442ef", "name": "network-vif-plugged", "status": "completed", "tag": "ec234d03-baa1-4218-9879-5938404785e9"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:06.735305 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3172ceb7-58c6-4bfc-80ac-eba1ee1a4d7c tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:06.736183 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3172ceb7-58c6-4bfc-80ac-eba1ee1a4d7c tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:06.737295 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3172ceb7-58c6-4bfc-80ac-eba1ee1a4d7c tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:06.738040 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3172ceb7-58c6-4bfc-80ac-eba1ee1a4d7c tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:06.807542 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3b0dcfca-a21d-4e48-bd37-57676e9860a1 req-9250b48f-1fa1-4114-9d02-3da47a7301cf service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:06.808753 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3b0dcfca-a21d-4e48-bd37-57676e9860a1 req-9250b48f-1fa1-4114-9d02-3da47a7301cf service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:06.850266 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-3b0dcfca-a21d-4e48-bd37-57676e9860a1 req-9250b48f-1fa1-4114-9d02-3da47a7301cf service nova] Creating event network-vif-plugged:ec234d03-baa1-4218-9879-5938404785e9 for instance 26234dd2-d806-4819-ac5a-651c8dd442ef on n-h1-836830-4 Jun 16 14:46:06.874708 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-3b0dcfca-a21d-4e48-bd37-57676e9860a1 req-9250b48f-1fa1-4114-9d02-3da47a7301cf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169028 Jun 16 14:46:06.882471 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 819/1674] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:46:07.270049 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3172ceb7-58c6-4bfc-80ac-eba1ee1a4d7c tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6" status: 200 len: 1620 microversion: 2.1 time: 0.614126 Jun 16 14:46:07.303330 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 856/1675] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:06 2022] GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6 => generated 1620 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:07.354934 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-aecbbbfd-1a47-4f79-8dcb-11066d7b8f5a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Action: 'create', calling method: .version_select at 0x7fdf0c5af670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1497642340", "policies": ["anti-affinity"]}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:07.418687 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-854d8523-f4bc-46c0-a32f-7e057ce076d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:07.429853 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-854d8523-f4bc-46c0-a32f-7e057ce076d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:07.485111 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-aecbbbfd-1a47-4f79-8dcb-11066d7b8f5a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_groups'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:46:07.499499 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-854d8523-f4bc-46c0-a32f-7e057ce076d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:07.504586 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-854d8523-f4bc-46c0-a32f-7e057ce076d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:07.516398 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-854d8523-f4bc-46c0-a32f-7e057ce076d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:07.531558 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-854d8523-f4bc-46c0-a32f-7e057ce076d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:07.561679 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-aecbbbfd-1a47-4f79-8dcb-11066d7b8f5a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_groups'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:46:07.822630 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-aecbbbfd-1a47-4f79-8dcb-11066d7b8f5a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_groups'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:46:07.845843 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-aecbbbfd-1a47-4f79-8dcb-11066d7b8f5a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_groups'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:46:07.933535 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-aecbbbfd-1a47-4f79-8dcb-11066d7b8f5a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.616760 Jun 16 14:46:07.935653 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 820/1676] 10.222.0.57 () {60 vars in 1173 bytes} [Thu Jun 16 14:46:07 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:46:07.997816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6b0137bf-162e-4d44-a8ef-4090d24e42c4 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffefdca0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:08.198174 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6b0137bf-162e-4d44-a8ef-4090d24e42c4 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.259473 Jun 16 14:46:08.208989 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 821/1677] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:07 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:08.223745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0fb27fc1-9964-492e-adb3-9ae00329daab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:08.228428 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0fb27fc1-9964-492e-adb3-9ae00329daab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:08.251799 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0fb27fc1-9964-492e-adb3-9ae00329daab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:08.252803 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0fb27fc1-9964-492e-adb3-9ae00329daab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:08.261178 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0fb27fc1-9964-492e-adb3-9ae00329daab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:08.262183 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0fb27fc1-9964-492e-adb3-9ae00329daab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:08.402455 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-854d8523-f4bc-46c0-a32f-7e057ce076d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:08.452470 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-854d8523-f4bc-46c0-a32f-7e057ce076d6 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1477 microversion: 2.1 time: 1.052460 Jun 16 14:46:08.472595 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 857/1678] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:07 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1477 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:08.665962 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-752510560", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a74e683f-8a1f-405f-8fb8-95762d26da01"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:08.677124 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0fb27fc1-9964-492e-adb3-9ae00329daab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:08.726666 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0fb27fc1-9964-492e-adb3-9ae00329daab tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1183 microversion: 2.1 time: 0.513637 Jun 16 14:46:08.728120 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 822/1679] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:08 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1183 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:08.893621 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:46:09.227861 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3268d1f9-ea4d-438b-bc32-e553451de071 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c27b1f0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:09.479112 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3268d1f9-ea4d-438b-bc32-e553451de071 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.258913 Jun 16 14:46:09.512468 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 823/1680] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:09 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:09.564981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c8f09bbc-b112-4b78-a637-31cbf7222d3a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:09.567172 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c8f09bbc-b112-4b78-a637-31cbf7222d3a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:09.602509 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8f09bbc-b112-4b78-a637-31cbf7222d3a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:09.603773 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8f09bbc-b112-4b78-a637-31cbf7222d3a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:09.606792 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8f09bbc-b112-4b78-a637-31cbf7222d3a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:09.608434 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8f09bbc-b112-4b78-a637-31cbf7222d3a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:10.206782 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:46:10.208181 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:46:10.209113 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:46:10.209962 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:46:10.210758 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:46:10.464246 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:10.465287 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:10.467114 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:10.467589 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:10.650837 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:46:10.703592 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:46:10.814449 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Going to run 2 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:46:10.841918 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: e8129f55-69cc-43f8-b70a-c04f23d336c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:46:10.901543 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c8f09bbc-b112-4b78-a637-31cbf7222d3a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:10.938452 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c8f09bbc-b112-4b78-a637-31cbf7222d3a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1477 microversion: 2.1 time: 1.419498 Jun 16 14:46:10.944327 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 824/1681] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:09 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1477 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:10.965264 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2353905a-bdef-4e6d-8a57-cc0a91c1a47a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:10.972437 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2353905a-bdef-4e6d-8a57-cc0a91c1a47a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:11.004474 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2353905a-bdef-4e6d-8a57-cc0a91c1a47a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:11.012122 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2353905a-bdef-4e6d-8a57-cc0a91c1a47a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:11.016309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2353905a-bdef-4e6d-8a57-cc0a91c1a47a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:11.025297 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2353905a-bdef-4e6d-8a57-cc0a91c1a47a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:11.152360 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=125863) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jun 16 14:46:11.320634 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:46:11.340045 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:46:11.453114 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:46:11.467763 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2353905a-bdef-4e6d-8a57-cc0a91c1a47a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:11.469116 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:46:11.495478 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2353905a-bdef-4e6d-8a57-cc0a91c1a47a tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1183 microversion: 2.1 time: 0.548785 Jun 16 14:46:11.499688 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 825/1682] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:10 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1183 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:11.520154 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4c6d68ce-ec88-47c8-aea1-e13ffe6e0280 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c27b040>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:11.526829 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=e8129f55-69cc-43f8-b70a-c04f23d336c5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:46:11.642580 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:11.650016 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4c6d68ce-ec88-47c8-aea1-e13ffe6e0280 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.148015 Jun 16 14:46:11.650715 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 826/1683] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:11 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:11.711131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-70959613", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "174724bb-1f38-4b2e-afaf-aad767c219ae"}], "block_device_mapping_v2": [{"uuid": "d846fe03-c7f2-4494-a560-51d656aaa8dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:11.831842 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:46:11.853138 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:46:11.980445 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] validate_networks() for [('174724bb-1f38-4b2e-afaf-aad767c219ae', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:46:12.011152 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:46:12.035930 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'server_group_members'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:46:12.204079 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-578f88dc-06af-4096-867b-ad76e55bb618 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.548205 Jun 16 14:46:12.207683 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 858/1684] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:46:08 2022] POST /compute/v2.1/servers => generated 32 bytes in 3553 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 16 14:46:12.260823 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2657c33a-7688-4ec7-b05d-9406b8a111ed tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:12.262710 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2657c33a-7688-4ec7-b05d-9406b8a111ed tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:12.295129 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2657c33a-7688-4ec7-b05d-9406b8a111ed tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:12.296155 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2657c33a-7688-4ec7-b05d-9406b8a111ed tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:12.301058 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2657c33a-7688-4ec7-b05d-9406b8a111ed tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:12.302215 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2657c33a-7688-4ec7-b05d-9406b8a111ed tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:13.109178 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2657c33a-7688-4ec7-b05d-9406b8a111ed tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:13.127917 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2657c33a-7688-4ec7-b05d-9406b8a111ed tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1477 microversion: 2.1 time: 0.911092 Jun 16 14:46:13.144278 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 859/1685] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:12 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1477 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:13.157516 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5027085b-7df6-4adb-b2fe-1d7d88667d91 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:13.162758 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5027085b-7df6-4adb-b2fe-1d7d88667d91 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:13.167873 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5027085b-7df6-4adb-b2fe-1d7d88667d91 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Searching by: {'deleted': False, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8'} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:46:13.209693 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5027085b-7df6-4adb-b2fe-1d7d88667d91 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:13.210169 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5027085b-7df6-4adb-b2fe-1d7d88667d91 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:13.211600 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5027085b-7df6-4adb-b2fe-1d7d88667d91 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:13.213041 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5027085b-7df6-4adb-b2fe-1d7d88667d91 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:13.329986 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.multi_cell_list [None req-5027085b-7df6-4adb-b2fe-1d7d88667d91 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=125863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:46:13.395841 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:13.412558 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5027085b-7df6-4adb-b2fe-1d7d88667d91 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.265933 Jun 16 14:46:13.415658 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 860/1686] 10.222.0.57 () {58 vars in 1124 bytes} [Thu Jun 16 14:46:13 2022] GET /compute/v2.1/servers => generated 1663 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:13.424214 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-146e7907-e316-4636-9609-4ef0f6d1640e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:13.426315 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-146e7907-e316-4636-9609-4ef0f6d1640e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:13.446827 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-146e7907-e316-4636-9609-4ef0f6d1640e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:13.454083 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-146e7907-e316-4636-9609-4ef0f6d1640e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:13.457374 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-146e7907-e316-4636-9609-4ef0f6d1640e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:13.458860 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-146e7907-e316-4636-9609-4ef0f6d1640e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:13.570915 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-146e7907-e316-4636-9609-4ef0f6d1640e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:13.571934 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-146e7907-e316-4636-9609-4ef0f6d1640e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:13.572416 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-146e7907-e316-4636-9609-4ef0f6d1640e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lazy-loading 'fault' on Instance uuid 34d49ca2-5a83-4054-bedf-0c06897d6b07 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:46:13.593267 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:46:13.594262 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:46:13.594978 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:46:13.595590 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:46:13.597498 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:46:13.619182 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:13.620065 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:13.623402 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:13.626814 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:13.683908 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Getting quotas for project c04830ebf498422d9dddfbc009697728. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:46:13.699806 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Getting quotas for user ab3aa4e887694a0e9a42bf6db6b01555 and project c04830ebf498422d9dddfbc009697728. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:46:13.836456 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-146e7907-e316-4636-9609-4ef0f6d1640e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:13.875993 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-146e7907-e316-4636-9609-4ef0f6d1640e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 200 len: 1142 microversion: 2.1 time: 0.455773 Jun 16 14:46:13.895309 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 861/1687] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:13 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 1142 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:13.909798 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2c117bab-1122-4934-aebf-8bbcec7ce419 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf110a1f70>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:13.966527 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:46:13.969078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d846fe03-c7f2-4494-a560-51d656aaa8dc',volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:46:14.031611 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2c117bab-1122-4934-aebf-8bbcec7ce419 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.111079 Jun 16 14:46:14.033555 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 862/1688] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:13 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:14.047976 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1608080820", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:14.222137 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] validate_networks() for [('487c2811-25df-4e80-8a06-b782ae938f03', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:46:14.405989 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-03fbeebc-ad0f-471a-9c05-514f0dcb51ac tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.698489 Jun 16 14:46:14.408017 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 827/1689] 10.222.0.57 () {62 vars in 1187 bytes} [Thu Jun 16 14:46:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2702 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 14:46:14.426426 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c50d6d06-b693-4224-8741-27af3b8b6ec4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:14.428883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c50d6d06-b693-4224-8741-27af3b8b6ec4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:14.438871 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:14.449108 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c50d6d06-b693-4224-8741-27af3b8b6ec4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:14.453495 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c50d6d06-b693-4224-8741-27af3b8b6ec4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:14.454778 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c50d6d06-b693-4224-8741-27af3b8b6ec4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:14.455530 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c50d6d06-b693-4224-8741-27af3b8b6ec4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:14.692098 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c50d6d06-b693-4224-8741-27af3b8b6ec4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:14.709622 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c50d6d06-b693-4224-8741-27af3b8b6ec4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1222 microversion: 2.1 time: 0.298463 Jun 16 14:46:14.712812 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 828/1690] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:14 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1222 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:14.726989 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-85e7a6d8-dee8-464a-aff8-eeb1e774cee9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:14.729874 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-85e7a6d8-dee8-464a-aff8-eeb1e774cee9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:14.745229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85e7a6d8-dee8-464a-aff8-eeb1e774cee9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:14.754540 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85e7a6d8-dee8-464a-aff8-eeb1e774cee9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:14.755739 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85e7a6d8-dee8-464a-aff8-eeb1e774cee9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:14.757007 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85e7a6d8-dee8-464a-aff8-eeb1e774cee9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:15.203044 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-85e7a6d8-dee8-464a-aff8-eeb1e774cee9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:15.224750 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-85e7a6d8-dee8-464a-aff8-eeb1e774cee9 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1477 microversion: 2.1 time: 0.510278 Jun 16 14:46:15.232282 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 829/1691] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:14 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1477 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:15.270565 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-eb17dfd5-3cb3-417a-85a1-f8ab5c9c2e4c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:15.274981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-eb17dfd5-3cb3-417a-85a1-f8ab5c9c2e4c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:15.377429 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-eb17dfd5-3cb3-417a-85a1-f8ab5c9c2e4c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:15.387346 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-eb17dfd5-3cb3-417a-85a1-f8ab5c9c2e4c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:15.389949 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-eb17dfd5-3cb3-417a-85a1-f8ab5c9c2e4c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:15.391487 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-eb17dfd5-3cb3-417a-85a1-f8ab5c9c2e4c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1102 microversion: 2.25 time: 0.157563 Jun 16 14:46:15.392419 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 830/1692] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:46:15 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1102 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:46:15.397720 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c23a9fbb-12da-4939-b5b7-21d5aa9865a3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:15.398919 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c23a9fbb-12da-4939-b5b7-21d5aa9865a3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 34d49ca2-5a83-4054-bedf-0c06897d6b07] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:15.412054 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c23a9fbb-12da-4939-b5b7-21d5aa9865a3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:15.412988 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c23a9fbb-12da-4939-b5b7-21d5aa9865a3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:15.416646 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c23a9fbb-12da-4939-b5b7-21d5aa9865a3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:15.417480 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c23a9fbb-12da-4939-b5b7-21d5aa9865a3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:15.455092 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-c23a9fbb-12da-4939-b5b7-21d5aa9865a3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] HTTP exception thrown: Instance 34d49ca2-5a83-4054-bedf-0c06897d6b07 could not be found. Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c23a9fbb-12da-4939-b5b7-21d5aa9865a3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Request method failure captured: Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 HTTP/1.1 Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_0KNDTPm3aaPQWBjf2jaunYMLa52Mei7kADPpFAOuvd6sGwJKxBasvBAqBMk5lzG5tHbAapIkL8DLicntDUOZEGR_uQjLR8FAI30R2NQBazbaq9YxqhzRMe1F3HFkFs2bV_SA6n4_BWkDwPNQCvvX86b3d0nDS6wkMRH7VBGyJjVc Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: b0484f4c1c304b84a88b7d2be3b9483c Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-LiveMigrationTest-1876095101 Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:46:15.461609 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:46:15.463964 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b0484f4c1c304b84a88b7d2be3b9483c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0484f4c1c304b84a88b7d2be3b9483c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0484f4c1c304b84a88b7d2be3b9483c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b0484f4c1c304b84a88b7d2be3b9483c"}]}] Jun 16 14:46:15.463964 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-LiveMigrationTest-1876095101 Jun 16 14:46:15.463964 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: b0484f4c1c304b84a88b7d2be3b9483c Jun 16 14:46:15.463964 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-LiveMigrationTest-1876095101 Jun 16 14:46:15.463964 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-LiveMigrationTest-1876095101-project Jun 16 14:46:15.463964 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:46:15.463964 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:46:15.463964 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 96fb5660c35642ad9da6d8bb34e393f4 Jun 16 14:46:15.463964 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-LiveMigrationTest-1876095101-project Jun 16 14:46:15.463964 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:46:15.463964 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 34d49ca2-5a83-4054-bedf-0c06897d6b07 could not be found. Jun 16 14:46:15.463964 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '34d49ca2-5a83-4054-bedf-0c06897d6b07'} Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d49ca2-5a83-4054-bedf-0c06897d6b07 could not be found. Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:46:15.465110 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d49ca2-5a83-4054-bedf-0c06897d6b07 could not be found. Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d49ca2-5a83-4054-bedf-0c06897d6b07 could not be found. Jun 16 14:46:15.467944 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:46:15.472665 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c23a9fbb-12da-4939-b5b7-21d5aa9865a3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Returning 404 to user: Instance 34d49ca2-5a83-4054-bedf-0c06897d6b07 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:46:15.474713 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c23a9fbb-12da-4939-b5b7-21d5aa9865a3 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07" status: 404 len: 111 microversion: 2.1 time: 0.080846 Jun 16 14:46:15.476476 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 831/1693] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:15 2022] GET /compute/v2.1/servers/34d49ca2-5a83-4054-bedf-0c06897d6b07 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:46:15.531426 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bd036f43-384f-4598-a638-d515ba66fa45 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c552c10>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:15.682533 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bd036f43-384f-4598-a638-d515ba66fa45 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.202505 Jun 16 14:46:15.698972 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 832/1694] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:15 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:15.759805 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-02f4b830-4251-49ad-95e8-c76745873e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:15.761968 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-02f4b830-4251-49ad-95e8-c76745873e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:15.779207 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02f4b830-4251-49ad-95e8-c76745873e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:15.786993 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02f4b830-4251-49ad-95e8-c76745873e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:15.792556 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02f4b830-4251-49ad-95e8-c76745873e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:15.795230 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02f4b830-4251-49ad-95e8-c76745873e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:16.079074 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:46:16.082367 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:46:16.083567 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:46:16.085415 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:46:16.086503 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:46:16.121789 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:16.134090 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:16.141222 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:16.142344 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:16.330336 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Getting quotas for project b46102b0fb544d118e324f7fcf654eb2. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:46:16.366757 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-02f4b830-4251-49ad-95e8-c76745873e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:16.383728 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Getting quotas for user 8fc694c86102467bb97072ca4972b223 and project b46102b0fb544d118e324f7fcf654eb2. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:46:16.402903 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-02f4b830-4251-49ad-95e8-c76745873e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1270 microversion: 2.1 time: 0.660860 Jun 16 14:46:16.408033 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 833/1695] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:15 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1270 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:16.432620 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ee93c887-bcd0-4780-9387-f968bca3426d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:16.438340 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ee93c887-bcd0-4780-9387-f968bca3426d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:16.489019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ee93c887-bcd0-4780-9387-f968bca3426d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:16.491897 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:46:16.492520 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ee93c887-bcd0-4780-9387-f968bca3426d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:16.494250 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ee93c887-bcd0-4780-9387-f968bca3426d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:16.497819 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:46:16.499107 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ee93c887-bcd0-4780-9387-f968bca3426d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:16.772988 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-59a228f4-c0fb-45a9-ba0e-b5bd92714cfb tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.737659 Jun 16 14:46:16.780149 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 863/1696] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:46:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:46:16.795656 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3fc35a4e-b195-4211-a796-1bb80ca199d3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:16.796666 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3fc35a4e-b195-4211-a796-1bb80ca199d3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:16.810827 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3fc35a4e-b195-4211-a796-1bb80ca199d3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:16.816441 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3fc35a4e-b195-4211-a796-1bb80ca199d3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:16.817701 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3fc35a4e-b195-4211-a796-1bb80ca199d3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:16.818498 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3fc35a4e-b195-4211-a796-1bb80ca199d3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:17.008890 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ee93c887-bcd0-4780-9387-f968bca3426d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:17.032676 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ee93c887-bcd0-4780-9387-f968bca3426d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1477 microversion: 2.1 time: 0.614315 Jun 16 14:46:17.034446 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 834/1697] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:16 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1477 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:17.077962 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-83ab826d-211a-4bb7-859b-ab8ea9f92c34 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c27b280>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:17.203305 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-83ab826d-211a-4bb7-859b-ab8ea9f92c34 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.165749 Jun 16 14:46:17.212539 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 835/1698] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:17 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:17.226351 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-37d2bd3d-3618-4678-88c7-e0e15ec934f0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:17.228561 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-37d2bd3d-3618-4678-88c7-e0e15ec934f0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:17.468924 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-37d2bd3d-3618-4678-88c7-e0e15ec934f0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:17.483987 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-37d2bd3d-3618-4678-88c7-e0e15ec934f0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1225 microversion: 2.1 time: 0.268492 Jun 16 14:46:17.498419 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 836/1699] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:17 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1225 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:17.500241 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-168decdf-de33-4397-acae-189f5f37bc29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:17.507217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-168decdf-de33-4397-acae-189f5f37bc29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:17.513745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-168decdf-de33-4397-acae-189f5f37bc29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:17.516555 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-168decdf-de33-4397-acae-189f5f37bc29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:17.519197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-168decdf-de33-4397-acae-189f5f37bc29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:17.520185 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-168decdf-de33-4397-acae-189f5f37bc29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:17.630797 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3fc35a4e-b195-4211-a796-1bb80ca199d3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:17.660284 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3fc35a4e-b195-4211-a796-1bb80ca199d3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:17.664800 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3fc35a4e-b195-4211-a796-1bb80ca199d3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:17.676178 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-168decdf-de33-4397-acae-189f5f37bc29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:17.684190 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3fc35a4e-b195-4211-a796-1bb80ca199d3 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1175 microversion: 2.25 time: 0.888648 Jun 16 14:46:17.691406 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 864/1700] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:46:16 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1175 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:46:17.695084 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-168decdf-de33-4397-acae-189f5f37bc29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1276 microversion: 2.1 time: 0.199518 Jun 16 14:46:17.701275 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 837/1701] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:17 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1276 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:18.065996 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-79223e20-2e73-4c92-9035-b7f714a98aa0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:18.066830 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-79223e20-2e73-4c92-9035-b7f714a98aa0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:18.091796 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-79223e20-2e73-4c92-9035-b7f714a98aa0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:18.094362 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-79223e20-2e73-4c92-9035-b7f714a98aa0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:18.096676 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-79223e20-2e73-4c92-9035-b7f714a98aa0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:18.102931 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-79223e20-2e73-4c92-9035-b7f714a98aa0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:18.222766 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-20ca6d6e-754b-4be8-bfaa-7db69680b44f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c4bb040>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:18.383845 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-20ca6d6e-754b-4be8-bfaa-7db69680b44f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.168448 Jun 16 14:46:18.384459 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 838/1702] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:18 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:18.517654 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-58835769-776b-4421-ab34-7edff31bf977 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:18.518714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-58835769-776b-4421-ab34-7edff31bf977 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:18.807258 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-58835769-776b-4421-ab34-7edff31bf977 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:18.831025 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-58835769-776b-4421-ab34-7edff31bf977 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1225 microversion: 2.1 time: 0.308969 Jun 16 14:46:18.833387 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 839/1703] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:18 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1225 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:18.850995 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f6b985e1-d561-4f70-aa37-a0daeea417cc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:18.863432 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f6b985e1-d561-4f70-aa37-a0daeea417cc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:18.904525 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f6b985e1-d561-4f70-aa37-a0daeea417cc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:18.905813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f6b985e1-d561-4f70-aa37-a0daeea417cc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:18.908095 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f6b985e1-d561-4f70-aa37-a0daeea417cc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:18.917889 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f6b985e1-d561-4f70-aa37-a0daeea417cc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:19.323850 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f6b985e1-d561-4f70-aa37-a0daeea417cc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:19.358165 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f6b985e1-d561-4f70-aa37-a0daeea417cc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:19.373001 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f6b985e1-d561-4f70-aa37-a0daeea417cc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:19.379684 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f6b985e1-d561-4f70-aa37-a0daeea417cc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1249 microversion: 2.25 time: 0.542704 Jun 16 14:46:19.394923 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 840/1704] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:46:18 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1249 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:46:19.432599 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0292c46c-d780-4a78-bfcc-4ac9ac916518 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:19.442444 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0292c46c-d780-4a78-bfcc-4ac9ac916518 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:19.484245 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0292c46c-d780-4a78-bfcc-4ac9ac916518 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:19.486156 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0292c46c-d780-4a78-bfcc-4ac9ac916518 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:19.491835 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0292c46c-d780-4a78-bfcc-4ac9ac916518 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:19.497912 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0292c46c-d780-4a78-bfcc-4ac9ac916518 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:19.819864 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0292c46c-d780-4a78-bfcc-4ac9ac916518 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:19.829832 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0292c46c-d780-4a78-bfcc-4ac9ac916518 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1276 microversion: 2.1 time: 0.433136 Jun 16 14:46:19.836560 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 841/1705] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:19 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1276 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:19.845961 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-53890bff-b253-4ec3-a883-b63a319c2231 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c94f700>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:20.000016 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-53890bff-b253-4ec3-a883-b63a319c2231 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.161942 Jun 16 14:46:20.001870 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 842/1706] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:19 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:20.014262 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e480e81f-e092-4f74-ab12-7622f4c6abe0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:20.022502 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e480e81f-e092-4f74-ab12-7622f4c6abe0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:20.042336 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e480e81f-e092-4f74-ab12-7622f4c6abe0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:20.044360 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e480e81f-e092-4f74-ab12-7622f4c6abe0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:20.048837 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e480e81f-e092-4f74-ab12-7622f4c6abe0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:20.054049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e480e81f-e092-4f74-ab12-7622f4c6abe0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:20.126164 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-79223e20-2e73-4c92-9035-b7f714a98aa0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:20.186928 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-79223e20-2e73-4c92-9035-b7f714a98aa0 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1477 microversion: 2.1 time: 2.122277 Jun 16 14:46:20.190987 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 865/1707] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:18 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1477 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:20.418051 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1cd8473f-9ee3-4294-b246-2896bba8d9d2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:20.423526 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1cd8473f-9ee3-4294-b246-2896bba8d9d2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:20.486632 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1cd8473f-9ee3-4294-b246-2896bba8d9d2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:20.490237 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1cd8473f-9ee3-4294-b246-2896bba8d9d2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:20.496445 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1cd8473f-9ee3-4294-b246-2896bba8d9d2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:20.507915 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1cd8473f-9ee3-4294-b246-2896bba8d9d2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:21.009636 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e480e81f-e092-4f74-ab12-7622f4c6abe0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:21.049402 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e480e81f-e092-4f74-ab12-7622f4c6abe0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1277 microversion: 2.1 time: 1.045936 Jun 16 14:46:21.066149 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1cd8473f-9ee3-4294-b246-2896bba8d9d2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:21.094194 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 843/1708] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:20 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1277 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:21.120782 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1cd8473f-9ee3-4294-b246-2896bba8d9d2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:21.124921 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1cd8473f-9ee3-4294-b246-2896bba8d9d2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:21.143471 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1cd8473f-9ee3-4294-b246-2896bba8d9d2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1249 microversion: 2.25 time: 0.716383 Jun 16 14:46:21.159012 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 866/1709] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:46:20 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1249 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:46:21.162509 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6c4e0ac2-8af6-4d31-921a-201fa0336e6e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:21.169812 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6c4e0ac2-8af6-4d31-921a-201fa0336e6e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:21.173847 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0c6e8621-3b2b-4fcb-a125-461f71efd7c3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c2ef5e0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:21.271213 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c4e0ac2-8af6-4d31-921a-201fa0336e6e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:21.276510 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c4e0ac2-8af6-4d31-921a-201fa0336e6e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:21.281148 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c4e0ac2-8af6-4d31-921a-201fa0336e6e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:21.282490 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c4e0ac2-8af6-4d31-921a-201fa0336e6e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:21.345827 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0c6e8621-3b2b-4fcb-a125-461f71efd7c3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.184632 Jun 16 14:46:21.347213 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 867/1710] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:21 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:21.390031 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8ba96b7b-e7ea-45b0-a005-0a57efee7bb8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:21.391563 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8ba96b7b-e7ea-45b0-a005-0a57efee7bb8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:21.427884 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8ba96b7b-e7ea-45b0-a005-0a57efee7bb8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:21.443571 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8ba96b7b-e7ea-45b0-a005-0a57efee7bb8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:21.448950 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8ba96b7b-e7ea-45b0-a005-0a57efee7bb8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:21.452952 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8ba96b7b-e7ea-45b0-a005-0a57efee7bb8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:21.689049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6c4e0ac2-8af6-4d31-921a-201fa0336e6e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:21.741105 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6c4e0ac2-8af6-4d31-921a-201fa0336e6e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1276 microversion: 2.1 time: 0.628665 Jun 16 14:46:21.749850 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 844/1711] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:21 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1276 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:22.116231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8b649564-55c6-49c1-a9f7-53b6c3f0e6fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:22.117224 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8b649564-55c6-49c1-a9f7-53b6c3f0e6fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:22.136115 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8b649564-55c6-49c1-a9f7-53b6c3f0e6fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:22.136674 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8b649564-55c6-49c1-a9f7-53b6c3f0e6fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:22.146312 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8b649564-55c6-49c1-a9f7-53b6c3f0e6fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:22.146918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8b649564-55c6-49c1-a9f7-53b6c3f0e6fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:22.954420 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8b649564-55c6-49c1-a9f7-53b6c3f0e6fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:22.983694 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8b649564-55c6-49c1-a9f7-53b6c3f0e6fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1283 microversion: 2.1 time: 0.863768 Jun 16 14:46:22.985353 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 845/1712] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:22 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1283 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:23.019127 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2fcb59a0-1a1f-4e79-893e-1ff4fd324e28 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:23.030267 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2fcb59a0-1a1f-4e79-893e-1ff4fd324e28 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:23.075256 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2fcb59a0-1a1f-4e79-893e-1ff4fd324e28 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:23.079291 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2fcb59a0-1a1f-4e79-893e-1ff4fd324e28 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:23.084122 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2fcb59a0-1a1f-4e79-893e-1ff4fd324e28 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:23.086269 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2fcb59a0-1a1f-4e79-893e-1ff4fd324e28 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:23.646353 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:24.245801 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2fcb59a0-1a1f-4e79-893e-1ff4fd324e28 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:24.266491 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2fcb59a0-1a1f-4e79-893e-1ff4fd324e28 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:24.292808 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2fcb59a0-1a1f-4e79-893e-1ff4fd324e28 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:24.304977 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2fcb59a0-1a1f-4e79-893e-1ff4fd324e28 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1291 microversion: 2.25 time: 1.318762 Jun 16 14:46:24.313729 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 846/1713] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:46:22 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1291 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:46:24.321379 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b201e942-3bd3-46e3-b210-79d260902e66 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c79e160>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:24.527119 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b201e942-3bd3-46e3-b210-79d260902e66 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.209617 Jun 16 14:46:24.528050 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 847/1714] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:24 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:24.569742 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-161662b5-8296-43a1-b1f9-4076dc5f3335 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:24.570591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-161662b5-8296-43a1-b1f9-4076dc5f3335 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:24.603177 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-161662b5-8296-43a1-b1f9-4076dc5f3335 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:24.603695 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-161662b5-8296-43a1-b1f9-4076dc5f3335 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:24.617487 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-161662b5-8296-43a1-b1f9-4076dc5f3335 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:24.618206 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-161662b5-8296-43a1-b1f9-4076dc5f3335 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:24.849542 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8ba96b7b-e7ea-45b0-a005-0a57efee7bb8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:24.871546 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8ba96b7b-e7ea-45b0-a005-0a57efee7bb8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1477 microversion: 2.1 time: 3.515181 Jun 16 14:46:24.873203 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 868/1715] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:21 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1477 bytes in 3518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:24.888616 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a71b73dd-0993-4550-82a5-b89eba7538d6 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:24.889639 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a71b73dd-0993-4550-82a5-b89eba7538d6 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:24.916365 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a71b73dd-0993-4550-82a5-b89eba7538d6 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:24.918086 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a71b73dd-0993-4550-82a5-b89eba7538d6 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:24.922487 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a71b73dd-0993-4550-82a5-b89eba7538d6 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:24.927173 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a71b73dd-0993-4550-82a5-b89eba7538d6 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:25.136886 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a71b73dd-0993-4550-82a5-b89eba7538d6 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:25.157426 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a71b73dd-0993-4550-82a5-b89eba7538d6 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1283 microversion: 2.1 time: 0.282810 Jun 16 14:46:25.164794 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 869/1716] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:24 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1283 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:25.347583 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2f5d2b39-7bd0-4cd1-b92e-db697b873f9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:25.348586 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2f5d2b39-7bd0-4cd1-b92e-db697b873f9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:25.359061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-161662b5-8296-43a1-b1f9-4076dc5f3335 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:25.364745 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2f5d2b39-7bd0-4cd1-b92e-db697b873f9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:25.366715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2f5d2b39-7bd0-4cd1-b92e-db697b873f9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:25.379901 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2f5d2b39-7bd0-4cd1-b92e-db697b873f9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:25.380788 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2f5d2b39-7bd0-4cd1-b92e-db697b873f9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:25.401523 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-161662b5-8296-43a1-b1f9-4076dc5f3335 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1276 microversion: 2.1 time: 0.872199 Jun 16 14:46:25.402136 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 848/1717] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:24 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1276 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:25.548389 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-593f2b5d-6e01-4558-a0b1-f3de97701b82 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c2438b0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:25.751744 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-593f2b5d-6e01-4558-a0b1-f3de97701b82 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.208699 Jun 16 14:46:25.771406 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 849/1718] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:25 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:25.819231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-c1af1846-96ac-46df-ae77-b623f196eef7 req-6d5674e9-e23a-4f0f-86ea-d72f4a0b40f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c77529a-f41c-4253-b703-8ef094f934f2", "tag": "a569649a-653d-4712-9e65-932e9431dcd3"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:25.905852 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-c1af1846-96ac-46df-ae77-b623f196eef7 req-6d5674e9-e23a-4f0f-86ea-d72f4a0b40f5 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:25.910141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-c1af1846-96ac-46df-ae77-b623f196eef7 req-6d5674e9-e23a-4f0f-86ea-d72f4a0b40f5 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:25.940665 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:25.984798 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-c1af1846-96ac-46df-ae77-b623f196eef7 req-6d5674e9-e23a-4f0f-86ea-d72f4a0b40f5 service nova] Creating event network-changed:a569649a-653d-4712-9e65-932e9431dcd3 for instance 2c77529a-f41c-4253-b703-8ef094f934f2 on n-h2-836830-4 Jun 16 14:46:26.010468 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-c1af1846-96ac-46df-ae77-b623f196eef7 req-6d5674e9-e23a-4f0f-86ea-d72f4a0b40f5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236719 Jun 16 14:46:26.019901 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 850/1719] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:46:26.041486 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6d883b2b-5ab2-44e4-ace4-53a0a4605792 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:26.042722 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6d883b2b-5ab2-44e4-ace4-53a0a4605792 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:26.065578 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d883b2b-5ab2-44e4-ace4-53a0a4605792 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:26.070820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d883b2b-5ab2-44e4-ace4-53a0a4605792 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:26.077704 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d883b2b-5ab2-44e4-ace4-53a0a4605792 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:26.080897 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d883b2b-5ab2-44e4-ace4-53a0a4605792 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:26.213791 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=8 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:26.429065 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=34 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:26.851185 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2f5d2b39-7bd0-4cd1-b92e-db697b873f9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:26.874733 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2f5d2b39-7bd0-4cd1-b92e-db697b873f9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:26.884732 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2f5d2b39-7bd0-4cd1-b92e-db697b873f9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:26.896104 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2f5d2b39-7bd0-4cd1-b92e-db697b873f9d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1291 microversion: 2.25 time: 1.548437 Jun 16 14:46:26.899231 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 870/1720] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:46:25 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1291 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:46:26.964383 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-36c364a1-848e-4816-a8d2-22f013136c58 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:26.966876 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-36c364a1-848e-4816-a8d2-22f013136c58 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:27.006924 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-36c364a1-848e-4816-a8d2-22f013136c58 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:27.010946 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-36c364a1-848e-4816-a8d2-22f013136c58 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:27.017247 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-36c364a1-848e-4816-a8d2-22f013136c58 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:27.018199 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-36c364a1-848e-4816-a8d2-22f013136c58 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:27.710023 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-36c364a1-848e-4816-a8d2-22f013136c58 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:27.745983 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-36c364a1-848e-4816-a8d2-22f013136c58 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1283 microversion: 2.1 time: 0.842289 Jun 16 14:46:27.752557 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 871/1721] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:26 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1283 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:27.784970 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-803385f8-b290-4ff9-a45f-4257600e25bb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:27.790829 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-803385f8-b290-4ff9-a45f-4257600e25bb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:27.887099 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-803385f8-b290-4ff9-a45f-4257600e25bb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:27.893414 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-803385f8-b290-4ff9-a45f-4257600e25bb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:27.909737 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-803385f8-b290-4ff9-a45f-4257600e25bb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:27.911834 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-803385f8-b290-4ff9-a45f-4257600e25bb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:27.937275 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6d883b2b-5ab2-44e4-ace4-53a0a4605792 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:27.957065 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6d883b2b-5ab2-44e4-ace4-53a0a4605792 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1476 microversion: 2.1 time: 1.933019 Jun 16 14:46:27.958466 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 851/1722] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:26 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1476 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:27.972622 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1565de02-7da5-4769-8550-f6d1fb7a1521 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffcd7310>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:28.090500 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1565de02-7da5-4769-8550-f6d1fb7a1521 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.130291 Jun 16 14:46:28.096251 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 852/1723] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:27 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:28.111460 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6c20fa41-a8e4-4028-b930-0e1604a54398 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:28.117282 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6c20fa41-a8e4-4028-b930-0e1604a54398 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:28.136813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c20fa41-a8e4-4028-b930-0e1604a54398 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:28.144364 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c20fa41-a8e4-4028-b930-0e1604a54398 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:28.148017 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c20fa41-a8e4-4028-b930-0e1604a54398 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:28.151069 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c20fa41-a8e4-4028-b930-0e1604a54398 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:28.595029 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-803385f8-b290-4ff9-a45f-4257600e25bb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:28.630300 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-803385f8-b290-4ff9-a45f-4257600e25bb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1276 microversion: 2.1 time: 0.875701 Jun 16 14:46:28.646104 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 872/1724] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:27 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1276 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:28.670191 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1317499963", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "45d53cbf-0597-41fa-b44b-5de0b648134e"}], "security_groups": [{"name": "tempest-securitygroup--1615461577"}], "key_name": "tempest-keypair-1053520011", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "dede6951-9e0d-4144-8a54-f532080d8c44", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:28.820855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=20 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:29.530431 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6c20fa41-a8e4-4028-b930-0e1604a54398 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:29.580407 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6c20fa41-a8e4-4028-b930-0e1604a54398 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:29.613350 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6c20fa41-a8e4-4028-b930-0e1604a54398 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:29.617264 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6c20fa41-a8e4-4028-b930-0e1604a54398 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1291 microversion: 2.25 time: 1.519174 Jun 16 14:46:29.619335 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 853/1725] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:46:28 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1291 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:46:29.651167 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f326e2d2-368b-49d9-8e2a-090cbb717785 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:29.653765 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f326e2d2-368b-49d9-8e2a-090cbb717785 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:29.687826 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f326e2d2-368b-49d9-8e2a-090cbb717785 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:29.689131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f326e2d2-368b-49d9-8e2a-090cbb717785 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:29.692425 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f326e2d2-368b-49d9-8e2a-090cbb717785 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:29.708523 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f326e2d2-368b-49d9-8e2a-090cbb717785 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:29.741135 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] validate_networks() for [('45d53cbf-0597-41fa-b44b-5de0b648134e', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:46:30.942598 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f326e2d2-368b-49d9-8e2a-090cbb717785 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:30.969712 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f326e2d2-368b-49d9-8e2a-090cbb717785 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1325 microversion: 2.1 time: 1.348224 Jun 16 14:46:30.978995 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 854/1726] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:29 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1325 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:31.027977 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6c4a653d-1403-4ffb-8580-0211f9abf1d2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:31.042121 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6c4a653d-1403-4ffb-8580-0211f9abf1d2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:31.083455 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c4a653d-1403-4ffb-8580-0211f9abf1d2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:31.091701 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c4a653d-1403-4ffb-8580-0211f9abf1d2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:31.095906 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c4a653d-1403-4ffb-8580-0211f9abf1d2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:31.097344 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c4a653d-1403-4ffb-8580-0211f9abf1d2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:31.537208 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6c4a653d-1403-4ffb-8580-0211f9abf1d2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:31.553021 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6c4a653d-1403-4ffb-8580-0211f9abf1d2 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1476 microversion: 2.1 time: 0.571839 Jun 16 14:46:31.553329 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 855/1727] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:30 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1476 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:31.570200 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0f9bbbb7-d885-4735-99ef-82ed5153ee98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c4f7790>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:31.714121 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0f9bbbb7-d885-4735-99ef-82ed5153ee98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.148476 Jun 16 14:46:31.715026 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 856/1728] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:31 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:31.747851 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2291e813-262d-48a9-9d8f-1536ec529caf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:31.749216 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2291e813-262d-48a9-9d8f-1536ec529caf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:31.790130 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2291e813-262d-48a9-9d8f-1536ec529caf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:31.793102 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2291e813-262d-48a9-9d8f-1536ec529caf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:31.797142 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2291e813-262d-48a9-9d8f-1536ec529caf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:31.800283 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2291e813-262d-48a9-9d8f-1536ec529caf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:31.934232 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2291e813-262d-48a9-9d8f-1536ec529caf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:46:32.348071 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2291e813-262d-48a9-9d8f-1536ec529caf tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 204 len: 0 microversion: 2.1 time: 0.620851 Jun 16 14:46:32.358871 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 857/1729] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:46:31 2022] DELETE /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:46:32.386071 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c8b9bb3a-493e-42b3-abce-8ef68e29e498 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:32.393632 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c8b9bb3a-493e-42b3-abce-8ef68e29e498 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:32.435789 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8b9bb3a-493e-42b3-abce-8ef68e29e498 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:32.436645 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8b9bb3a-493e-42b3-abce-8ef68e29e498 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:32.441972 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8b9bb3a-493e-42b3-abce-8ef68e29e498 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:32.442843 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c8b9bb3a-493e-42b3-abce-8ef68e29e498 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:33.931972 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c8b9bb3a-493e-42b3-abce-8ef68e29e498 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:33.989424 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c8b9bb3a-493e-42b3-abce-8ef68e29e498 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1318 microversion: 2.1 time: 1.625868 Jun 16 14:46:33.990411 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 858/1730] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:32 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1318 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:34.069426 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-b857e3d2-ab05-4cc1-a5ec-19825d3cc720 req-8181d715-43be-47aa-b814-bcd087caa0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e774f1-5f0b-44fc-999d-0d4473971cef", "name": "network-vif-unplugged", "status": "completed", "tag": "be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:34.132222 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-b857e3d2-ab05-4cc1-a5ec-19825d3cc720 req-8181d715-43be-47aa-b814-bcd087caa0e7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:34.136978 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-b857e3d2-ab05-4cc1-a5ec-19825d3cc720 req-8181d715-43be-47aa-b814-bcd087caa0e7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:34.239244 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Getting quotas for project f7683609ebb347cf82d4b2d7ed3198eb. Resources: dict_keys(['metadata_items']) {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:46:34.240667 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-b857e3d2-ab05-4cc1-a5ec-19825d3cc720 req-8181d715-43be-47aa-b814-bcd087caa0e7 service nova] Creating event network-vif-unplugged:be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0 for instance d0e774f1-5f0b-44fc-999d-0d4473971cef on n-h2-836830-4 Jun 16 14:46:34.256104 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [req-b857e3d2-ab05-4cc1-a5ec-19825d3cc720 req-8181d715-43be-47aa-b814-bcd087caa0e7 service nova] Instance d0e774f1-5f0b-44fc-999d-0d4473971cef is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:46:34.260169 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Getting quotas for user 4fb6234a28c1437d97f356504163406b and project f7683609ebb347cf82d4b2d7ed3198eb. Resources: dict_keys(['metadata_items']) {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:46:34.282670 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-b857e3d2-ab05-4cc1-a5ec-19825d3cc720 req-8181d715-43be-47aa-b814-bcd087caa0e7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.271776 Jun 16 14:46:34.283736 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 859/1731] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:46:34.297036 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d6c55867-6426-405c-b388-fed568a2027a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:34.303731 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d6c55867-6426-405c-b388-fed568a2027a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:34.320779 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d6c55867-6426-405c-b388-fed568a2027a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:34.321654 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d6c55867-6426-405c-b388-fed568a2027a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:34.322807 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d6c55867-6426-405c-b388-fed568a2027a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:34.323898 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d6c55867-6426-405c-b388-fed568a2027a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:34.324306 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:46:34.325700 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:46:34.327161 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:46:34.328574 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:46:34.329233 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:46:34.350952 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:34.353340 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:34.354751 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:34.360512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:34.443039 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Getting quotas for project f7683609ebb347cf82d4b2d7ed3198eb. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:46:34.468264 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Getting quotas for user 4fb6234a28c1437d97f356504163406b and project f7683609ebb347cf82d4b2d7ed3198eb. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:46:34.635222 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:46:34.637633 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dede6951-9e0d-4144-8a54-f532080d8c44',volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:46:35.022203 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f2a4cc16-6168-4cb5-bf10-964081fd227d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 6.372341 Jun 16 14:46:35.046725 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 873/1732] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:46:28 2022] POST /compute/v2.1/servers => generated 407 bytes in 6400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:46:35.120609 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e8dc690e-a80d-4367-a306-cd3138966a1e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:35.131044 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e8dc690e-a80d-4367-a306-cd3138966a1e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:35.153657 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d6c55867-6426-405c-b388-fed568a2027a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:35.190716 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d6c55867-6426-405c-b388-fed568a2027a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:35.198802 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d6c55867-6426-405c-b388-fed568a2027a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:35.201560 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d6c55867-6426-405c-b388-fed568a2027a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1291 microversion: 2.25 time: 0.915975 Jun 16 14:46:35.213099 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e8dc690e-a80d-4367-a306-cd3138966a1e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:35.214126 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e8dc690e-a80d-4367-a306-cd3138966a1e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:35.219566 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 860/1733] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:46:34 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1291 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:46:35.233179 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e8dc690e-a80d-4367-a306-cd3138966a1e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:35.234161 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e8dc690e-a80d-4367-a306-cd3138966a1e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:35.267056 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-32c1926a-5725-4e5b-8702-a7f91798b386 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:35.268216 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-32c1926a-5725-4e5b-8702-a7f91798b386 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:35.314926 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-32c1926a-5725-4e5b-8702-a7f91798b386 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:35.315811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-32c1926a-5725-4e5b-8702-a7f91798b386 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:35.327351 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-32c1926a-5725-4e5b-8702-a7f91798b386 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:35.328128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-32c1926a-5725-4e5b-8702-a7f91798b386 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:36.891132 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-32c1926a-5725-4e5b-8702-a7f91798b386 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:36.909186 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-32c1926a-5725-4e5b-8702-a7f91798b386 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1548 microversion: 2.1 time: 1.688002 Jun 16 14:46:36.916102 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 861/1734] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:35 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1548 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:36.934322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7d79051f-1d5c-4f3d-8bf4-8229329839df tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:36.944556 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7d79051f-1d5c-4f3d-8bf4-8229329839df tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:36.970103 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7d79051f-1d5c-4f3d-8bf4-8229329839df tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:36.979107 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7d79051f-1d5c-4f3d-8bf4-8229329839df tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:36.980389 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7d79051f-1d5c-4f3d-8bf4-8229329839df tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:36.981618 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7d79051f-1d5c-4f3d-8bf4-8229329839df tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:37.568978 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7d79051f-1d5c-4f3d-8bf4-8229329839df tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:37.587527 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7d79051f-1d5c-4f3d-8bf4-8229329839df tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1476 microversion: 2.1 time: 0.664458 Jun 16 14:46:37.610738 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 862/1735] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:36 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1476 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:37.621015 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-19253519-2291-45f5-aaf9-41361da61998 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c5435e0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:37.848781 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-19253519-2291-45f5-aaf9-41361da61998 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.235444 Jun 16 14:46:37.855684 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 863/1736] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:37 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:37.887095 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e6a49cba-d8cd-4bdc-971c-4d24da40a622 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:37.891365 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e6a49cba-d8cd-4bdc-971c-4d24da40a622 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:37.908070 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6a49cba-d8cd-4bdc-971c-4d24da40a622 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:37.909711 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6a49cba-d8cd-4bdc-971c-4d24da40a622 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:37.911941 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6a49cba-d8cd-4bdc-971c-4d24da40a622 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:37.913249 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6a49cba-d8cd-4bdc-971c-4d24da40a622 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:38.366467 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e8dc690e-a80d-4367-a306-cd3138966a1e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:38.444574 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e8dc690e-a80d-4367-a306-cd3138966a1e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1325 microversion: 2.1 time: 3.394913 Jun 16 14:46:38.445553 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 874/1737] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:35 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1325 bytes in 3398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:38.488590 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fea1b01f-43cb-4332-8aa0-863903f9e82b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:38.496065 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fea1b01f-43cb-4332-8aa0-863903f9e82b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:38.540282 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fea1b01f-43cb-4332-8aa0-863903f9e82b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:38.552128 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fea1b01f-43cb-4332-8aa0-863903f9e82b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:38.554272 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fea1b01f-43cb-4332-8aa0-863903f9e82b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:38.555467 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fea1b01f-43cb-4332-8aa0-863903f9e82b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:38.751502 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e6a49cba-d8cd-4bdc-971c-4d24da40a622 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:38.820738 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e6a49cba-d8cd-4bdc-971c-4d24da40a622 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1318 microversion: 2.1 time: 0.952305 Jun 16 14:46:38.834276 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 864/1738] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:37 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1318 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:38.875233 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0688edc3-2dc7-4de9-974f-98c23a5e4301 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:38.886049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0688edc3-2dc7-4de9-974f-98c23a5e4301 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:38.953622 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0688edc3-2dc7-4de9-974f-98c23a5e4301 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:38.963242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0688edc3-2dc7-4de9-974f-98c23a5e4301 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:38.966026 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fea1b01f-43cb-4332-8aa0-863903f9e82b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:38.971385 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0688edc3-2dc7-4de9-974f-98c23a5e4301 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:38.974825 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0688edc3-2dc7-4de9-974f-98c23a5e4301 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:39.032253 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fea1b01f-43cb-4332-8aa0-863903f9e82b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1238 microversion: 2.1 time: 0.546935 Jun 16 14:46:39.033467 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 875/1739] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:38 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1238 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:39.081798 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ac49e847-810b-4ce0-8353-48c1404c562c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:39.126525 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ac49e847-810b-4ce0-8353-48c1404c562c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:39.149986 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ac49e847-810b-4ce0-8353-48c1404c562c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:39.160098 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ac49e847-810b-4ce0-8353-48c1404c562c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:39.162054 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ac49e847-810b-4ce0-8353-48c1404c562c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:39.163219 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ac49e847-810b-4ce0-8353-48c1404c562c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:39.813938 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ac49e847-810b-4ce0-8353-48c1404c562c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:39.841949 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ac49e847-810b-4ce0-8353-48c1404c562c tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 200 len: 1480 microversion: 2.1 time: 0.766672 Jun 16 14:46:39.847765 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 876/1740] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:39 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 1480 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:39.903919 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-5f6bbd0c-a217-4324-8599-6bf47ba14ad9 req-777459fc-798d-4b11-a18c-ea669dbae693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e774f1-5f0b-44fc-999d-0d4473971cef", "tag": "be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:39.976392 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-5f6bbd0c-a217-4324-8599-6bf47ba14ad9 req-777459fc-798d-4b11-a18c-ea669dbae693 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:39.982222 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-5f6bbd0c-a217-4324-8599-6bf47ba14ad9 req-777459fc-798d-4b11-a18c-ea669dbae693 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:40.160522 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-5f6bbd0c-a217-4324-8599-6bf47ba14ad9 req-777459fc-798d-4b11-a18c-ea669dbae693 service nova] Creating event network-changed:be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0 for instance d0e774f1-5f0b-44fc-999d-0d4473971cef on n-h2-836830-4 Jun 16 14:46:40.223740 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [req-5f6bbd0c-a217-4324-8599-6bf47ba14ad9 req-777459fc-798d-4b11-a18c-ea669dbae693 service nova] Instance d0e774f1-5f0b-44fc-999d-0d4473971cef is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:46:40.383940 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-5f6bbd0c-a217-4324-8599-6bf47ba14ad9 req-777459fc-798d-4b11-a18c-ea669dbae693 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.494744 Jun 16 14:46:40.385268 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 877/1741] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:46:40.430650 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a28ec007-ae66-479c-b5eb-b27a27ef5531 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:40.451160 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a28ec007-ae66-479c-b5eb-b27a27ef5531 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:40.472469 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=91 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:40.513648 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a28ec007-ae66-479c-b5eb-b27a27ef5531 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:40.515499 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a28ec007-ae66-479c-b5eb-b27a27ef5531 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:40.517825 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a28ec007-ae66-479c-b5eb-b27a27ef5531 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:40.519046 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a28ec007-ae66-479c-b5eb-b27a27ef5531 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:41.541569 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0688edc3-2dc7-4de9-974f-98c23a5e4301 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:41.580172 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0688edc3-2dc7-4de9-974f-98c23a5e4301 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:41.599612 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0688edc3-2dc7-4de9-974f-98c23a5e4301 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:41.603042 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0688edc3-2dc7-4de9-974f-98c23a5e4301 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1279 microversion: 2.25 time: 2.764885 Jun 16 14:46:41.606420 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 865/1742] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:46:38 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1279 bytes in 2771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:46:41.639061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f0002aa1-f528-44ed-8c62-d258be49656e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffd3a790>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:41.914165 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f0002aa1-f528-44ed-8c62-d258be49656e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.292526 Jun 16 14:46:41.931314 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 866/1743] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:41 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:41.940969 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-53cc3742-ea50-4e6a-b750-dab999531eda tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:41.942726 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-53cc3742-ea50-4e6a-b750-dab999531eda tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:41.955935 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-53cc3742-ea50-4e6a-b750-dab999531eda tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:41.956720 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-53cc3742-ea50-4e6a-b750-dab999531eda tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:41.957981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-53cc3742-ea50-4e6a-b750-dab999531eda tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:41.958686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-53cc3742-ea50-4e6a-b750-dab999531eda tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:43.411551 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-53cc3742-ea50-4e6a-b750-dab999531eda tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:43.443204 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-53cc3742-ea50-4e6a-b750-dab999531eda tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1325 microversion: 2.1 time: 1.510442 Jun 16 14:46:43.443830 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 867/1744] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:41 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1325 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:43.462793 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-115bade7-b4b9-49d2-9882-7d76218723db tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:43.470490 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-115bade7-b4b9-49d2-9882-7d76218723db tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:43.487749 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-115bade7-b4b9-49d2-9882-7d76218723db tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:43.488217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-115bade7-b4b9-49d2-9882-7d76218723db tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:43.489045 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-115bade7-b4b9-49d2-9882-7d76218723db tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:43.489493 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-115bade7-b4b9-49d2-9882-7d76218723db tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:44.013605 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a28ec007-ae66-479c-b5eb-b27a27ef5531 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:44.022521 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=87 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:44.039214 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a28ec007-ae66-479c-b5eb-b27a27ef5531 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1476 microversion: 2.1 time: 3.651695 Jun 16 14:46:44.054249 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-115bade7-b4b9-49d2-9882-7d76218723db tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:44.054927 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 878/1745] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:40 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1476 bytes in 3669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:44.061945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-04ca515b-53f9-47fa-b5cc-3d744b12990a tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:44.063455 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-04ca515b-53f9-47fa-b5cc-3d744b12990a tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:44.087371 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-115bade7-b4b9-49d2-9882-7d76218723db tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1318 microversion: 2.1 time: 0.641963 Jun 16 14:46:44.098443 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-04ca515b-53f9-47fa-b5cc-3d744b12990a tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:44.099328 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-04ca515b-53f9-47fa-b5cc-3d744b12990a tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:44.100421 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-04ca515b-53f9-47fa-b5cc-3d744b12990a tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:44.103351 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-04ca515b-53f9-47fa-b5cc-3d744b12990a tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:44.107059 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 868/1746] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:43 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1318 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:44.122400 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ce735ee4-1126-4e1e-b92c-b391e696c450 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:44.130620 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ce735ee4-1126-4e1e-b92c-b391e696c450 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: e8cb64d6-b915-425c-aed2-442d3e2a1676] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:44.159030 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ce735ee4-1126-4e1e-b92c-b391e696c450 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:44.162021 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ce735ee4-1126-4e1e-b92c-b391e696c450 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:44.164097 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ce735ee4-1126-4e1e-b92c-b391e696c450 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:44.166980 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ce735ee4-1126-4e1e-b92c-b391e696c450 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:44.226915 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-ce735ee4-1126-4e1e-b92c-b391e696c450 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] HTTP exception thrown: Instance e8cb64d6-b915-425c-aed2-442d3e2a1676 could not be found. Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ce735ee4-1126-4e1e-b92c-b391e696c450 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Request method failure captured: Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 HTTP/1.1 Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_0KNDTPm3aaPQWBjf2jaunYMLa52Mei7kADPpFAOuvd6sGwJKxBasvBAqBMk5lzG5tHbAapIkL8DLicntDUOZEGR_uQjLR8FAI30R2NQBazbaq9YxqhzRMe1F3HFkFs2bV_SA6n4_BWkDwPNQCvvX86b3d0nDS6wkMRH7VBGyJjVc Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: b0484f4c1c304b84a88b7d2be3b9483c Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-LiveMigrationTest-1876095101 Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:46:44.233499 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:46:44.237277 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b0484f4c1c304b84a88b7d2be3b9483c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0484f4c1c304b84a88b7d2be3b9483c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0484f4c1c304b84a88b7d2be3b9483c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b0484f4c1c304b84a88b7d2be3b9483c"}]}] Jun 16 14:46:44.237277 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-LiveMigrationTest-1876095101 Jun 16 14:46:44.237277 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: b0484f4c1c304b84a88b7d2be3b9483c Jun 16 14:46:44.237277 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-LiveMigrationTest-1876095101 Jun 16 14:46:44.237277 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-LiveMigrationTest-1876095101-project Jun 16 14:46:44.237277 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:46:44.237277 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:46:44.237277 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 96fb5660c35642ad9da6d8bb34e393f4 Jun 16 14:46:44.237277 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-LiveMigrationTest-1876095101-project Jun 16 14:46:44.237277 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:46:44.237277 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance e8cb64d6-b915-425c-aed2-442d3e2a1676 could not be found. Jun 16 14:46:44.237277 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'e8cb64d6-b915-425c-aed2-442d3e2a1676'} Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8cb64d6-b915-425c-aed2-442d3e2a1676 could not be found. Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:46:44.239079 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8cb64d6-b915-425c-aed2-442d3e2a1676 could not be found. Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8cb64d6-b915-425c-aed2-442d3e2a1676 could not be found. Jun 16 14:46:44.241898 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:46:44.247904 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ce735ee4-1126-4e1e-b92c-b391e696c450 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Returning 404 to user: Instance e8cb64d6-b915-425c-aed2-442d3e2a1676 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:46:44.250674 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ce735ee4-1126-4e1e-b92c-b391e696c450 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676" status: 404 len: 111 microversion: 2.1 time: 0.140764 Jun 16 14:46:44.252625 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 869/1747] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:44 2022] GET /compute/v2.1/servers/e8cb64d6-b915-425c-aed2-442d3e2a1676 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:46:44.263583 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-3bec691e-2ced-4315-a468-fa3815e85707 req-50e63f5f-896d-416e-8f05-d2adccde978e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cb64d6-b915-425c-aed2-442d3e2a1676", "name": "network-vif-deleted", "tag": "dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a"}, {"name": "network-changed", "server_uuid": "6def9a2e-2a3a-4509-bda8-13a61358d684", "tag": "313e4cd3-8cb5-43de-9dcc-a44d11059435"}, {"name": "network-changed", "server_uuid": "88cd3633-0f20-4fd2-94c5-c8803c13836a", "tag": "d41b3ebf-35ad-4121-a488-e3458270da18"}, {"name": "network-changed", "server_uuid": "e8129f55-69cc-43f8-b70a-c04f23d336c5", "tag": "9d6b56a9-437f-474b-8cba-dee373187456"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:44.293475 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3bec691e-2ced-4315-a468-fa3815e85707 req-50e63f5f-896d-416e-8f05-d2adccde978e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:44.295796 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3bec691e-2ced-4315-a468-fa3815e85707 req-50e63f5f-896d-416e-8f05-d2adccde978e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:44.347649 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-3bec691e-2ced-4315-a468-fa3815e85707 req-50e63f5f-896d-416e-8f05-d2adccde978e service nova] Creating event network-vif-deleted:dd62dde4-81b9-4017-ac1c-8b9bfa68cb6a for instance e8cb64d6-b915-425c-aed2-442d3e2a1676 on n-h2-836830-4 Jun 16 14:46:44.349009 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-3bec691e-2ced-4315-a468-fa3815e85707 req-50e63f5f-896d-416e-8f05-d2adccde978e service nova] Creating event network-changed:313e4cd3-8cb5-43de-9dcc-a44d11059435 for instance 6def9a2e-2a3a-4509-bda8-13a61358d684 on n-h2-836830-4 Jun 16 14:46:44.350208 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-3bec691e-2ced-4315-a468-fa3815e85707 req-50e63f5f-896d-416e-8f05-d2adccde978e service nova] Creating event network-changed:d41b3ebf-35ad-4121-a488-e3458270da18 for instance 88cd3633-0f20-4fd2-94c5-c8803c13836a on n-h1-836830-4 Jun 16 14:46:44.351469 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-3bec691e-2ced-4315-a468-fa3815e85707 req-50e63f5f-896d-416e-8f05-d2adccde978e service nova] Creating event network-changed:9d6b56a9-437f-474b-8cba-dee373187456 for instance e8129f55-69cc-43f8-b70a-c04f23d336c5 on n-h2-836830-4 Jun 16 14:46:44.398351 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:44.402007 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-3bec691e-2ced-4315-a468-fa3815e85707 req-50e63f5f-896d-416e-8f05-d2adccde978e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 684 microversion: 2.1 time: 0.144302 Jun 16 14:46:44.405446 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 870/1748] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:46:44.417753 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a29a3a97-28e5-4173-9db9-cfb9fb26239b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:44.423225 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a29a3a97-28e5-4173-9db9-cfb9fb26239b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:44.439080 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a29a3a97-28e5-4173-9db9-cfb9fb26239b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:44.440461 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a29a3a97-28e5-4173-9db9-cfb9fb26239b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:44.442272 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a29a3a97-28e5-4173-9db9-cfb9fb26239b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:44.444098 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a29a3a97-28e5-4173-9db9-cfb9fb26239b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:44.487801 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=10 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:44.497378 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:45.490028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a29a3a97-28e5-4173-9db9-cfb9fb26239b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:45.529105 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a29a3a97-28e5-4173-9db9-cfb9fb26239b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:45.541580 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a29a3a97-28e5-4173-9db9-cfb9fb26239b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:45.543907 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a29a3a97-28e5-4173-9db9-cfb9fb26239b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1279 microversion: 2.25 time: 1.135806 Jun 16 14:46:45.564336 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 871/1749] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:46:44 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1279 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:46:45.579118 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3112573e-b759-46fe-9a7d-235977853f44 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffeb0dc0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:45.776136 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3112573e-b759-46fe-9a7d-235977853f44 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.209500 Jun 16 14:46:45.788123 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 872/1750] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:45 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:45.827939 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9d678cf4-89e6-4fc4-ac4e-150568397625 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:45.844992 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9d678cf4-89e6-4fc4-ac4e-150568397625 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:45.882229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:45.891278 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d678cf4-89e6-4fc4-ac4e-150568397625 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:45.891619 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d678cf4-89e6-4fc4-ac4e-150568397625 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:45.904708 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d678cf4-89e6-4fc4-ac4e-150568397625 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:45.913511 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9d678cf4-89e6-4fc4-ac4e-150568397625 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:46.124761 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9d678cf4-89e6-4fc4-ac4e-150568397625 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:46:46.479215 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9d678cf4-89e6-4fc4-ac4e-150568397625 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "DELETE /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 204 len: 0 microversion: 2.1 time: 0.687436 Jun 16 14:46:46.488217 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 873/1751] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:46:45 2022] DELETE /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 0 bytes in 695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:46:46.513152 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5843c8d0-477e-4e92-bbf9-75a9d9bd0171 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:46.520961 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5843c8d0-477e-4e92-bbf9-75a9d9bd0171 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:46.548008 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5843c8d0-477e-4e92-bbf9-75a9d9bd0171 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:46.551478 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5843c8d0-477e-4e92-bbf9-75a9d9bd0171 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:46.580429 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5843c8d0-477e-4e92-bbf9-75a9d9bd0171 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:46.587659 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5843c8d0-477e-4e92-bbf9-75a9d9bd0171 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:46.710372 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-04ca515b-53f9-47fa-b5cc-3d744b12990a tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:46.729886 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-04ca515b-53f9-47fa-b5cc-3d744b12990a tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1306 microversion: 2.1 time: 2.666746 Jun 16 14:46:46.752705 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 879/1752] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:44 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1306 bytes in 2680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:46.759799 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-eb5c25c8-8dd5-41a6-afe1-798b75ed4597 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:46.760447 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-eb5c25c8-8dd5-41a6-afe1-798b75ed4597 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:46.800605 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb5c25c8-8dd5-41a6-afe1-798b75ed4597 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:46.803853 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb5c25c8-8dd5-41a6-afe1-798b75ed4597 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:46.805496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb5c25c8-8dd5-41a6-afe1-798b75ed4597 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:46.805965 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eb5c25c8-8dd5-41a6-afe1-798b75ed4597 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:47.514234 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5843c8d0-477e-4e92-bbf9-75a9d9bd0171 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:47.523136 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5843c8d0-477e-4e92-bbf9-75a9d9bd0171 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1325 microversion: 2.1 time: 1.032180 Jun 16 14:46:47.523760 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 874/1753] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:46 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1325 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:47.546353 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e09c6b11-9a07-4273-93a1-3520b5443232 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:47.555480 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e09c6b11-9a07-4273-93a1-3520b5443232 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:47.577168 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e09c6b11-9a07-4273-93a1-3520b5443232 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:47.577716 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e09c6b11-9a07-4273-93a1-3520b5443232 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:47.583176 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e09c6b11-9a07-4273-93a1-3520b5443232 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:47.583686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e09c6b11-9a07-4273-93a1-3520b5443232 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:47.811270 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-eb5c25c8-8dd5-41a6-afe1-798b75ed4597 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:47.823722 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-eb5c25c8-8dd5-41a6-afe1-798b75ed4597 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1476 microversion: 2.1 time: 1.087164 Jun 16 14:46:47.827677 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 880/1754] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:46 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1476 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:47.840984 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5f7854fe-f05a-4e28-8632-b2b32a22d651 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:47.842229 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5f7854fe-f05a-4e28-8632-b2b32a22d651 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:47.881381 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5f7854fe-f05a-4e28-8632-b2b32a22d651 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:47.882314 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5f7854fe-f05a-4e28-8632-b2b32a22d651 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:47.892278 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5f7854fe-f05a-4e28-8632-b2b32a22d651 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:47.893029 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5f7854fe-f05a-4e28-8632-b2b32a22d651 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:48.748350 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e09c6b11-9a07-4273-93a1-3520b5443232 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:48.796706 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e09c6b11-9a07-4273-93a1-3520b5443232 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1318 microversion: 2.1 time: 1.271417 Jun 16 14:46:48.819773 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 875/1755] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:47 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1318 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:48.847907 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-893c0e33-402f-4071-9bbe-3c43e792e521 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:48.852871 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-893c0e33-402f-4071-9bbe-3c43e792e521 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:48.870357 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-893c0e33-402f-4071-9bbe-3c43e792e521 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:48.871353 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-893c0e33-402f-4071-9bbe-3c43e792e521 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:48.873243 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-893c0e33-402f-4071-9bbe-3c43e792e521 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:48.874128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-893c0e33-402f-4071-9bbe-3c43e792e521 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:49.201023 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5f7854fe-f05a-4e28-8632-b2b32a22d651 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:49.224372 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5f7854fe-f05a-4e28-8632-b2b32a22d651 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1443 microversion: 2.1 time: 1.395338 Jun 16 14:46:49.225003 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 881/1756] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:47 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1443 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:49.229828 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-dc5dea44-03b2-4589-9b40-b80df8943fc3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf111034c0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:49.359687 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-dc5dea44-03b2-4589-9b40-b80df8943fc3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.133184 Jun 16 14:46:49.369364 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 882/1757] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:49 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:49.412355 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-42030585-0371-42da-8de3-c100bc622561 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:49.417668 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-42030585-0371-42da-8de3-c100bc622561 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:49.419722 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-893c0e33-402f-4071-9bbe-3c43e792e521 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:49.441122 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-893c0e33-402f-4071-9bbe-3c43e792e521 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:49.455202 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-893c0e33-402f-4071-9bbe-3c43e792e521 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:49.456644 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-893c0e33-402f-4071-9bbe-3c43e792e521 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1279 microversion: 2.25 time: 0.613355 Jun 16 14:46:49.467624 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 876/1758] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:46:48 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1279 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:46:49.484145 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-522b092f-f24d-4987-b1c7-21d1f4e58195 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:49.485400 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-522b092f-f24d-4987-b1c7-21d1f4e58195 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:49.502633 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-42030585-0371-42da-8de3-c100bc622561 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:49.509192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-42030585-0371-42da-8de3-c100bc622561 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:49.512229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-522b092f-f24d-4987-b1c7-21d1f4e58195 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:49.514496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-42030585-0371-42da-8de3-c100bc622561 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:49.515829 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-42030585-0371-42da-8de3-c100bc622561 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:49.516747 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-522b092f-f24d-4987-b1c7-21d1f4e58195 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:49.518134 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-522b092f-f24d-4987-b1c7-21d1f4e58195 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:49.526177 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-522b092f-f24d-4987-b1c7-21d1f4e58195 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:50.052610 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-522b092f-f24d-4987-b1c7-21d1f4e58195 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:50.065265 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-522b092f-f24d-4987-b1c7-21d1f4e58195 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1325 microversion: 2.1 time: 0.596319 Jun 16 14:46:50.069393 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 877/1759] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:49 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1325 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:50.083920 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-4208d45f-73fc-48e6-8bb3-57a352acd045 req-f103cd86-a4e4-4d85-9adf-bc29a6bccd94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041bdae6-9e2f-4508-bd7b-51bcc2666b7f", "name": "network-vif-deleted", "tag": "96b3e2f5-fedd-4636-8ce3-e8b768044f69"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:50.095096 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-4208d45f-73fc-48e6-8bb3-57a352acd045 req-f103cd86-a4e4-4d85-9adf-bc29a6bccd94 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:50.095963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-4208d45f-73fc-48e6-8bb3-57a352acd045 req-f103cd86-a4e4-4d85-9adf-bc29a6bccd94 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:50.111736 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-4208d45f-73fc-48e6-8bb3-57a352acd045 req-f103cd86-a4e4-4d85-9adf-bc29a6bccd94 service nova] Creating event network-vif-deleted:96b3e2f5-fedd-4636-8ce3-e8b768044f69 for instance 041bdae6-9e2f-4508-bd7b-51bcc2666b7f on n-h1-836830-4 Jun 16 14:46:50.121147 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-4208d45f-73fc-48e6-8bb3-57a352acd045 req-f103cd86-a4e4-4d85-9adf-bc29a6bccd94 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040121 Jun 16 14:46:50.123306 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 878/1760] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:46:50.131599 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-54b92d3b-5a32-49f8-a897-647146cccca8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:50.134436 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-54b92d3b-5a32-49f8-a897-647146cccca8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:50.145703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54b92d3b-5a32-49f8-a897-647146cccca8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:50.146600 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54b92d3b-5a32-49f8-a897-647146cccca8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:50.148437 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54b92d3b-5a32-49f8-a897-647146cccca8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:50.149164 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-54b92d3b-5a32-49f8-a897-647146cccca8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:50.446734 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-54b92d3b-5a32-49f8-a897-647146cccca8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:50.455207 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-54b92d3b-5a32-49f8-a897-647146cccca8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1471 microversion: 2.1 time: 0.329803 Jun 16 14:46:50.462083 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 879/1761] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:50 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1471 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:50.483913 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-765013e3-8412-4d37-aa00-cf4372be5872 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:50.488320 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-765013e3-8412-4d37-aa00-cf4372be5872 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:50.509286 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-765013e3-8412-4d37-aa00-cf4372be5872 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:50.515444 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-765013e3-8412-4d37-aa00-cf4372be5872 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:50.517826 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-765013e3-8412-4d37-aa00-cf4372be5872 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:50.519349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-765013e3-8412-4d37-aa00-cf4372be5872 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:51.225137 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-765013e3-8412-4d37-aa00-cf4372be5872 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:51.263004 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-765013e3-8412-4d37-aa00-cf4372be5872 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1318 microversion: 2.1 time: 0.787304 Jun 16 14:46:51.265859 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 880/1762] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:50 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1318 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:51.508800 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6392eeb8-fbd6-42af-956b-05bdd457fc52 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Action: 'create', calling method: .version_select at 0x7fdf0c5f1dc0>, body: {"keypair": {"name": "tempest-keypair-351441770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7jlgyBbM5qN6k2/V35WqrPxr2zwPmx05UrhLRO88D3z4tmC7PvmBp+FTnt0eSNeZHOohkoOMPNv/IDXQ3ieI1dpSf3Hlva8smGvhaTWFZ8lVVoptWXEohyClaJKACVdw=="}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:51.577735 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-42030585-0371-42da-8de3-c100bc622561 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:51.593334 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-42030585-0371-42da-8de3-c100bc622561 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1306 microversion: 2.1 time: 2.221785 Jun 16 14:46:51.606754 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 883/1763] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:49 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1306 bytes in 2236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:51.611302 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-6392eeb8-fbd6-42af-956b-05bdd457fc52 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Getting quotas for project fb4a315608594ee79027be384bc4613d. Resources: {'key_pairs'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:46:51.623356 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-92100faf-4c21-408b-b567-563ddbde6509 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:51.624392 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-92100faf-4c21-408b-b567-563ddbde6509 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:51.643101 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-6392eeb8-fbd6-42af-956b-05bdd457fc52 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Getting quotas for user 2d712575a0c24127b182c920a6222ccd and project fb4a315608594ee79027be384bc4613d. Resources: {'key_pairs'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:46:51.662798 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-92100faf-4c21-408b-b567-563ddbde6509 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:51.663333 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-92100faf-4c21-408b-b567-563ddbde6509 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:51.664192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-92100faf-4c21-408b-b567-563ddbde6509 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:51.664913 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-92100faf-4c21-408b-b567-563ddbde6509 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:51.796499 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6392eeb8-fbd6-42af-956b-05bdd457fc52 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.528219 Jun 16 14:46:51.809114 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 881/1764] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:46:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:46:51.832049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b7c0a8b9-e2c8-4ab4-a330-5ad1e8189241 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffeb0ca0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:51.848527 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-92100faf-4c21-408b-b567-563ddbde6509 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:51.850936 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-92100faf-4c21-408b-b567-563ddbde6509 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:51.856983 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-92100faf-4c21-408b-b567-563ddbde6509 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lazy-loading 'fault' on Instance uuid 041bdae6-9e2f-4508-bd7b-51bcc2666b7f {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:46:52.034683 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b7c0a8b9-e2c8-4ab4-a330-5ad1e8189241 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1414 microversion: 2.1 time: 0.209794 Jun 16 14:46:52.055734 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 882/1765] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:51 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1414 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:52.073809 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d5e2b46e-8e60-42d7-8d92-6c688a477c9f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:52.079653 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d5e2b46e-8e60-42d7-8d92-6c688a477c9f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:52.099092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d5e2b46e-8e60-42d7-8d92-6c688a477c9f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:52.100448 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d5e2b46e-8e60-42d7-8d92-6c688a477c9f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:52.102366 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d5e2b46e-8e60-42d7-8d92-6c688a477c9f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:52.103572 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d5e2b46e-8e60-42d7-8d92-6c688a477c9f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:52.259623 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-92100faf-4c21-408b-b567-563ddbde6509 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:52.295658 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-92100faf-4c21-408b-b567-563ddbde6509 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 200 len: 1300 microversion: 2.1 time: 0.686849 Jun 16 14:46:52.297184 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 884/1766] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:51 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 1300 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:52.311351 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8bf345be-59a4-4931-9b3d-030ec458dbd2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:52.312972 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8bf345be-59a4-4931-9b3d-030ec458dbd2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:52.338784 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8bf345be-59a4-4931-9b3d-030ec458dbd2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:52.344855 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8bf345be-59a4-4931-9b3d-030ec458dbd2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:52.348527 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8bf345be-59a4-4931-9b3d-030ec458dbd2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:52.352022 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8bf345be-59a4-4931-9b3d-030ec458dbd2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:52.484352 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d5e2b46e-8e60-42d7-8d92-6c688a477c9f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "POST /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef/action" status: 202 len: 0 microversion: 2.1 time: 0.426276 Jun 16 14:46:52.485317 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 883/1767] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:46:52 2022] POST /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:46:52.496191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ffe15113-0bd8-4dd5-9211-98482e874ad0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:52.504464 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ffe15113-0bd8-4dd5-9211-98482e874ad0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:52.520076 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffe15113-0bd8-4dd5-9211-98482e874ad0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:52.520765 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffe15113-0bd8-4dd5-9211-98482e874ad0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:52.521633 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffe15113-0bd8-4dd5-9211-98482e874ad0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:52.522149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffe15113-0bd8-4dd5-9211-98482e874ad0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:52.860131 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8bf345be-59a4-4931-9b3d-030ec458dbd2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:52.867972 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ffe15113-0bd8-4dd5-9211-98482e874ad0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:52.884583 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ffe15113-0bd8-4dd5-9211-98482e874ad0 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1325 microversion: 2.1 time: 0.392987 Jun 16 14:46:52.895376 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 884/1768] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:52 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1325 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:52.896682 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8bf345be-59a4-4931-9b3d-030ec458dbd2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:52.896860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-80a80461-ea26-4e78-9b0d-f5604e94830c tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:52.898069 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-80a80461-ea26-4e78-9b0d-f5604e94830c tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:52.905650 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8bf345be-59a4-4931-9b3d-030ec458dbd2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:52.907502 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8bf345be-59a4-4931-9b3d-030ec458dbd2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1279 microversion: 2.25 time: 0.608595 Jun 16 14:46:52.910093 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 885/1769] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:46:52 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1279 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:46:52.921718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-80a80461-ea26-4e78-9b0d-f5604e94830c tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:52.921718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-80a80461-ea26-4e78-9b0d-f5604e94830c tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:52.921718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-80a80461-ea26-4e78-9b0d-f5604e94830c tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:52.921718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-80a80461-ea26-4e78-9b0d-f5604e94830c tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:52.934978 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-85e113b5-e52f-4697-9dcd-dbba9e141e25 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:52.936180 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-85e113b5-e52f-4697-9dcd-dbba9e141e25 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:52.946197 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85e113b5-e52f-4697-9dcd-dbba9e141e25 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:52.946712 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85e113b5-e52f-4697-9dcd-dbba9e141e25 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:52.947692 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85e113b5-e52f-4697-9dcd-dbba9e141e25 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:52.948147 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85e113b5-e52f-4697-9dcd-dbba9e141e25 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:53.294212 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-80a80461-ea26-4e78-9b0d-f5604e94830c tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:53.328233 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-80a80461-ea26-4e78-9b0d-f5604e94830c tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1318 microversion: 2.1 time: 0.438891 Jun 16 14:46:53.331241 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 885/1770] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:52 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:53.383207 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ca52b6ec-4da9-4d0f-8c21-7847c766f986 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:53.385014 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ca52b6ec-4da9-4d0f-8c21-7847c766f986 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:53.400540 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca52b6ec-4da9-4d0f-8c21-7847c766f986 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:53.401936 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca52b6ec-4da9-4d0f-8c21-7847c766f986 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:53.407556 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca52b6ec-4da9-4d0f-8c21-7847c766f986 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:53.412797 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca52b6ec-4da9-4d0f-8c21-7847c766f986 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:53.786428 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ca52b6ec-4da9-4d0f-8c21-7847c766f986 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:53.819433 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ca52b6ec-4da9-4d0f-8c21-7847c766f986 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1306 microversion: 2.1 time: 0.467456 Jun 16 14:46:53.820609 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 886/1771] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:53 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1306 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:53.832187 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-828561fb-dce7-466b-b3d1-9d41f2de9294 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c38e160>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:54.031705 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-828561fb-dce7-466b-b3d1-9d41f2de9294 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1423 microversion: 2.1 time: 0.209125 Jun 16 14:46:54.034805 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 887/1772] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:53 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1423 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:54.062781 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8669c4c9-6aac-44be-837b-fa95e6f9bb0f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:54.067856 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8669c4c9-6aac-44be-837b-fa95e6f9bb0f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: 041bdae6-9e2f-4508-bd7b-51bcc2666b7f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:54.099728 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8669c4c9-6aac-44be-837b-fa95e6f9bb0f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:54.101068 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8669c4c9-6aac-44be-837b-fa95e6f9bb0f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:54.104663 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8669c4c9-6aac-44be-837b-fa95e6f9bb0f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:54.106854 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8669c4c9-6aac-44be-837b-fa95e6f9bb0f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:54.151289 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-8669c4c9-6aac-44be-837b-fa95e6f9bb0f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] HTTP exception thrown: Instance 041bdae6-9e2f-4508-bd7b-51bcc2666b7f could not be found. Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8669c4c9-6aac-44be-837b-fa95e6f9bb0f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Request method failure captured: Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f HTTP/1.1 Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_0KNDTPm3aaPQWBjf2jaunYMLa52Mei7kADPpFAOuvd6sGwJKxBasvBAqBMk5lzG5tHbAapIkL8DLicntDUOZEGR_uQjLR8FAI30R2NQBazbaq9YxqhzRMe1F3HFkFs2bV_SA6n4_BWkDwPNQCvvX86b3d0nDS6wkMRH7VBGyJjVc Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: b0484f4c1c304b84a88b7d2be3b9483c Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-LiveMigrationTest-1876095101 Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:46:54.156879 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:46:54.160406 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b0484f4c1c304b84a88b7d2be3b9483c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0484f4c1c304b84a88b7d2be3b9483c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0484f4c1c304b84a88b7d2be3b9483c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b0484f4c1c304b84a88b7d2be3b9483c"}]}] Jun 16 14:46:54.160406 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-LiveMigrationTest-1876095101 Jun 16 14:46:54.160406 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: b0484f4c1c304b84a88b7d2be3b9483c Jun 16 14:46:54.160406 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-LiveMigrationTest-1876095101 Jun 16 14:46:54.160406 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-LiveMigrationTest-1876095101-project Jun 16 14:46:54.160406 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:46:54.160406 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:46:54.160406 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 96fb5660c35642ad9da6d8bb34e393f4 Jun 16 14:46:54.160406 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-LiveMigrationTest-1876095101-project Jun 16 14:46:54.160406 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:46:54.160406 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 041bdae6-9e2f-4508-bd7b-51bcc2666b7f could not be found. Jun 16 14:46:54.160406 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '041bdae6-9e2f-4508-bd7b-51bcc2666b7f'} Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 041bdae6-9e2f-4508-bd7b-51bcc2666b7f could not be found. Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:46:54.162252 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 041bdae6-9e2f-4508-bd7b-51bcc2666b7f could not be found. Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 041bdae6-9e2f-4508-bd7b-51bcc2666b7f could not be found. Jun 16 14:46:54.165472 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:46:54.170948 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8669c4c9-6aac-44be-837b-fa95e6f9bb0f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Returning 404 to user: Instance 041bdae6-9e2f-4508-bd7b-51bcc2666b7f could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:46:54.172122 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8669c4c9-6aac-44be-837b-fa95e6f9bb0f tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f" status: 404 len: 111 microversion: 2.1 time: 0.132331 Jun 16 14:46:54.176633 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 888/1773] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:54 2022] GET /compute/v2.1/servers/041bdae6-9e2f-4508-bd7b-51bcc2666b7f => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:46:54.183709 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-5410fb68-61c0-4061-ac25-8289a0b5850e req-294a6cb8-b43d-4cda-81d5-5866008aa966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10edf992-de67-491e-a852-b01b4d61f050", "tag": "41ff13ee-3afd-4b91-b9aa-45a9e6952aa6"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:54.195119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-5410fb68-61c0-4061-ac25-8289a0b5850e req-294a6cb8-b43d-4cda-81d5-5866008aa966 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:54.196099 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-5410fb68-61c0-4061-ac25-8289a0b5850e req-294a6cb8-b43d-4cda-81d5-5866008aa966 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:54.214337 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-5410fb68-61c0-4061-ac25-8289a0b5850e req-294a6cb8-b43d-4cda-81d5-5866008aa966 service nova] Creating event network-changed:41ff13ee-3afd-4b91-b9aa-45a9e6952aa6 for instance 10edf992-de67-491e-a852-b01b4d61f050 on n-h1-836830-4 Jun 16 14:46:54.222257 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-5410fb68-61c0-4061-ac25-8289a0b5850e req-294a6cb8-b43d-4cda-81d5-5866008aa966 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042933 Jun 16 14:46:54.223332 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 889/1774] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:46:54.232046 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-360f0221-dcbc-4c01-830e-f6cb500bda5e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:54.233241 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-360f0221-dcbc-4c01-830e-f6cb500bda5e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:54.243440 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-360f0221-dcbc-4c01-830e-f6cb500bda5e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:54.244328 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-360f0221-dcbc-4c01-830e-f6cb500bda5e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:54.245579 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-360f0221-dcbc-4c01-830e-f6cb500bda5e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:54.246438 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-360f0221-dcbc-4c01-830e-f6cb500bda5e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:54.273880 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:54.402338 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-85e113b5-e52f-4697-9dcd-dbba9e141e25 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:54.420883 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-85e113b5-e52f-4697-9dcd-dbba9e141e25 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1470 microversion: 2.1 time: 1.508332 Jun 16 14:46:54.423225 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 886/1775] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:52 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1470 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:54.437307 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c4ccb372-da0d-4943-b784-b7423a0504ca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:54.439339 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c4ccb372-da0d-4943-b784-b7423a0504ca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:54.454060 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c4ccb372-da0d-4943-b784-b7423a0504ca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:54.455678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c4ccb372-da0d-4943-b784-b7423a0504ca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:54.458424 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c4ccb372-da0d-4943-b784-b7423a0504ca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:54.460885 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c4ccb372-da0d-4943-b784-b7423a0504ca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:54.688364 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-360f0221-dcbc-4c01-830e-f6cb500bda5e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:54.708493 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-360f0221-dcbc-4c01-830e-f6cb500bda5e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1325 microversion: 2.1 time: 0.482751 Jun 16 14:46:54.709989 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 890/1776] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:54 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1325 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:54.722175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-717fdff0-3414-45ab-9316-725d1f3bc812 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c38e3a0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:54.808115 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-717fdff0-3414-45ab-9316-725d1f3bc812 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 200 len: 1423 microversion: 2.1 time: 0.096049 Jun 16 14:46:54.817277 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 891/1777] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:46:54 2022] GET /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:54.822745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-91525070-8b79-493f-a380-73ffa33113f5 req-6373b637-1036-46cc-a544-ec92314c77c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c77529a-f41c-4253-b703-8ef094f934f2", "name": "network-vif-plugged", "status": "completed", "tag": "a569649a-653d-4712-9e65-932e9431dcd3"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:54.834969 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-91525070-8b79-493f-a380-73ffa33113f5 req-6373b637-1036-46cc-a544-ec92314c77c7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:54.835730 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-91525070-8b79-493f-a380-73ffa33113f5 req-6373b637-1036-46cc-a544-ec92314c77c7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:54.849703 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-91525070-8b79-493f-a380-73ffa33113f5 req-6373b637-1036-46cc-a544-ec92314c77c7 service nova] Creating event network-vif-plugged:a569649a-653d-4712-9e65-932e9431dcd3 for instance 2c77529a-f41c-4253-b703-8ef094f934f2 on n-h2-836830-4 Jun 16 14:46:54.861385 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-91525070-8b79-493f-a380-73ffa33113f5 req-6373b637-1036-46cc-a544-ec92314c77c7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041791 Jun 16 14:46:54.862942 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 892/1778] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:46:54.879191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cffaf656-c726-4630-ae94-a281c999647b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:54.880007 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cffaf656-c726-4630-ae94-a281c999647b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:54.898688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cffaf656-c726-4630-ae94-a281c999647b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:54.906423 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cffaf656-c726-4630-ae94-a281c999647b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:54.907654 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cffaf656-c726-4630-ae94-a281c999647b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:54.909865 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cffaf656-c726-4630-ae94-a281c999647b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:54.992735 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cffaf656-c726-4630-ae94-a281c999647b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:46:55.205536 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cffaf656-c726-4630-ae94-a281c999647b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 204 len: 0 microversion: 2.1 time: 0.339859 Jun 16 14:46:55.207080 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 893/1779] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:46:54 2022] DELETE /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:46:55.218167 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d3b9b795-7982-4021-b963-3960b88bbe61 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:55.220102 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d3b9b795-7982-4021-b963-3960b88bbe61 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:55.233699 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d3b9b795-7982-4021-b963-3960b88bbe61 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:55.234745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d3b9b795-7982-4021-b963-3960b88bbe61 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:55.238835 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d3b9b795-7982-4021-b963-3960b88bbe61 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:55.240315 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d3b9b795-7982-4021-b963-3960b88bbe61 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:55.784365 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d3b9b795-7982-4021-b963-3960b88bbe61 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:55.795966 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d3b9b795-7982-4021-b963-3960b88bbe61 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1318 microversion: 2.1 time: 0.586799 Jun 16 14:46:55.797226 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 894/1780] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:55 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:55.802480 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2a5e3692-1b07-4394-88b1-a4d99ce17f43 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c6b29d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:55.993034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c4ccb372-da0d-4943-b784-b7423a0504ca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:56.005385 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c4ccb372-da0d-4943-b784-b7423a0504ca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:56.007031 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c4ccb372-da0d-4943-b784-b7423a0504ca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:56.008224 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c4ccb372-da0d-4943-b784-b7423a0504ca tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1279 microversion: 2.25 time: 1.582412 Jun 16 14:46:56.008842 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 887/1781] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:46:54 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1279 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:46:56.033543 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f5646d9b-da80-46d2-afd2-1cb4982e36f1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:56.034176 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f5646d9b-da80-46d2-afd2-1cb4982e36f1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:56.054979 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f5646d9b-da80-46d2-afd2-1cb4982e36f1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:56.055767 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f5646d9b-da80-46d2-afd2-1cb4982e36f1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:56.057139 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f5646d9b-da80-46d2-afd2-1cb4982e36f1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:56.057990 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f5646d9b-da80-46d2-afd2-1cb4982e36f1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:57.118860 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2a5e3692-1b07-4394-88b1-a4d99ce17f43 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 204 len: 0 microversion: 2.1 time: 1.320236 Jun 16 14:46:57.120409 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 895/1782] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:55 2022] DELETE /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 0 bytes in 1322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:46:57.126763 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a9a3a6f7-bf69-46a6-ae97-c46583c43f2b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:57.127402 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a9a3a6f7-bf69-46a6-ae97-c46583c43f2b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:57.135497 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9a3a6f7-bf69-46a6-ae97-c46583c43f2b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:57.136026 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9a3a6f7-bf69-46a6-ae97-c46583c43f2b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:57.137305 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9a3a6f7-bf69-46a6-ae97-c46583c43f2b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:57.137800 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9a3a6f7-bf69-46a6-ae97-c46583c43f2b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:57.297462 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f5646d9b-da80-46d2-afd2-1cb4982e36f1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:57.321150 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f5646d9b-da80-46d2-afd2-1cb4982e36f1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1294 microversion: 2.1 time: 1.291068 Jun 16 14:46:57.339738 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 888/1783] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:56 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1294 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:57.356731 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bb8e4ea2-cde2-4d2c-881c-bb8b1994e09b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:57.358478 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bb8e4ea2-cde2-4d2c-881c-bb8b1994e09b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:57.365860 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb8e4ea2-cde2-4d2c-881c-bb8b1994e09b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:57.366504 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb8e4ea2-cde2-4d2c-881c-bb8b1994e09b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:57.367423 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb8e4ea2-cde2-4d2c-881c-bb8b1994e09b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:57.367971 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb8e4ea2-cde2-4d2c-881c-bb8b1994e09b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:57.403544 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a9a3a6f7-bf69-46a6-ae97-c46583c43f2b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:57.414275 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a9a3a6f7-bf69-46a6-ae97-c46583c43f2b tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1499 microversion: 2.1 time: 0.292711 Jun 16 14:46:57.416009 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 896/1784] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:57 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1499 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:57.422325 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-248909a1-fb70-4e1e-ae36-c7f9d2cad5a9 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:57.423666 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-248909a1-fb70-4e1e-ae36-c7f9d2cad5a9 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:57.440858 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-248909a1-fb70-4e1e-ae36-c7f9d2cad5a9 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:57.441583 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-248909a1-fb70-4e1e-ae36-c7f9d2cad5a9 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:57.442912 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-248909a1-fb70-4e1e-ae36-c7f9d2cad5a9 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:57.443694 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-248909a1-fb70-4e1e-ae36-c7f9d2cad5a9 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:57.833347 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-248909a1-fb70-4e1e-ae36-c7f9d2cad5a9 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:57.856439 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-248909a1-fb70-4e1e-ae36-c7f9d2cad5a9 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1325 microversion: 2.1 time: 0.437800 Jun 16 14:46:57.858003 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 897/1785] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:57 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1325 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:57.874416 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-968481315", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f09d749f-a83f-42ae-87a3-692a1a16530d"}], "security_groups": [{"name": "tempest-securitygroup--34902625"}], "key_name": "tempest-keypair-351441770", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:58.135412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] validate_networks() for [('f09d749f-a83f-42ae-87a3-692a1a16530d', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:46:58.247597 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bb8e4ea2-cde2-4d2c-881c-bb8b1994e09b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:58.263225 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bb8e4ea2-cde2-4d2c-881c-bb8b1994e09b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1470 microversion: 2.1 time: 0.915906 Jun 16 14:46:58.264278 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 889/1786] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:57 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1470 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:58.288203 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-541a865c-7312-4967-81db-362a7159e49e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:58.289259 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-541a865c-7312-4967-81db-362a7159e49e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:58.301083 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-541a865c-7312-4967-81db-362a7159e49e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:58.303135 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-541a865c-7312-4967-81db-362a7159e49e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:58.304362 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-541a865c-7312-4967-81db-362a7159e49e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:58.306888 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-541a865c-7312-4967-81db-362a7159e49e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:59.024463 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Getting quotas for project fb4a315608594ee79027be384bc4613d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:46:59.048854 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Getting quotas for user 2d712575a0c24127b182c920a6222ccd and project fb4a315608594ee79027be384bc4613d. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:46:59.093588 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:46:59.094466 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:46:59.095389 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:46:59.096273 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:46:59.098196 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:46:59.123541 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:59.124373 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:59.125989 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:59.126831 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:59.194500 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Getting quotas for project fb4a315608594ee79027be384bc4613d. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:46:59.214660 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Getting quotas for user 2d712575a0c24127b182c920a6222ccd and project fb4a315608594ee79027be384bc4613d. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:46:59.251554 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:46:59.256385 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:46:59.310148 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-541a865c-7312-4967-81db-362a7159e49e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:46:59.322244 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-541a865c-7312-4967-81db-362a7159e49e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1318 microversion: 2.1 time: 1.038856 Jun 16 14:46:59.328081 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 890/1787] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:58 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1318 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:46:59.346475 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e1cb06b2-20cb-4122-8aa3-13d3bf9015d5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:59.352930 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e1cb06b2-20cb-4122-8aa3-13d3bf9015d5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:59.376614 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e1cb06b2-20cb-4122-8aa3-13d3bf9015d5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:59.378580 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e1cb06b2-20cb-4122-8aa3-13d3bf9015d5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:59.381191 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e1cb06b2-20cb-4122-8aa3-13d3bf9015d5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:59.383662 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ce58f993-b95b-4453-bb1d-5f56a696eb12 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.522875 Jun 16 14:46:59.385912 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e1cb06b2-20cb-4122-8aa3-13d3bf9015d5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:59.391209 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 898/1788] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:46:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:46:59.396570 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7fe12273-03e6-4705-94af-dd47087ac199 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:59.397237 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7fe12273-03e6-4705-94af-dd47087ac199 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:59.405132 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7fe12273-03e6-4705-94af-dd47087ac199 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:59.405745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7fe12273-03e6-4705-94af-dd47087ac199 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:59.407083 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7fe12273-03e6-4705-94af-dd47087ac199 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:59.407806 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7fe12273-03e6-4705-94af-dd47087ac199 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:59.475690 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7fe12273-03e6-4705-94af-dd47087ac199 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:46:59.595867 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:59.625349 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7fe12273-03e6-4705-94af-dd47087ac199 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 204 len: 0 microversion: 2.1 time: 0.227442 Jun 16 14:46:59.629382 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 899/1789] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:46:59 2022] DELETE /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:46:59.649779 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-63719320-753a-4473-aecb-2baf6897fc96 req-1465c2d5-5c27-4ce8-8844-ce50fd9cc37d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e774f1-5f0b-44fc-999d-0d4473971cef", "name": "network-vif-plugged", "status": "completed", "tag": "be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:46:59.695654 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-63719320-753a-4473-aecb-2baf6897fc96 req-1465c2d5-5c27-4ce8-8844-ce50fd9cc37d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:59.696804 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-63719320-753a-4473-aecb-2baf6897fc96 req-1465c2d5-5c27-4ce8-8844-ce50fd9cc37d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:59.740302 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-63719320-753a-4473-aecb-2baf6897fc96 req-1465c2d5-5c27-4ce8-8844-ce50fd9cc37d service nova] Creating event network-vif-plugged:be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0 for instance d0e774f1-5f0b-44fc-999d-0d4473971cef on n-h2-836830-4 Jun 16 14:46:59.756092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [req-63719320-753a-4473-aecb-2baf6897fc96 req-1465c2d5-5c27-4ce8-8844-ce50fd9cc37d service nova] Instance d0e774f1-5f0b-44fc-999d-0d4473971cef is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125862) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:46:59.800130 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-63719320-753a-4473-aecb-2baf6897fc96 req-1465c2d5-5c27-4ce8-8844-ce50fd9cc37d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164833 Jun 16 14:46:59.803469 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 900/1790] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:46:59.818685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-87a3d0b1-e717-4f23-a11a-ca37306b95b2 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:46:59.820176 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-87a3d0b1-e717-4f23-a11a-ca37306b95b2 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:46:59.839594 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-87a3d0b1-e717-4f23-a11a-ca37306b95b2 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:59.843085 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-87a3d0b1-e717-4f23-a11a-ca37306b95b2 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:46:59.844360 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-87a3d0b1-e717-4f23-a11a-ca37306b95b2 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:46:59.848158 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-87a3d0b1-e717-4f23-a11a-ca37306b95b2 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:00.218181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-87a3d0b1-e717-4f23-a11a-ca37306b95b2 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:00.233369 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-87a3d0b1-e717-4f23-a11a-ca37306b95b2 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1294 microversion: 2.1 time: 0.425370 Jun 16 14:47:00.234043 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 901/1791] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:46:59 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1294 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:00.249705 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-38428937-6ff3-46f4-95af-70da0ca46db8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:00.250495 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-38428937-6ff3-46f4-95af-70da0ca46db8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:00.268014 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-38428937-6ff3-46f4-95af-70da0ca46db8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:00.268620 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-38428937-6ff3-46f4-95af-70da0ca46db8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:00.269321 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-38428937-6ff3-46f4-95af-70da0ca46db8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:00.269775 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-38428937-6ff3-46f4-95af-70da0ca46db8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:00.341558 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e1cb06b2-20cb-4122-8aa3-13d3bf9015d5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:00.358359 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e1cb06b2-20cb-4122-8aa3-13d3bf9015d5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:00.365524 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e1cb06b2-20cb-4122-8aa3-13d3bf9015d5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:00.368682 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e1cb06b2-20cb-4122-8aa3-13d3bf9015d5 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1474 microversion: 2.25 time: 1.037207 Jun 16 14:47:00.389121 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 891/1792] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:46:59 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1474 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:00.419942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f6dfb120-72d5-4609-801b-210ee1c53757 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:00.420978 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f6dfb120-72d5-4609-801b-210ee1c53757 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:00.435316 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f6dfb120-72d5-4609-801b-210ee1c53757 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:00.436130 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f6dfb120-72d5-4609-801b-210ee1c53757 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:00.437200 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f6dfb120-72d5-4609-801b-210ee1c53757 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:00.446426 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f6dfb120-72d5-4609-801b-210ee1c53757 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:00.446921 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-38428937-6ff3-46f4-95af-70da0ca46db8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:00.460521 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-38428937-6ff3-46f4-95af-70da0ca46db8 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1457 microversion: 2.1 time: 0.219495 Jun 16 14:47:00.462247 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 902/1793] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:00 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1457 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:00.472625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-50441fed-0984-4d5a-84f6-75f03878f658 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:00.473435 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-50441fed-0984-4d5a-84f6-75f03878f658 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:00.491919 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50441fed-0984-4d5a-84f6-75f03878f658 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:00.492963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50441fed-0984-4d5a-84f6-75f03878f658 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:00.502796 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50441fed-0984-4d5a-84f6-75f03878f658 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:00.503551 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50441fed-0984-4d5a-84f6-75f03878f658 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:00.754583 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f6dfb120-72d5-4609-801b-210ee1c53757 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:00.767767 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f6dfb120-72d5-4609-801b-210ee1c53757 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1325 microversion: 2.1 time: 0.377053 Jun 16 14:47:00.768936 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 892/1794] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:00 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1325 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:00.774173 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a523e353-a263-41a9-a4cd-d640b82e300a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:00.775602 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a523e353-a263-41a9-a4cd-d640b82e300a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:00.783054 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a523e353-a263-41a9-a4cd-d640b82e300a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:00.783510 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a523e353-a263-41a9-a4cd-d640b82e300a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:00.784565 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a523e353-a263-41a9-a4cd-d640b82e300a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:00.785222 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a523e353-a263-41a9-a4cd-d640b82e300a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:00.801396 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-50441fed-0984-4d5a-84f6-75f03878f658 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:00.817404 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-50441fed-0984-4d5a-84f6-75f03878f658 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1470 microversion: 2.1 time: 0.352464 Jun 16 14:47:00.818531 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 903/1795] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:00 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1470 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:00.828413 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1896394654", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "3140785d-f673-4aae-abcb-d2ef972abb5e"}]}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:00.892083 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a523e353-a263-41a9-a4cd-d640b82e300a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:00.899564 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] validate_networks() for [('3140785d-f673-4aae-abcb-d2ef972abb5e', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:47:00.902325 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a523e353-a263-41a9-a4cd-d640b82e300a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1272 microversion: 2.1 time: 0.132040 Jun 16 14:47:00.906679 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 893/1796] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:00 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1272 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:00.916462 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b79989a5-d5c4-4201-a079-dc4de9285e67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:00.917584 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b79989a5-d5c4-4201-a079-dc4de9285e67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:00.930049 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b79989a5-d5c4-4201-a079-dc4de9285e67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:00.930851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b79989a5-d5c4-4201-a079-dc4de9285e67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:00.932324 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b79989a5-d5c4-4201-a079-dc4de9285e67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:00.933126 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b79989a5-d5c4-4201-a079-dc4de9285e67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:01.187165 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b79989a5-d5c4-4201-a079-dc4de9285e67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:01.204560 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b79989a5-d5c4-4201-a079-dc4de9285e67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1318 microversion: 2.1 time: 0.295526 Jun 16 14:47:01.215863 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 894/1797] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:00 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:01.230644 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-7248e5db-cc63-4af1-a7a1-4eb419b02ac2 req-920c5209-dc32-4da0-a566-b00734b0dc81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3c31ac-af0e-4b6f-ab6a-36316a393d77", "name": "network-vif-deleted", "tag": "75ab1982-70e8-4bb1-a9d6-1f4b0b0997f2"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:01.255648 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-7248e5db-cc63-4af1-a7a1-4eb419b02ac2 req-920c5209-dc32-4da0-a566-b00734b0dc81 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:01.256904 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-7248e5db-cc63-4af1-a7a1-4eb419b02ac2 req-920c5209-dc32-4da0-a566-b00734b0dc81 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:01.285538 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-7248e5db-cc63-4af1-a7a1-4eb419b02ac2 req-920c5209-dc32-4da0-a566-b00734b0dc81 service nova] Creating event network-vif-deleted:75ab1982-70e8-4bb1-a9d6-1f4b0b0997f2 for instance ea3c31ac-af0e-4b6f-ab6a-36316a393d77 on n-h2-836830-4 Jun 16 14:47:01.297570 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-7248e5db-cc63-4af1-a7a1-4eb419b02ac2 req-920c5209-dc32-4da0-a566-b00734b0dc81 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089678 Jun 16 14:47:01.298924 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 895/1798] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:01.517859 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6267ece5-6cae-407b-b61e-09c181ff3c61 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:01.520502 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6267ece5-6cae-407b-b61e-09c181ff3c61 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:01.533853 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6267ece5-6cae-407b-b61e-09c181ff3c61 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:01.534755 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6267ece5-6cae-407b-b61e-09c181ff3c61 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:01.536207 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6267ece5-6cae-407b-b61e-09c181ff3c61 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:01.537013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6267ece5-6cae-407b-b61e-09c181ff3c61 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:01.752084 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:01.763653 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-6267ece5-6cae-407b-b61e-09c181ff3c61 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'services' on Instance uuid 2c77529a-f41c-4253-b703-8ef094f934f2 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:47:01.781838 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6267ece5-6cae-407b-b61e-09c181ff3c61 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1965 microversion: 2.25 time: 0.480775 Jun 16 14:47:01.782837 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 896/1799] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:01 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1965 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:01.788098 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3c6dc5e4-a3fe-416f-9350-d629c58b8e87 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:01.788734 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3c6dc5e4-a3fe-416f-9350-d629c58b8e87 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:01.797302 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3c6dc5e4-a3fe-416f-9350-d629c58b8e87 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:01.797765 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3c6dc5e4-a3fe-416f-9350-d629c58b8e87 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:01.798729 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3c6dc5e4-a3fe-416f-9350-d629c58b8e87 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:01.799186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3c6dc5e4-a3fe-416f-9350-d629c58b8e87 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:02.048278 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3c6dc5e4-a3fe-416f-9350-d629c58b8e87 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:02.062366 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3c6dc5e4-a3fe-416f-9350-d629c58b8e87 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1294 microversion: 2.1 time: 0.278312 Jun 16 14:47:02.077073 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 897/1800] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:01 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1294 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:02.077390 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0ba551f8-6c06-4d14-81f6-d6e89a8b0e5e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:02.077890 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0ba551f8-6c06-4d14-81f6-d6e89a8b0e5e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:02.095970 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0ba551f8-6c06-4d14-81f6-d6e89a8b0e5e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:02.096785 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0ba551f8-6c06-4d14-81f6-d6e89a8b0e5e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:02.098016 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0ba551f8-6c06-4d14-81f6-d6e89a8b0e5e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:02.098973 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0ba551f8-6c06-4d14-81f6-d6e89a8b0e5e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:02.166729 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0ba551f8-6c06-4d14-81f6-d6e89a8b0e5e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:02.167683 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0ba551f8-6c06-4d14-81f6-d6e89a8b0e5e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:02.170034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-0ba551f8-6c06-4d14-81f6-d6e89a8b0e5e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lazy-loading 'fault' on Instance uuid ea3c31ac-af0e-4b6f-ab6a-36316a393d77 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:47:02.286555 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0ba551f8-6c06-4d14-81f6-d6e89a8b0e5e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96fb5660c35642ad9da6d8bb34e393f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0484f4c1c304b84a88b7d2be3b9483c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:02.295875 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:47:02.297091 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:47:02.297590 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:47:02.298006 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:47:02.298640 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:47:02.315507 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:02.316927 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:02.318461 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:02.319433 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:02.322260 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0ba551f8-6c06-4d14-81f6-d6e89a8b0e5e tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 200 len: 1300 microversion: 2.1 time: 0.254433 Jun 16 14:47:02.342416 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 898/1801] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:02 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 1300 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:02.342416 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1a4e4ac8-2f57-447e-888a-3b2bc0302adc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:02.343897 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1a4e4ac8-2f57-447e-888a-3b2bc0302adc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:02.363831 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a4e4ac8-2f57-447e-888a-3b2bc0302adc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:02.365164 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a4e4ac8-2f57-447e-888a-3b2bc0302adc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:02.369126 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a4e4ac8-2f57-447e-888a-3b2bc0302adc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:02.370531 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a4e4ac8-2f57-447e-888a-3b2bc0302adc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:02.373989 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Getting quotas for project 1ac65ee04fbf47608c18c173900ad8f7. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:47:02.392629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Getting quotas for user f91d14d5fb884048a0b12279c62e963d and project 1ac65ee04fbf47608c18c173900ad8f7. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:47:02.427193 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:47:02.429830 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:47:02.510620 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d0d6ce20-595c-41ee-88d7-27f62d6266e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689842 Jun 16 14:47:02.521058 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 904/1802] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:47:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:47:02.523731 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ac0d3e9f-4b24-4a33-a7ad-7b4136ed98ec tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:02.524878 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ac0d3e9f-4b24-4a33-a7ad-7b4136ed98ec tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:02.538604 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac0d3e9f-4b24-4a33-a7ad-7b4136ed98ec tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:02.539484 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac0d3e9f-4b24-4a33-a7ad-7b4136ed98ec tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:02.541450 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac0d3e9f-4b24-4a33-a7ad-7b4136ed98ec tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:02.542436 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac0d3e9f-4b24-4a33-a7ad-7b4136ed98ec tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:02.946432 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-ac0d3e9f-4b24-4a33-a7ad-7b4136ed98ec tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'services' on Instance uuid 2c77529a-f41c-4253-b703-8ef094f934f2 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:47:02.999574 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ac0d3e9f-4b24-4a33-a7ad-7b4136ed98ec tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1965 microversion: 2.25 time: 0.482384 Jun 16 14:47:03.000838 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 905/1803] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:02 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1965 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:03.007617 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-c641fe11-1f37-499f-a008-b9b8787edaba req-39ac1b36-a475-4552-bbdf-d79c8b485082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88cd3633-0f20-4fd2-94c5-c8803c13836a", "name": "network-vif-plugged", "status": "completed", "tag": "d41b3ebf-35ad-4121-a488-e3458270da18"}, {"server_uuid": "6def9a2e-2a3a-4509-bda8-13a61358d684", "name": "network-vif-plugged", "status": "completed", "tag": "313e4cd3-8cb5-43de-9dcc-a44d11059435"}, {"server_uuid": "26234dd2-d806-4819-ac5a-651c8dd442ef", "name": "network-vif-unplugged", "status": "completed", "tag": "ec234d03-baa1-4218-9879-5938404785e9"}, {"server_uuid": "e8129f55-69cc-43f8-b70a-c04f23d336c5", "name": "network-vif-plugged", "status": "completed", "tag": "9d6b56a9-437f-474b-8cba-dee373187456"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:03.023581 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1a4e4ac8-2f57-447e-888a-3b2bc0302adc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:03.032168 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-c641fe11-1f37-499f-a008-b9b8787edaba req-39ac1b36-a475-4552-bbdf-d79c8b485082 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:03.032722 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-c641fe11-1f37-499f-a008-b9b8787edaba req-39ac1b36-a475-4552-bbdf-d79c8b485082 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:03.054071 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-c641fe11-1f37-499f-a008-b9b8787edaba req-39ac1b36-a475-4552-bbdf-d79c8b485082 service nova] Creating event network-vif-plugged:d41b3ebf-35ad-4121-a488-e3458270da18 for instance 88cd3633-0f20-4fd2-94c5-c8803c13836a on n-h1-836830-4 Jun 16 14:47:03.054823 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-c641fe11-1f37-499f-a008-b9b8787edaba req-39ac1b36-a475-4552-bbdf-d79c8b485082 service nova] Creating event network-vif-plugged:313e4cd3-8cb5-43de-9dcc-a44d11059435 for instance 6def9a2e-2a3a-4509-bda8-13a61358d684 on n-h2-836830-4 Jun 16 14:47:03.055354 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-c641fe11-1f37-499f-a008-b9b8787edaba req-39ac1b36-a475-4552-bbdf-d79c8b485082 service nova] Creating event network-vif-unplugged:ec234d03-baa1-4218-9879-5938404785e9 for instance 26234dd2-d806-4819-ac5a-651c8dd442ef on n-h1-836830-4 Jun 16 14:47:03.055872 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-c641fe11-1f37-499f-a008-b9b8787edaba req-39ac1b36-a475-4552-bbdf-d79c8b485082 service nova] Creating event network-vif-plugged:9d6b56a9-437f-474b-8cba-dee373187456 for instance e8129f55-69cc-43f8-b70a-c04f23d336c5 on n-h2-836830-4 Jun 16 14:47:03.069593 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1a4e4ac8-2f57-447e-888a-3b2bc0302adc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1325 microversion: 2.1 time: 0.738989 Jun 16 14:47:03.070759 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 899/1804] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:02 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1325 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:03.101114 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-467a508b-171b-41aa-9351-8d8fb6b43652 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:03.101854 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-c641fe11-1f37-499f-a008-b9b8787edaba req-39ac1b36-a475-4552-bbdf-d79c8b485082 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.098404 Jun 16 14:47:03.102290 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-467a508b-171b-41aa-9351-8d8fb6b43652 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:03.103425 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 906/1805] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:03.109989 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-199c4608-e347-42f8-967a-b55494eb31c2 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:03.119623 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-199c4608-e347-42f8-967a-b55494eb31c2 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:03.135469 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-467a508b-171b-41aa-9351-8d8fb6b43652 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:03.136330 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-467a508b-171b-41aa-9351-8d8fb6b43652 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:03.149894 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-467a508b-171b-41aa-9351-8d8fb6b43652 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:03.152113 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-199c4608-e347-42f8-967a-b55494eb31c2 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:03.154750 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-199c4608-e347-42f8-967a-b55494eb31c2 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:03.155658 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-199c4608-e347-42f8-967a-b55494eb31c2 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:03.156226 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-199c4608-e347-42f8-967a-b55494eb31c2 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:03.161667 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-467a508b-171b-41aa-9351-8d8fb6b43652 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:03.373354 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-199c4608-e347-42f8-967a-b55494eb31c2 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:03.394807 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-199c4608-e347-42f8-967a-b55494eb31c2 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1326 microversion: 2.1 time: 0.289837 Jun 16 14:47:03.411997 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 907/1806] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:03 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1326 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:03.419977 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-31ab19d0-45d9-4323-aa90-c6458227eb6b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:03.423508 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-31ab19d0-45d9-4323-aa90-c6458227eb6b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:03.432745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-31ab19d0-45d9-4323-aa90-c6458227eb6b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:03.433985 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-31ab19d0-45d9-4323-aa90-c6458227eb6b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:03.435441 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-31ab19d0-45d9-4323-aa90-c6458227eb6b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:03.436158 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-31ab19d0-45d9-4323-aa90-c6458227eb6b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:03.487547 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:03.785077 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-31ab19d0-45d9-4323-aa90-c6458227eb6b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:03.801282 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-31ab19d0-45d9-4323-aa90-c6458227eb6b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1318 microversion: 2.1 time: 0.385777 Jun 16 14:47:03.802411 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 908/1807] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:03 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:03.808457 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b0441b8d-1f3d-4ce7-9339-cad1d7e7d57f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:03.809794 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b0441b8d-1f3d-4ce7-9339-cad1d7e7d57f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:03.820951 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b0441b8d-1f3d-4ce7-9339-cad1d7e7d57f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:03.822305 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b0441b8d-1f3d-4ce7-9339-cad1d7e7d57f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:03.824030 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b0441b8d-1f3d-4ce7-9339-cad1d7e7d57f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:03.825342 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b0441b8d-1f3d-4ce7-9339-cad1d7e7d57f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:03.930774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b0441b8d-1f3d-4ce7-9339-cad1d7e7d57f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:03.941255 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b0441b8d-1f3d-4ce7-9339-cad1d7e7d57f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1" status: 200 len: 1204 microversion: 2.1 time: 0.137188 Jun 16 14:47:03.942150 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 909/1808] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:03 2022] GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 => generated 1204 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:03.957490 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cc4a01a3-4b1b-481f-9bf5-3f1293c805ef tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:03.959381 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:47:03.959381 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:47:03.960700 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cc4a01a3-4b1b-481f-9bf5-3f1293c805ef tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:03.961158 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cc4a01a3-4b1b-481f-9bf5-3f1293c805ef tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:03.961981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cc4a01a3-4b1b-481f-9bf5-3f1293c805ef tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:03.963251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cc4a01a3-4b1b-481f-9bf5-3f1293c805ef tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:03.992819 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cc4a01a3-4b1b-481f-9bf5-3f1293c805ef tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.039281 Jun 16 14:47:03.993493 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 910/1809] 10.222.0.57 () {60 vars in 1216 bytes} [Thu Jun 16 14:47:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:47:03.998414 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-178ac288-9625-476c-bd88-f5391fc901c4 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:03.999038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-178ac288-9625-476c-bd88-f5391fc901c4 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:04.016125 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-178ac288-9625-476c-bd88-f5391fc901c4 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:04.016797 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-178ac288-9625-476c-bd88-f5391fc901c4 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:04.019118 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-178ac288-9625-476c-bd88-f5391fc901c4 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:04.019588 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-178ac288-9625-476c-bd88-f5391fc901c4 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:04.178015 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-467a508b-171b-41aa-9351-8d8fb6b43652 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:04.192168 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-467a508b-171b-41aa-9351-8d8fb6b43652 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1470 microversion: 2.1 time: 1.119893 Jun 16 14:47:04.193478 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 900/1810] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:03 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1470 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:04.210770 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-178ac288-9625-476c-bd88-f5391fc901c4 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:04.223278 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-178ac288-9625-476c-bd88-f5391fc901c4 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1294 microversion: 2.1 time: 0.228442 Jun 16 14:47:04.223904 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 911/1811] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:03 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1294 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:04.228580 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fa3b54aa-4307-4ec1-9d93-5712785e2b91 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:04.229211 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fa3b54aa-4307-4ec1-9d93-5712785e2b91 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] [instance: ea3c31ac-af0e-4b6f-ab6a-36316a393d77] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:04.239821 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fa3b54aa-4307-4ec1-9d93-5712785e2b91 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:04.240646 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fa3b54aa-4307-4ec1-9d93-5712785e2b91 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:04.242099 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fa3b54aa-4307-4ec1-9d93-5712785e2b91 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:04.243131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fa3b54aa-4307-4ec1-9d93-5712785e2b91 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:04.264136 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-fa3b54aa-4307-4ec1-9d93-5712785e2b91 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] HTTP exception thrown: Instance ea3c31ac-af0e-4b6f-ab6a-36316a393d77 could not be found. Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fa3b54aa-4307-4ec1-9d93-5712785e2b91 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Request method failure captured: Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 HTTP/1.1 Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiqz_0KNDTPm3aaPQWBjf2jaunYMLa52Mei7kADPpFAOuvd6sGwJKxBasvBAqBMk5lzG5tHbAapIkL8DLicntDUOZEGR_uQjLR8FAI30R2NQBazbaq9YxqhzRMe1F3HFkFs2bV_SA6n4_BWkDwPNQCvvX86b3d0nDS6wkMRH7VBGyJjVc Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: b0484f4c1c304b84a88b7d2be3b9483c Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-LiveMigrationTest-1876095101 Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:47:04.265930 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:47:04.267831 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b0484f4c1c304b84a88b7d2be3b9483c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0484f4c1c304b84a88b7d2be3b9483c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b0484f4c1c304b84a88b7d2be3b9483c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b0484f4c1c304b84a88b7d2be3b9483c"}]}] Jun 16 14:47:04.267831 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-LiveMigrationTest-1876095101 Jun 16 14:47:04.267831 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: b0484f4c1c304b84a88b7d2be3b9483c Jun 16 14:47:04.267831 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-LiveMigrationTest-1876095101 Jun 16 14:47:04.267831 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-LiveMigrationTest-1876095101-project Jun 16 14:47:04.267831 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:47:04.267831 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:47:04.267831 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 96fb5660c35642ad9da6d8bb34e393f4 Jun 16 14:47:04.267831 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-LiveMigrationTest-1876095101-project Jun 16 14:47:04.267831 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:47:04.267831 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance ea3c31ac-af0e-4b6f-ab6a-36316a393d77 could not be found. Jun 16 14:47:04.267831 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'ea3c31ac-af0e-4b6f-ab6a-36316a393d77'} Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea3c31ac-af0e-4b6f-ab6a-36316a393d77 could not be found. Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:47:04.268896 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea3c31ac-af0e-4b6f-ab6a-36316a393d77 could not be found. Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea3c31ac-af0e-4b6f-ab6a-36316a393d77 could not be found. Jun 16 14:47:04.270624 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:04.272118 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fa3b54aa-4307-4ec1-9d93-5712785e2b91 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] Returning 404 to user: Instance ea3c31ac-af0e-4b6f-ab6a-36316a393d77 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:47:04.272118 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fa3b54aa-4307-4ec1-9d93-5712785e2b91 tempest-LiveMigrationTest-1876095101 tempest-LiveMigrationTest-1876095101-project] 10.222.0.57 "GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77" status: 404 len: 111 microversion: 2.1 time: 0.044438 Jun 16 14:47:04.272118 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 912/1812] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:04 2022] GET /compute/v2.1/servers/ea3c31ac-af0e-4b6f-ab6a-36316a393d77 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:47:04.277543 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4484d06a-73aa-43e1-9010-7228e23c1cd1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-4", "block_migration": "auto"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:04.279347 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4484d06a-73aa-43e1-9010-7228e23c1cd1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:04.298144 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4484d06a-73aa-43e1-9010-7228e23c1cd1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:04.298751 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4484d06a-73aa-43e1-9010-7228e23c1cd1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:04.300616 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-2ff29009-b974-43b0-aa40-1066bf06e007 req-8f1cf957-01b8-47a5-9fca-74e48717662f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26234dd2-d806-4819-ac5a-651c8dd442ef", "name": "network-vif-deleted", "tag": "ec234d03-baa1-4218-9879-5938404785e9"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:04.302797 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4484d06a-73aa-43e1-9010-7228e23c1cd1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:04.303411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4484d06a-73aa-43e1-9010-7228e23c1cd1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:04.311717 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-2ff29009-b974-43b0-aa40-1066bf06e007 req-8f1cf957-01b8-47a5-9fca-74e48717662f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:04.312565 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-2ff29009-b974-43b0-aa40-1066bf06e007 req-8f1cf957-01b8-47a5-9fca-74e48717662f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:04.327401 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-2ff29009-b974-43b0-aa40-1066bf06e007 req-8f1cf957-01b8-47a5-9fca-74e48717662f service nova] Creating event network-vif-deleted:ec234d03-baa1-4218-9879-5938404785e9 for instance 26234dd2-d806-4819-ac5a-651c8dd442ef on n-h1-836830-4 Jun 16 14:47:04.333183 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-2ff29009-b974-43b0-aa40-1066bf06e007 req-8f1cf957-01b8-47a5-9fca-74e48717662f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137429 Jun 16 14:47:04.334659 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 901/1813] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:04.342499 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d214c59e-6043-4792-903b-3e387bcd537c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:04.343598 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d214c59e-6043-4792-903b-3e387bcd537c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:04.350121 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-4484d06a-73aa-43e1-9010-7228e23c1cd1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'flavor' on Instance uuid 2c77529a-f41c-4253-b703-8ef094f934f2 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:47:04.352049 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d214c59e-6043-4792-903b-3e387bcd537c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:04.352776 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d214c59e-6043-4792-903b-3e387bcd537c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:04.353904 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d214c59e-6043-4792-903b-3e387bcd537c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:04.354703 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d214c59e-6043-4792-903b-3e387bcd537c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:04.370501 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4484d06a-73aa-43e1-9010-7228e23c1cd1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Going to try to live migrate instance to n-h1-836830-4 {{(pid=125862) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 16 14:47:04.839652 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d214c59e-6043-4792-903b-3e387bcd537c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:04.858696 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d214c59e-6043-4792-903b-3e387bcd537c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1325 microversion: 2.1 time: 0.521979 Jun 16 14:47:04.860135 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 902/1814] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:04 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1325 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:04.867355 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-349ce394-2a5b-4aac-b062-191aca723f17 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:04.868684 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-349ce394-2a5b-4aac-b062-191aca723f17 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:04.878407 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-349ce394-2a5b-4aac-b062-191aca723f17 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:04.879417 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-349ce394-2a5b-4aac-b062-191aca723f17 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:04.880596 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-349ce394-2a5b-4aac-b062-191aca723f17 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:04.882025 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-349ce394-2a5b-4aac-b062-191aca723f17 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:05.566586 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-349ce394-2a5b-4aac-b062-191aca723f17 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:05.596649 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-349ce394-2a5b-4aac-b062-191aca723f17 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1392 microversion: 2.1 time: 0.733246 Jun 16 14:47:05.605170 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 903/1815] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:04 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1392 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:05.655088 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-38e93fd3-d9cf-4202-bb9b-b63c256fc0a0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:05.658707 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-38e93fd3-d9cf-4202-bb9b-b63c256fc0a0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:05.678716 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38e93fd3-d9cf-4202-bb9b-b63c256fc0a0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:05.680324 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38e93fd3-d9cf-4202-bb9b-b63c256fc0a0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:05.682281 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38e93fd3-d9cf-4202-bb9b-b63c256fc0a0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:05.683453 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38e93fd3-d9cf-4202-bb9b-b63c256fc0a0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:06.206773 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-38e93fd3-d9cf-4202-bb9b-b63c256fc0a0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:06.217544 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-38e93fd3-d9cf-4202-bb9b-b63c256fc0a0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1318 microversion: 2.1 time: 0.608402 Jun 16 14:47:06.218508 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 904/1816] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:05 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1318 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:06.224249 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a7d0b530-989c-413e-b01c-3b7853457de6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:06.229753 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a7d0b530-989c-413e-b01c-3b7853457de6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:06.241661 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7d0b530-989c-413e-b01c-3b7853457de6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:06.242491 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7d0b530-989c-413e-b01c-3b7853457de6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:06.243483 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7d0b530-989c-413e-b01c-3b7853457de6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:06.244126 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a7d0b530-989c-413e-b01c-3b7853457de6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:06.498646 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a7d0b530-989c-413e-b01c-3b7853457de6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:06.509371 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a7d0b530-989c-413e-b01c-3b7853457de6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1" status: 200 len: 1266 microversion: 2.1 time: 0.289102 Jun 16 14:47:06.519320 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 905/1817] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:06 2022] GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:06.534512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d10c6547-6c52-439f-9340-58037a9c438f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:06.540757 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d10c6547-6c52-439f-9340-58037a9c438f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:06.556739 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d10c6547-6c52-439f-9340-58037a9c438f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:06.557463 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d10c6547-6c52-439f-9340-58037a9c438f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:06.561385 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d10c6547-6c52-439f-9340-58037a9c438f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:06.562118 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d10c6547-6c52-439f-9340-58037a9c438f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:07.694173 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d10c6547-6c52-439f-9340-58037a9c438f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:07.731781 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d10c6547-6c52-439f-9340-58037a9c438f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1470 microversion: 2.1 time: 1.195220 Jun 16 14:47:07.737663 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 906/1818] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:06 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1470 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:07.765167 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1bfe9b99-9518-402c-aee8-d3c9077dece7 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:07.766752 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1bfe9b99-9518-402c-aee8-d3c9077dece7 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:07.795465 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1bfe9b99-9518-402c-aee8-d3c9077dece7 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:07.796429 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1bfe9b99-9518-402c-aee8-d3c9077dece7 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:07.798350 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1bfe9b99-9518-402c-aee8-d3c9077dece7 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:07.804163 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1bfe9b99-9518-402c-aee8-d3c9077dece7 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:08.889046 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1bfe9b99-9518-402c-aee8-d3c9077dece7 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:08.948907 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1bfe9b99-9518-402c-aee8-d3c9077dece7 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1294 microversion: 2.1 time: 1.203820 Jun 16 14:47:08.969340 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 907/1819] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:07 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1294 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:08.986638 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0c7e6327-934e-458c-a6d1-ce7cdb9368fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:08.992211 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0c7e6327-934e-458c-a6d1-ce7cdb9368fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:09.009466 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0c7e6327-934e-458c-a6d1-ce7cdb9368fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:09.012576 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0c7e6327-934e-458c-a6d1-ce7cdb9368fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:09.017161 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0c7e6327-934e-458c-a6d1-ce7cdb9368fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:09.018105 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0c7e6327-934e-458c-a6d1-ce7cdb9368fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:10.236787 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0c7e6327-934e-458c-a6d1-ce7cdb9368fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:10.258204 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0c7e6327-934e-458c-a6d1-ce7cdb9368fa tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1521 microversion: 2.1 time: 1.283895 Jun 16 14:47:10.265979 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 908/1820] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:08 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1521 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:10.285976 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-fa612b62-a087-412c-a715-1c6c2ab9606f req-67133aae-790a-43f2-8fb5-e5324f581c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e774f1-5f0b-44fc-999d-0d4473971cef", "name": "network-vif-unplugged", "status": "completed", "tag": "be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:10.307414 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-fa612b62-a087-412c-a715-1c6c2ab9606f req-67133aae-790a-43f2-8fb5-e5324f581c8f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:10.308165 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-fa612b62-a087-412c-a715-1c6c2ab9606f req-67133aae-790a-43f2-8fb5-e5324f581c8f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:10.331851 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-fa612b62-a087-412c-a715-1c6c2ab9606f req-67133aae-790a-43f2-8fb5-e5324f581c8f service nova] Creating event network-vif-unplugged:be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0 for instance d0e774f1-5f0b-44fc-999d-0d4473971cef on n-h1-836830-4 Jun 16 14:47:10.338191 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [req-fa612b62-a087-412c-a715-1c6c2ab9606f req-67133aae-790a-43f2-8fb5-e5324f581c8f service nova] Instance d0e774f1-5f0b-44fc-999d-0d4473971cef is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:47:10.356563 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-fa612b62-a087-412c-a715-1c6c2ab9606f req-67133aae-790a-43f2-8fb5-e5324f581c8f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087650 Jun 16 14:47:10.357952 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 909/1821] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:10.363688 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-14704ab4-786c-4651-ace8-243aab7aafb4 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:10.364422 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-14704ab4-786c-4651-ace8-243aab7aafb4 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:10.373638 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14704ab4-786c-4651-ace8-243aab7aafb4 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:10.374880 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14704ab4-786c-4651-ace8-243aab7aafb4 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:10.376718 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14704ab4-786c-4651-ace8-243aab7aafb4 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:10.377236 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14704ab4-786c-4651-ace8-243aab7aafb4 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:11.163235 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4484d06a-73aa-43e1-9010-7228e23c1cd1 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2/action" status: 202 len: 0 microversion: 2.25 time: 6.889686 Jun 16 14:47:11.172924 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 913/1822] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jun 16 14:47:04 2022] POST /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2/action => generated 0 bytes in 6901 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:47:11.179698 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2820bbaa-11fc-4f48-9af2-4d6616689f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:11.180946 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2820bbaa-11fc-4f48-9af2-4d6616689f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:11.198991 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2820bbaa-11fc-4f48-9af2-4d6616689f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:11.200912 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2820bbaa-11fc-4f48-9af2-4d6616689f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:11.205484 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2820bbaa-11fc-4f48-9af2-4d6616689f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:11.206721 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2820bbaa-11fc-4f48-9af2-4d6616689f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:11.583981 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-14704ab4-786c-4651-ace8-243aab7aafb4 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:11.596904 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-14704ab4-786c-4651-ace8-243aab7aafb4 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1392 microversion: 2.1 time: 1.236801 Jun 16 14:47:11.598546 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 910/1823] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:10 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1392 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:11.612808 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a279e933-45e1-4dcb-bba5-83f7ba105092 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:11.615186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a279e933-45e1-4dcb-bba5-83f7ba105092 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:11.629247 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=68 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:11.658195 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a279e933-45e1-4dcb-bba5-83f7ba105092 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:11.659793 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a279e933-45e1-4dcb-bba5-83f7ba105092 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:11.665987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a279e933-45e1-4dcb-bba5-83f7ba105092 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:11.675388 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a279e933-45e1-4dcb-bba5-83f7ba105092 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:12.232688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2820bbaa-11fc-4f48-9af2-4d6616689f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:12.248673 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2820bbaa-11fc-4f48-9af2-4d6616689f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1467 microversion: 2.1 time: 1.073775 Jun 16 14:47:12.260495 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 914/1824] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:11 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1467 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:12.279822 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5ae80fe8-e1e8-4434-b2b2-e75d7a37f373 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:12.282076 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5ae80fe8-e1e8-4434-b2b2-e75d7a37f373 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:12.303819 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5ae80fe8-e1e8-4434-b2b2-e75d7a37f373 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:12.304835 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5ae80fe8-e1e8-4434-b2b2-e75d7a37f373 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:12.307953 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5ae80fe8-e1e8-4434-b2b2-e75d7a37f373 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:12.310001 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5ae80fe8-e1e8-4434-b2b2-e75d7a37f373 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:12.409694 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a279e933-45e1-4dcb-bba5-83f7ba105092 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:12.414006 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=20 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:12.425230 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a279e933-45e1-4dcb-bba5-83f7ba105092 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1" status: 200 len: 1308 microversion: 2.1 time: 0.824518 Jun 16 14:47:12.427049 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 911/1825] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:11 2022] GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 => generated 1308 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:12.434187 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c4e706d2-a440-4462-b3af-3f932413de12 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:12.437248 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c4e706d2-a440-4462-b3af-3f932413de12 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:12.455873 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c4e706d2-a440-4462-b3af-3f932413de12 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:12.458194 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c4e706d2-a440-4462-b3af-3f932413de12 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:12.461260 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c4e706d2-a440-4462-b3af-3f932413de12 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:12.463068 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c4e706d2-a440-4462-b3af-3f932413de12 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:12.636324 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5ae80fe8-e1e8-4434-b2b2-e75d7a37f373 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:12.646522 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5ae80fe8-e1e8-4434-b2b2-e75d7a37f373 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1470 microversion: 2.1 time: 0.395668 Jun 16 14:47:12.651532 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 915/1826] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:12 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1470 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:12.659475 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6abeb744-a18f-421b-aa0e-9275ebc8965a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:12.661028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6abeb744-a18f-421b-aa0e-9275ebc8965a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:12.671731 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6abeb744-a18f-421b-aa0e-9275ebc8965a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:12.672228 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6abeb744-a18f-421b-aa0e-9275ebc8965a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:12.675295 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6abeb744-a18f-421b-aa0e-9275ebc8965a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:12.676442 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6abeb744-a18f-421b-aa0e-9275ebc8965a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:12.888714 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c4e706d2-a440-4462-b3af-3f932413de12 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:12.921342 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c4e706d2-a440-4462-b3af-3f932413de12 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1294 microversion: 2.1 time: 0.478116 Jun 16 14:47:12.929843 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 912/1827] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:12 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1294 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:12.942920 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-3fa29924-79bb-4441-8dc1-3b25f0c8ef21 req-5f19ad25-0acc-424f-8cff-5ed6d6afb75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10edf992-de67-491e-a852-b01b4d61f050", "name": "network-vif-plugged", "status": "completed", "tag": "41ff13ee-3afd-4b91-b9aa-45a9e6952aa6"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:12.945748 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6abeb744-a18f-421b-aa0e-9275ebc8965a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:12.957641 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-3fa29924-79bb-4441-8dc1-3b25f0c8ef21 req-5f19ad25-0acc-424f-8cff-5ed6d6afb75e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:12.958179 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-3fa29924-79bb-4441-8dc1-3b25f0c8ef21 req-5f19ad25-0acc-424f-8cff-5ed6d6afb75e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:12.964407 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6abeb744-a18f-421b-aa0e-9275ebc8965a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1521 microversion: 2.1 time: 0.308722 Jun 16 14:47:12.967228 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 916/1828] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:12 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:12.975189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-337afb9c-1704-4258-9a25-f583880d629f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:12.977101 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-337afb9c-1704-4258-9a25-f583880d629f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:12.983682 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-3fa29924-79bb-4441-8dc1-3b25f0c8ef21 req-5f19ad25-0acc-424f-8cff-5ed6d6afb75e service nova] Creating event network-vif-plugged:41ff13ee-3afd-4b91-b9aa-45a9e6952aa6 for instance 10edf992-de67-491e-a852-b01b4d61f050 on n-h1-836830-4 Jun 16 14:47:12.989300 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-3fa29924-79bb-4441-8dc1-3b25f0c8ef21 req-5f19ad25-0acc-424f-8cff-5ed6d6afb75e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057743 Jun 16 14:47:12.989906 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 913/1829] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:12.994160 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-337afb9c-1704-4258-9a25-f583880d629f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:12.995568 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-337afb9c-1704-4258-9a25-f583880d629f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:12.998706 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-337afb9c-1704-4258-9a25-f583880d629f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:12.999034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cbe7898b-5bf7-4a32-a016-00e75d054eb0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:12.999473 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cbe7898b-5bf7-4a32-a016-00e75d054eb0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: e8129f55-69cc-43f8-b70a-c04f23d336c5] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:13.000572 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-337afb9c-1704-4258-9a25-f583880d629f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:13.006986 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cbe7898b-5bf7-4a32-a016-00e75d054eb0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:13.007445 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cbe7898b-5bf7-4a32-a016-00e75d054eb0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:13.008510 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cbe7898b-5bf7-4a32-a016-00e75d054eb0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:13.009138 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cbe7898b-5bf7-4a32-a016-00e75d054eb0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:13.028384 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:13.334481 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-337afb9c-1704-4258-9a25-f583880d629f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:13.343180 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-cbe7898b-5bf7-4a32-a016-00e75d054eb0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:13.356322 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cbe7898b-5bf7-4a32-a016-00e75d054eb0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/e8129f55-69cc-43f8-b70a-c04f23d336c5" status: 200 len: 1467 microversion: 2.1 time: 0.361321 Jun 16 14:47:13.370532 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 914/1830] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:12 2022] GET /compute/v2.1/servers/e8129f55-69cc-43f8-b70a-c04f23d336c5 => generated 1467 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:13.370532 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-4398cf9b-cb7c-4876-8008-263de18d31c8 req-f6e7b28b-975f-466e-bbf1-3daa1fc05075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e774f1-5f0b-44fc-999d-0d4473971cef", "tag": "be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0"}, {"name": "network-changed", "server_uuid": "d0480cd1-9dd6-492d-ae9f-aa52b4702e05", "tag": "65ad3aa6-d064-42ed-9694-845ef2625d96"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:13.384528 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-4398cf9b-cb7c-4876-8008-263de18d31c8 req-f6e7b28b-975f-466e-bbf1-3daa1fc05075 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:13.385226 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-4398cf9b-cb7c-4876-8008-263de18d31c8 req-f6e7b28b-975f-466e-bbf1-3daa1fc05075 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:13.397512 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-337afb9c-1704-4258-9a25-f583880d629f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:13.404805 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-337afb9c-1704-4258-9a25-f583880d629f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:13.409375 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-337afb9c-1704-4258-9a25-f583880d629f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.439652 Jun 16 14:47:13.411213 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 917/1831] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:12 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:13.427557 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-36694404-2b7c-4c51-aab9-4dd7625b7853 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:13.430114 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-36694404-2b7c-4c51-aab9-4dd7625b7853 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:13.434958 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-4398cf9b-cb7c-4876-8008-263de18d31c8 req-f6e7b28b-975f-466e-bbf1-3daa1fc05075 service nova] Creating event network-changed:be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0 for instance d0e774f1-5f0b-44fc-999d-0d4473971cef on n-h1-836830-4 Jun 16 14:47:13.435482 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-4398cf9b-cb7c-4876-8008-263de18d31c8 req-f6e7b28b-975f-466e-bbf1-3daa1fc05075 service nova] Creating event network-changed:65ad3aa6-d064-42ed-9694-845ef2625d96 for instance d0480cd1-9dd6-492d-ae9f-aa52b4702e05 on n-h1-836830-4 Jun 16 14:47:13.460648 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-36694404-2b7c-4c51-aab9-4dd7625b7853 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:13.470459 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [req-4398cf9b-cb7c-4876-8008-263de18d31c8 req-f6e7b28b-975f-466e-bbf1-3daa1fc05075 service nova] Instance d0e774f1-5f0b-44fc-999d-0d4473971cef is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-4', 'n-h1-836830-4'} {{(pid=125863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 16 14:47:13.470930 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-36694404-2b7c-4c51-aab9-4dd7625b7853 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:13.475084 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-36694404-2b7c-4c51-aab9-4dd7625b7853 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:13.475857 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-36694404-2b7c-4c51-aab9-4dd7625b7853 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:13.517147 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-4398cf9b-cb7c-4876-8008-263de18d31c8 req-f6e7b28b-975f-466e-bbf1-3daa1fc05075 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.158388 Jun 16 14:47:13.517785 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 915/1832] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:13.525218 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d82fa814-a2b0-4c8c-a0e2-bfb6418a3f5c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-939258524"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:13.526976 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d82fa814-a2b0-4c8c-a0e2-bfb6418a3f5c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:13.537648 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d82fa814-a2b0-4c8c-a0e2-bfb6418a3f5c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:13.538400 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d82fa814-a2b0-4c8c-a0e2-bfb6418a3f5c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:13.539657 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d82fa814-a2b0-4c8c-a0e2-bfb6418a3f5c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:13.540369 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d82fa814-a2b0-4c8c-a0e2-bfb6418a3f5c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:13.810662 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-36694404-2b7c-4c51-aab9-4dd7625b7853 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:13.823731 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-36694404-2b7c-4c51-aab9-4dd7625b7853 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1392 microversion: 2.1 time: 0.410789 Jun 16 14:47:13.828786 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 918/1833] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:13 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1392 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:13.844173 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b8d46ea9-3ab4-445e-9c87-3b89aab52a30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:13.869022 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b8d46ea9-3ab4-445e-9c87-3b89aab52a30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:13.872596 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b8d46ea9-3ab4-445e-9c87-3b89aab52a30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Searching by: {'reservation_id': 'r-g5fxve6b', 'deleted': False, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8'} {{(pid=125862) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:47:13.900245 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b8d46ea9-3ab4-445e-9c87-3b89aab52a30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:13.901050 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b8d46ea9-3ab4-445e-9c87-3b89aab52a30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:13.913809 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b8d46ea9-3ab4-445e-9c87-3b89aab52a30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:13.914748 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b8d46ea9-3ab4-445e-9c87-3b89aab52a30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:14.132950 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.multi_cell_list [None req-b8d46ea9-3ab4-445e-9c87-3b89aab52a30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:47:14.271380 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d82fa814-a2b0-4c8c-a0e2-bfb6418a3f5c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "POST /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684/action" status: 202 len: 0 microversion: 2.1 time: 0.751325 Jun 16 14:47:14.282702 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 916/1834] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:47:13 2022] POST /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684/action => generated 0 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 14:47:14.293163 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-51a7b4bb-e840-4f70-a2ba-7862c8357dc9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:14.294593 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-51a7b4bb-e840-4f70-a2ba-7862c8357dc9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:14.302520 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b8d46ea9-3ab4-445e-9c87-3b89aab52a30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:14.313353 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-51a7b4bb-e840-4f70-a2ba-7862c8357dc9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:14.314317 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-51a7b4bb-e840-4f70-a2ba-7862c8357dc9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:14.315942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-51a7b4bb-e840-4f70-a2ba-7862c8357dc9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:14.316907 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-51a7b4bb-e840-4f70-a2ba-7862c8357dc9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:14.339657 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b8d46ea9-3ab4-445e-9c87-3b89aab52a30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:14.340465 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b8d46ea9-3ab4-445e-9c87-3b89aab52a30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:14.666253 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b8d46ea9-3ab4-445e-9c87-3b89aab52a30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/detail?reservation_id=r-g5fxve6b" status: 200 len: 2927 microversion: 2.1 time: 0.834521 Jun 16 14:47:14.679607 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 919/1835] 10.222.0.57 () {58 vars in 1196 bytes} [Thu Jun 16 14:47:13 2022] GET /compute/v2.1/servers/detail?reservation_id=r-g5fxve6b => generated 2927 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:14.685999 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7f7f7558-3863-407d-af67-924df0dc8f7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:14.687033 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7f7f7558-3863-407d-af67-924df0dc8f7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:14.697157 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f7f7558-3863-407d-af67-924df0dc8f7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:14.698036 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f7f7558-3863-407d-af67-924df0dc8f7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:14.699714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f7f7558-3863-407d-af67-924df0dc8f7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:14.700421 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f7f7558-3863-407d-af67-924df0dc8f7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:14.830735 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-51a7b4bb-e840-4f70-a2ba-7862c8357dc9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:14.844461 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-51a7b4bb-e840-4f70-a2ba-7862c8357dc9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1" status: 200 len: 1308 microversion: 2.1 time: 0.559654 Jun 16 14:47:14.845566 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 917/1836] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:14 2022] GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 => generated 1308 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:14.851682 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cf3a1020-e76a-4fea-8d07-38ba2723f75b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:14.852905 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cf3a1020-e76a-4fea-8d07-38ba2723f75b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:14.860951 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cf3a1020-e76a-4fea-8d07-38ba2723f75b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:14.861628 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cf3a1020-e76a-4fea-8d07-38ba2723f75b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:14.862662 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cf3a1020-e76a-4fea-8d07-38ba2723f75b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:14.863118 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cf3a1020-e76a-4fea-8d07-38ba2723f75b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:15.040828 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-cf3a1020-e76a-4fea-8d07-38ba2723f75b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:15.052687 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7f7f7558-3863-407d-af67-924df0dc8f7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:15.075939 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cf3a1020-e76a-4fea-8d07-38ba2723f75b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1294 microversion: 2.1 time: 0.228328 Jun 16 14:47:15.077363 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 918/1837] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:14 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1294 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:15.080759 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7f7f7558-3863-407d-af67-924df0dc8f7b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1470 microversion: 2.1 time: 0.393245 Jun 16 14:47:15.083987 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 920/1838] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:14 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1470 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:15.093749 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3f668a7e-0015-48c0-92a4-315f3536c93c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '.version_select at 0x7fdf110a1280>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:15.099244 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-83200482-2582-407d-ad1d-70c617d6433d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:15.100328 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-83200482-2582-407d-ad1d-70c617d6433d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:15.111909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-83200482-2582-407d-ad1d-70c617d6433d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:15.113037 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-83200482-2582-407d-ad1d-70c617d6433d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:15.115229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-83200482-2582-407d-ad1d-70c617d6433d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:15.118056 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-83200482-2582-407d-ad1d-70c617d6433d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:15.353160 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3f668a7e-0015-48c0-92a4-315f3536c93c tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "DELETE /compute/v2.1/images/6ec746a2-6c9a-4036-bf0e-fb9c269f7e4f" status: 204 len: 0 microversion: 2.1 time: 0.273396 Jun 16 14:47:15.354858 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 919/1839] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:15 2022] DELETE /compute/v2.1/images/6ec746a2-6c9a-4036-bf0e-fb9c269f7e4f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:47:15.366626 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-551b0e87-50cc-4015-8cce-20fd62c5c2c3 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:15.410600 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.compute.server_groups [None req-551b0e87-50cc-4015-8cce-20fd62c5c2c3 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Querying cell 5f79e34c-a163-4b02-a0e0-fa1420b72299(cell1) for 2 instances {{(pid=125863) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 16 14:47:15.412992 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-551b0e87-50cc-4015-8cce-20fd62c5c2c3 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:15.415673 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-551b0e87-50cc-4015-8cce-20fd62c5c2c3 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:15.499070 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-551b0e87-50cc-4015-8cce-20fd62c5c2c3 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/os-server-groups/a74e683f-8a1f-405f-8fb8-95762d26da01" status: 200 len: 271 microversion: 2.1 time: 0.140841 Jun 16 14:47:15.500933 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 920/1840] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jun 16 14:47:15 2022] GET /compute/v2.1/os-server-groups/a74e683f-8a1f-405f-8fb8-95762d26da01 => generated 271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:15.510844 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6317627f-1285-4760-beb7-f5a13bdd2180 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:15.513233 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6317627f-1285-4760-beb7-f5a13bdd2180 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:15.527392 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6317627f-1285-4760-beb7-f5a13bdd2180 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:15.528749 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6317627f-1285-4760-beb7-f5a13bdd2180 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:15.530776 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6317627f-1285-4760-beb7-f5a13bdd2180 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:15.531905 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6317627f-1285-4760-beb7-f5a13bdd2180 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:15.955572 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-83200482-2582-407d-ad1d-70c617d6433d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:15.988786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-83200482-2582-407d-ad1d-70c617d6433d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:15.994503 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-83200482-2582-407d-ad1d-70c617d6433d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:16.009013 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-83200482-2582-407d-ad1d-70c617d6433d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.922755 Jun 16 14:47:16.046151 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 921/1841] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:15 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:16.056301 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c45be2b4-e427-4ae8-8549-aba0b7b276a4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '.version_select at 0x7fdeffcb7dc0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:16.150658 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-c45be2b4-e427-4ae8-8549-aba0b7b276a4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] HTTP exception thrown: Image not found. Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c45be2b4-e427-4ae8-8549-aba0b7b276a4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Request method failure captured: Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/images/6ec746a2-6c9a-4036-bf0e-fb9c269f7e4f HTTP/1.1 Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0HwzjjfEOzwOCijJMwAIM9bloQokdG738AdmO2AfwSY4wjVjyQLh9lWAzH4Rn8UCfDe9NW9edyGFTRe1GgDBY6cMZzBwN1dffuTKMcXrVyPL7r_AJ0308sfSN5YHtB5BJ4xC8C7QdPv6xOmwCbcFwnW04fPzhAdrkooBYSucmrM6SQ Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:47:16.159135 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:47:16.161919 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b46102b0fb544d118e324f7fcf654eb2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b46102b0fb544d118e324f7fcf654eb2"}]}] Jun 16 14:47:16.161919 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:47:16.161919 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:47:16.161919 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:47:16.161919 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:47:16.161919 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:47:16.161919 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:47:16.161919 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 8fc694c86102467bb97072ca4972b223 Jun 16 14:47:16.161919 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:47:16.161919 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:47:16.161919 n-d-836830-4 devstack@n-api.service[125862]: exception: Image not found. Jun 16 14:47:16.161919 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '6ec746a2-6c9a-4036-bf0e-fb9c269f7e4f'} Jun 16 14:47:16.161919 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:47:16.163573 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6ec746a2-6c9a-4036-bf0e-fb9c269f7e4f Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:47:16.166152 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6ec746a2-6c9a-4036-bf0e-fb9c269f7e4f could not be found. Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:47:16.177361 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:16.180496 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c45be2b4-e427-4ae8-8549-aba0b7b276a4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Returning 404 to user: Image not found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:47:16.183257 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c45be2b4-e427-4ae8-8549-aba0b7b276a4 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/images/6ec746a2-6c9a-4036-bf0e-fb9c269f7e4f" status: 404 len: 62 microversion: 2.1 time: 0.125799 Jun 16 14:47:16.185323 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 922/1842] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:16 2022] GET /compute/v2.1/images/6ec746a2-6c9a-4036-bf0e-fb9c269f7e4f => generated 62 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:47:16.195713 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-35c31109-3b9b-4a74-9800-1796b0e3f22c tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:16.201128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-35c31109-3b9b-4a74-9800-1796b0e3f22c tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:16.218016 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35c31109-3b9b-4a74-9800-1796b0e3f22c tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:16.219238 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35c31109-3b9b-4a74-9800-1796b0e3f22c tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:16.221099 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35c31109-3b9b-4a74-9800-1796b0e3f22c tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:16.222245 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35c31109-3b9b-4a74-9800-1796b0e3f22c tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:16.471829 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6317627f-1285-4760-beb7-f5a13bdd2180 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:16.491426 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6317627f-1285-4760-beb7-f5a13bdd2180 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1392 microversion: 2.1 time: 0.988269 Jun 16 14:47:16.506424 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 921/1843] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:15 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1392 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:16.514109 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-b5f50f5e-d6b9-4cbd-9da6-ce2d2954b602 req-0f1e7ddd-bc1d-430a-bfff-c9be3dcff0ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b76875a5-11a5-4d7f-9db3-7a731c2589a1", "tag": "b6ac5e50-81ef-41de-8ac9-bed451827a4f"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:16.529331 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-b5f50f5e-d6b9-4cbd-9da6-ce2d2954b602 req-0f1e7ddd-bc1d-430a-bfff-c9be3dcff0ab service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:16.530352 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-b5f50f5e-d6b9-4cbd-9da6-ce2d2954b602 req-0f1e7ddd-bc1d-430a-bfff-c9be3dcff0ab service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:16.563859 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-b5f50f5e-d6b9-4cbd-9da6-ce2d2954b602 req-0f1e7ddd-bc1d-430a-bfff-c9be3dcff0ab service nova] Creating event network-changed:b6ac5e50-81ef-41de-8ac9-bed451827a4f for instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 on n-h2-836830-4 Jun 16 14:47:16.576674 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-b5f50f5e-d6b9-4cbd-9da6-ce2d2954b602 req-0f1e7ddd-bc1d-430a-bfff-c9be3dcff0ab service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077415 Jun 16 14:47:16.579651 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 922/1844] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:16.590785 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-88546fbb-38c9-4d51-b329-e894ca59d9b9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:16.592263 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-88546fbb-38c9-4d51-b329-e894ca59d9b9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:16.604612 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-88546fbb-38c9-4d51-b329-e894ca59d9b9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:16.605885 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-88546fbb-38c9-4d51-b329-e894ca59d9b9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:16.607874 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-88546fbb-38c9-4d51-b329-e894ca59d9b9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:16.609191 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-88546fbb-38c9-4d51-b329-e894ca59d9b9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:17.103173 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-35c31109-3b9b-4a74-9800-1796b0e3f22c tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1618 microversion: 2.1 time: 0.915768 Jun 16 14:47:17.104781 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 923/1845] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:16 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1618 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:17.110632 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c3896ceb-adc8-4c77-93e5-84fee788d3bc tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:17.111662 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c3896ceb-adc8-4c77-93e5-84fee788d3bc tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:17.125917 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c3896ceb-adc8-4c77-93e5-84fee788d3bc tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:17.127444 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c3896ceb-adc8-4c77-93e5-84fee788d3bc tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:17.129066 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c3896ceb-adc8-4c77-93e5-84fee788d3bc tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:17.129677 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c3896ceb-adc8-4c77-93e5-84fee788d3bc tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:17.454162 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-88546fbb-38c9-4d51-b329-e894ca59d9b9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:17.479131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c3896ceb-adc8-4c77-93e5-84fee788d3bc tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:17.491522 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-88546fbb-38c9-4d51-b329-e894ca59d9b9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1" status: 200 len: 1308 microversion: 2.1 time: 0.908167 Jun 16 14:47:17.502705 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 923/1846] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:16 2022] GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 => generated 1308 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:17.513083 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7ea57c1b-c442-4ccb-bd0f-d5071df0a92e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:17.517752 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7ea57c1b-c442-4ccb-bd0f-d5071df0a92e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:17.520298 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:17.543910 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ea57c1b-c442-4ccb-bd0f-d5071df0a92e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:17.546359 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ea57c1b-c442-4ccb-bd0f-d5071df0a92e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:17.548070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ea57c1b-c442-4ccb-bd0f-d5071df0a92e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:17.549253 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ea57c1b-c442-4ccb-bd0f-d5071df0a92e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:17.551302 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c3896ceb-adc8-4c77-93e5-84fee788d3bc tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1294 microversion: 2.1 time: 0.444677 Jun 16 14:47:17.559415 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 924/1847] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:17 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1294 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:17.579942 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-08068051-e0c2-4225-b9e3-6146594db7a3 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:17.581687 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-08068051-e0c2-4225-b9e3-6146594db7a3 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:17.608797 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-08068051-e0c2-4225-b9e3-6146594db7a3 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:17.632198 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-08068051-e0c2-4225-b9e3-6146594db7a3 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:17.645411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-08068051-e0c2-4225-b9e3-6146594db7a3 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:17.647059 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-08068051-e0c2-4225-b9e3-6146594db7a3 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:17.988199 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-08068051-e0c2-4225-b9e3-6146594db7a3 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:17.997675 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-08068051-e0c2-4225-b9e3-6146594db7a3 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1539 microversion: 2.1 time: 0.436189 Jun 16 14:47:17.998733 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 925/1848] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:17 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1539 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:18.004404 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-09322f9d-6dd0-4648-b23a-c49b6cc83b9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:18.007231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-09322f9d-6dd0-4648-b23a-c49b6cc83b9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:18.015637 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-09322f9d-6dd0-4648-b23a-c49b6cc83b9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:18.022823 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-09322f9d-6dd0-4648-b23a-c49b6cc83b9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:18.024259 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-09322f9d-6dd0-4648-b23a-c49b6cc83b9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:18.025570 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-09322f9d-6dd0-4648-b23a-c49b6cc83b9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:18.129231 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7ea57c1b-c442-4ccb-bd0f-d5071df0a92e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:18.138820 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7ea57c1b-c442-4ccb-bd0f-d5071df0a92e tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1463 microversion: 2.1 time: 0.643088 Jun 16 14:47:18.140021 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 924/1849] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:17 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1463 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:18.158229 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-55e490c5-0dec-4feb-9a40-be3dc6274235 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:18.160225 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-55e490c5-0dec-4feb-9a40-be3dc6274235 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] [instance: e8129f55-69cc-43f8-b70a-c04f23d336c5] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:18.173916 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-55e490c5-0dec-4feb-9a40-be3dc6274235 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:18.177733 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-55e490c5-0dec-4feb-9a40-be3dc6274235 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:18.180302 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-55e490c5-0dec-4feb-9a40-be3dc6274235 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:18.181417 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-55e490c5-0dec-4feb-9a40-be3dc6274235 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:18.563940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-09322f9d-6dd0-4648-b23a-c49b6cc83b9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:18.574568 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-09322f9d-6dd0-4648-b23a-c49b6cc83b9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:18.576552 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-09322f9d-6dd0-4648-b23a-c49b6cc83b9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:18.578633 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-09322f9d-6dd0-4648-b23a-c49b6cc83b9e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.578316 Jun 16 14:47:18.581858 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-55e490c5-0dec-4feb-9a40-be3dc6274235 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/e8129f55-69cc-43f8-b70a-c04f23d336c5" status: 200 len: 1618 microversion: 2.1 time: 0.439454 Jun 16 14:47:18.584192 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 925/1850] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:18 2022] GET /compute/v2.1/servers/e8129f55-69cc-43f8-b70a-c04f23d336c5 => generated 1618 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:18.591573 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 926/1851] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:17 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:18.600415 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6f1e45a6-898b-481f-a6b7-96e9f9795cbe tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:18.602145 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6f1e45a6-898b-481f-a6b7-96e9f9795cbe tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:18.621607 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6f1e45a6-898b-481f-a6b7-96e9f9795cbe tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:18.623262 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6f1e45a6-898b-481f-a6b7-96e9f9795cbe tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:18.625012 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6f1e45a6-898b-481f-a6b7-96e9f9795cbe tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:18.625291 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-499709d9-e442-4027-92ff-3e843b5c67fe tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:18.627360 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6f1e45a6-898b-481f-a6b7-96e9f9795cbe tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:18.639986 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-499709d9-e442-4027-92ff-3e843b5c67fe tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:18.665988 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-499709d9-e442-4027-92ff-3e843b5c67fe tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:18.667938 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-499709d9-e442-4027-92ff-3e843b5c67fe tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:18.674314 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-499709d9-e442-4027-92ff-3e843b5c67fe tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:18.678159 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-499709d9-e442-4027-92ff-3e843b5c67fe tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:18.928925 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6f1e45a6-898b-481f-a6b7-96e9f9795cbe tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:18.960231 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6f1e45a6-898b-481f-a6b7-96e9f9795cbe tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1392 microversion: 2.1 time: 0.373587 Jun 16 14:47:18.962274 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 926/1852] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:18 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1392 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:18.977474 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bb388c7b-f892-4d43-b275-49580e6c3220 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:18.980545 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bb388c7b-f892-4d43-b275-49580e6c3220 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:18.988538 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb388c7b-f892-4d43-b275-49580e6c3220 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:18.989385 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb388c7b-f892-4d43-b275-49580e6c3220 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:18.990655 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb388c7b-f892-4d43-b275-49580e6c3220 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:18.991311 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb388c7b-f892-4d43-b275-49580e6c3220 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:19.109065 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-499709d9-e442-4027-92ff-3e843b5c67fe tempest-MigrationsAdminTest-1251561143 tempest-MigrationsAdminTest-1251561143-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1614 microversion: 2.1 time: 0.515835 Jun 16 14:47:19.126488 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 927/1853] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:18 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1614 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:19.162830 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2862b334-c262-4206-9e50-5bf6e93c15ac tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:19.166943 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2862b334-c262-4206-9e50-5bf6e93c15ac tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:19.184158 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2862b334-c262-4206-9e50-5bf6e93c15ac tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:19.185563 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2862b334-c262-4206-9e50-5bf6e93c15ac tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:19.187445 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2862b334-c262-4206-9e50-5bf6e93c15ac tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:19.188428 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2862b334-c262-4206-9e50-5bf6e93c15ac tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:19.300559 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bb388c7b-f892-4d43-b275-49580e6c3220 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:19.329287 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bb388c7b-f892-4d43-b275-49580e6c3220 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1" status: 200 len: 1308 microversion: 2.1 time: 0.364672 Jun 16 14:47:19.347068 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 927/1854] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:18 2022] GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 => generated 1308 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:19.359324 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-602371402", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:19.482037 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:47:19.594348 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2862b334-c262-4206-9e50-5bf6e93c15ac tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:19.614758 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2862b334-c262-4206-9e50-5bf6e93c15ac tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1294 microversion: 2.1 time: 0.490360 Jun 16 14:47:19.632432 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 928/1855] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:19 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1294 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:19.635211 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cf4b5e68-3509-459a-a862-d86bf0802476 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:19.636777 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cf4b5e68-3509-459a-a862-d86bf0802476 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:19.661962 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf4b5e68-3509-459a-a862-d86bf0802476 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:19.664314 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf4b5e68-3509-459a-a862-d86bf0802476 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:19.666769 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf4b5e68-3509-459a-a862-d86bf0802476 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:19.667540 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cf4b5e68-3509-459a-a862-d86bf0802476 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:19.998210 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cf4b5e68-3509-459a-a862-d86bf0802476 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:20.013233 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cf4b5e68-3509-459a-a862-d86bf0802476 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1521 microversion: 2.1 time: 0.386993 Jun 16 14:47:20.013916 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 929/1856] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:19 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:20.018504 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:47:20.019404 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-56920aee-fcff-4013-a623-1bd2bcfe61b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:20.019903 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-56920aee-fcff-4013-a623-1bd2bcfe61b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:20.021117 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:47:20.022336 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:47:20.023616 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:47:20.024731 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:47:20.028374 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56920aee-fcff-4013-a623-1bd2bcfe61b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:20.029002 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56920aee-fcff-4013-a623-1bd2bcfe61b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:20.030041 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56920aee-fcff-4013-a623-1bd2bcfe61b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:20.030538 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-56920aee-fcff-4013-a623-1bd2bcfe61b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:20.054463 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:20.054942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:20.058980 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:20.059512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:20.088297 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-56920aee-fcff-4013-a623-1bd2bcfe61b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:47:20.101557 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:47:20.116611 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:47:20.143742 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:47:20.148262 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:47:20.292347 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e4faade5-222e-4d15-89c3-7f9a90a06ce0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.941050 Jun 16 14:47:20.296696 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 928/1857] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:47:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:47:20.318977 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c0bc96d0-bc7e-40b2-be3a-ed42e8f6e1b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:20.319968 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c0bc96d0-bc7e-40b2-be3a-ed42e8f6e1b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:20.334024 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c0bc96d0-bc7e-40b2-be3a-ed42e8f6e1b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:20.334859 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c0bc96d0-bc7e-40b2-be3a-ed42e8f6e1b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:20.336436 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c0bc96d0-bc7e-40b2-be3a-ed42e8f6e1b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:20.337603 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c0bc96d0-bc7e-40b2-be3a-ed42e8f6e1b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:20.343690 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-56920aee-fcff-4013-a623-1bd2bcfe61b4 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 204 len: 0 microversion: 2.1 time: 0.322503 Jun 16 14:47:20.350533 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 930/1858] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:47:20 2022] DELETE /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:47:20.901665 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c0bc96d0-bc7e-40b2-be3a-ed42e8f6e1b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:20.926121 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c0bc96d0-bc7e-40b2-be3a-ed42e8f6e1b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:20.929965 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c0bc96d0-bc7e-40b2-be3a-ed42e8f6e1b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:20.932921 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c0bc96d0-bc7e-40b2-be3a-ed42e8f6e1b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.633449 Jun 16 14:47:20.935472 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 929/1859] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:20 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:20.940931 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-831bc888-20e6-464f-ad69-aa95659707aa tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:20.941860 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-831bc888-20e6-464f-ad69-aa95659707aa tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:20.948856 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-831bc888-20e6-464f-ad69-aa95659707aa tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:20.949901 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-831bc888-20e6-464f-ad69-aa95659707aa tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:20.950986 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-831bc888-20e6-464f-ad69-aa95659707aa tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:20.951611 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-831bc888-20e6-464f-ad69-aa95659707aa tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:20.967603 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-b88d7869-d4d7-417e-a443-c83bf1ce86c0 req-20c13ba5-b582-4ccb-a3ee-c2e6a47252fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e774f1-5f0b-44fc-999d-0d4473971cef", "name": "network-vif-plugged", "status": "completed", "tag": "be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:20.981438 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-b88d7869-d4d7-417e-a443-c83bf1ce86c0 req-20c13ba5-b582-4ccb-a3ee-c2e6a47252fc service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:20.981954 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-b88d7869-d4d7-417e-a443-c83bf1ce86c0 req-20c13ba5-b582-4ccb-a3ee-c2e6a47252fc service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:21.012633 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-b88d7869-d4d7-417e-a443-c83bf1ce86c0 req-20c13ba5-b582-4ccb-a3ee-c2e6a47252fc service nova] Creating event network-vif-plugged:be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0 for instance d0e774f1-5f0b-44fc-999d-0d4473971cef on n-h1-836830-4 Jun 16 14:47:21.035795 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-b88d7869-d4d7-417e-a443-c83bf1ce86c0 req-20c13ba5-b582-4ccb-a3ee-c2e6a47252fc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.677984 Jun 16 14:47:21.037604 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 931/1860] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:21.048329 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1cb74237-a242-4a2f-ba1b-6e015d2cd0c1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:21.049383 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1cb74237-a242-4a2f-ba1b-6e015d2cd0c1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:21.067470 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1cb74237-a242-4a2f-ba1b-6e015d2cd0c1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:21.068277 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1cb74237-a242-4a2f-ba1b-6e015d2cd0c1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:21.069435 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1cb74237-a242-4a2f-ba1b-6e015d2cd0c1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:21.069890 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1cb74237-a242-4a2f-ba1b-6e015d2cd0c1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:21.129653 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1cb74237-a242-4a2f-ba1b-6e015d2cd0c1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:47:21.206086 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-831bc888-20e6-464f-ad69-aa95659707aa tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:21.221454 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-831bc888-20e6-464f-ad69-aa95659707aa tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1392 microversion: 2.1 time: 0.284208 Jun 16 14:47:21.235270 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 930/1861] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:20 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1392 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:21.249487 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-25f8319b-9003-4b74-99e0-8029fdcc8609 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:21.250736 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-25f8319b-9003-4b74-99e0-8029fdcc8609 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:21.341655 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1cb74237-a242-4a2f-ba1b-6e015d2cd0c1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 204 len: 0 microversion: 2.1 time: 0.298673 Jun 16 14:47:21.344153 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 932/1862] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:47:21 2022] DELETE /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:47:21.349673 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-25f8319b-9003-4b74-99e0-8029fdcc8609 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:21.354689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2e644401-3078-4867-a0ab-9c34da388939 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:21.360845 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2e644401-3078-4867-a0ab-9c34da388939 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:21.367843 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-25f8319b-9003-4b74-99e0-8029fdcc8609 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1216 microversion: 2.1 time: 0.130777 Jun 16 14:47:21.368929 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 931/1863] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:21 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1216 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:21.382178 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-aab72240-2d86-4ff5-87f1-e712cafdd0e8 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:21.383996 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-aab72240-2d86-4ff5-87f1-e712cafdd0e8 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:21.390794 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2e644401-3078-4867-a0ab-9c34da388939 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:21.391874 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2e644401-3078-4867-a0ab-9c34da388939 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:21.394478 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2e644401-3078-4867-a0ab-9c34da388939 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:21.396645 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aab72240-2d86-4ff5-87f1-e712cafdd0e8 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:21.397685 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aab72240-2d86-4ff5-87f1-e712cafdd0e8 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:21.399197 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aab72240-2d86-4ff5-87f1-e712cafdd0e8 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:21.400102 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-aab72240-2d86-4ff5-87f1-e712cafdd0e8 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:21.403701 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2e644401-3078-4867-a0ab-9c34da388939 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:21.624085 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-aab72240-2d86-4ff5-87f1-e712cafdd0e8 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:21.635195 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-aab72240-2d86-4ff5-87f1-e712cafdd0e8 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1" status: 200 len: 1308 microversion: 2.1 time: 0.263822 Jun 16 14:47:21.636078 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 932/1864] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:21 2022] GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 => generated 1308 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:21.647380 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4195f888-2255-4fee-a543-f0f8ef67b2cf tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:21.648605 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4195f888-2255-4fee-a543-f0f8ef67b2cf tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:21.660994 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4195f888-2255-4fee-a543-f0f8ef67b2cf tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:21.661765 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4195f888-2255-4fee-a543-f0f8ef67b2cf tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:21.662745 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4195f888-2255-4fee-a543-f0f8ef67b2cf tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:21.663290 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4195f888-2255-4fee-a543-f0f8ef67b2cf tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:21.674197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2e644401-3078-4867-a0ab-9c34da388939 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:21.692501 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2e644401-3078-4867-a0ab-9c34da388939 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1469 microversion: 2.1 time: 0.346001 Jun 16 14:47:21.697011 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 933/1865] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:21 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1469 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:21.706531 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-480a22ac-dc07-447b-9c7b-7a728dc88e6b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:21.709413 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-480a22ac-dc07-447b-9c7b-7a728dc88e6b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:21.714316 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:21.726963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-480a22ac-dc07-447b-9c7b-7a728dc88e6b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:21.727986 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-480a22ac-dc07-447b-9c7b-7a728dc88e6b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:21.729602 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-480a22ac-dc07-447b-9c7b-7a728dc88e6b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:21.730640 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-480a22ac-dc07-447b-9c7b-7a728dc88e6b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:21.914823 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4195f888-2255-4fee-a543-f0f8ef67b2cf tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:21.921785 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:21.940939 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4195f888-2255-4fee-a543-f0f8ef67b2cf tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1484 microversion: 2.1 time: 0.301314 Jun 16 14:47:21.957301 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 933/1866] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:21 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1484 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:21.973335 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d6461cdc-ea2a-4803-8282-a2143a64ad7e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:21.974807 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d6461cdc-ea2a-4803-8282-a2143a64ad7e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:21.994269 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d6461cdc-ea2a-4803-8282-a2143a64ad7e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:21.995468 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d6461cdc-ea2a-4803-8282-a2143a64ad7e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:21.997107 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d6461cdc-ea2a-4803-8282-a2143a64ad7e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:21.997997 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d6461cdc-ea2a-4803-8282-a2143a64ad7e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:22.064320 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-480a22ac-dc07-447b-9c7b-7a728dc88e6b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:22.083699 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-480a22ac-dc07-447b-9c7b-7a728dc88e6b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1527 microversion: 2.1 time: 0.386365 Jun 16 14:47:22.096781 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 934/1867] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:21 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1527 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:22.103613 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7b7fcaa9-bd11-4bf7-9c15-f40a7f694f42 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:22.104420 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7b7fcaa9-bd11-4bf7-9c15-f40a7f694f42 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:22.113212 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b7fcaa9-bd11-4bf7-9c15-f40a7f694f42 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:22.114354 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b7fcaa9-bd11-4bf7-9c15-f40a7f694f42 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:22.115395 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b7fcaa9-bd11-4bf7-9c15-f40a7f694f42 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:22.116036 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b7fcaa9-bd11-4bf7-9c15-f40a7f694f42 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:22.300028 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7b7fcaa9-bd11-4bf7-9c15-f40a7f694f42 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201155 Jun 16 14:47:22.301894 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 935/1868] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 16 14:47:22 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050/os-interface => generated 284 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:22.318877 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-22a70bef-f6f3-424b-99d9-8777b8dbfe13 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:22.324880 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-22a70bef-f6f3-424b-99d9-8777b8dbfe13 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:22.352707 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-22a70bef-f6f3-424b-99d9-8777b8dbfe13 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:22.361135 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-22a70bef-f6f3-424b-99d9-8777b8dbfe13 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:22.364752 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-22a70bef-f6f3-424b-99d9-8777b8dbfe13 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:22.365303 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-22a70bef-f6f3-424b-99d9-8777b8dbfe13 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:22.891667 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d6461cdc-ea2a-4803-8282-a2143a64ad7e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:22.939231 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d6461cdc-ea2a-4803-8282-a2143a64ad7e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:22.948430 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d6461cdc-ea2a-4803-8282-a2143a64ad7e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:22.953399 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d6461cdc-ea2a-4803-8282-a2143a64ad7e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.993858 Jun 16 14:47:22.958925 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 934/1869] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:21 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:22.992054 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-df5fc187-61e4-4a6d-84d5-f7c3f2cca372 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:23.021486 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-df5fc187-61e4-4a6d-84d5-f7c3f2cca372 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:23.054863 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-df5fc187-61e4-4a6d-84d5-f7c3f2cca372 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:23.055161 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-df5fc187-61e4-4a6d-84d5-f7c3f2cca372 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:23.056380 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-df5fc187-61e4-4a6d-84d5-f7c3f2cca372 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:23.056847 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-df5fc187-61e4-4a6d-84d5-f7c3f2cca372 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:23.263300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-df5fc187-61e4-4a6d-84d5-f7c3f2cca372 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:23.277444 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-df5fc187-61e4-4a6d-84d5-f7c3f2cca372 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1268 microversion: 2.1 time: 0.316389 Jun 16 14:47:23.278064 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 935/1870] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:22 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1268 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:23.284119 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2a895129-cf41-4129-b493-41f9e5fb691d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:23.292756 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2a895129-cf41-4129-b493-41f9e5fb691d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:23.305428 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a895129-cf41-4129-b493-41f9e5fb691d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:23.305775 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a895129-cf41-4129-b493-41f9e5fb691d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:23.310598 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a895129-cf41-4129-b493-41f9e5fb691d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:23.313603 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a895129-cf41-4129-b493-41f9e5fb691d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:23.784453 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-22a70bef-f6f3-424b-99d9-8777b8dbfe13 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:23.810493 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-22a70bef-f6f3-424b-99d9-8777b8dbfe13 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1392 microversion: 2.1 time: 1.506395 Jun 16 14:47:23.811476 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 936/1871] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:22 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1392 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:23.836346 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0434f697-6f4a-421d-bcb8-db56815d355f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:23.838621 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0434f697-6f4a-421d-bcb8-db56815d355f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:23.872722 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0434f697-6f4a-421d-bcb8-db56815d355f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:23.873940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0434f697-6f4a-421d-bcb8-db56815d355f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:23.875774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0434f697-6f4a-421d-bcb8-db56815d355f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:23.877100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0434f697-6f4a-421d-bcb8-db56815d355f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:23.987130 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=8 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:24.290789 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:24.471926 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0434f697-6f4a-421d-bcb8-db56815d355f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:24.493088 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0434f697-6f4a-421d-bcb8-db56815d355f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1469 microversion: 2.1 time: 0.673683 Jun 16 14:47:24.494031 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 937/1872] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:23 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1469 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:24.501473 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-926d715c-e9a1-49ff-bd9c-e4eb2902b229 req-90a8cbe6-65cd-4fb0-864f-43cb92d63d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76875a5-11a5-4d7f-9db3-7a731c2589a1", "name": "network-vif-plugged", "status": "completed", "tag": "b6ac5e50-81ef-41de-8ac9-bed451827a4f"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:24.520476 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2a895129-cf41-4129-b493-41f9e5fb691d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:24.525327 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-926d715c-e9a1-49ff-bd9c-e4eb2902b229 req-90a8cbe6-65cd-4fb0-864f-43cb92d63d12 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:24.526705 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-926d715c-e9a1-49ff-bd9c-e4eb2902b229 req-90a8cbe6-65cd-4fb0-864f-43cb92d63d12 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:24.540933 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-926d715c-e9a1-49ff-bd9c-e4eb2902b229 req-90a8cbe6-65cd-4fb0-864f-43cb92d63d12 service nova] Creating event network-vif-plugged:b6ac5e50-81ef-41de-8ac9-bed451827a4f for instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 on n-h2-836830-4 Jun 16 14:47:24.541234 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2a895129-cf41-4129-b493-41f9e5fb691d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1" status: 200 len: 1308 microversion: 2.1 time: 1.261066 Jun 16 14:47:24.546997 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-926d715c-e9a1-49ff-bd9c-e4eb2902b229 req-90a8cbe6-65cd-4fb0-864f-43cb92d63d12 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051426 Jun 16 14:47:24.548181 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 938/1874] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:24.548425 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 936/1874] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:23 2022] GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 => generated 1308 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:24.559730 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-177d203d-b65c-4954-9a4f-9bad0954ff7e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:24.561053 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-177d203d-b65c-4954-9a4f-9bad0954ff7e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:24.567040 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2e8e02fc-a855-4353-a304-d0e1ef7b51c9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:24.571848 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2e8e02fc-a855-4353-a304-d0e1ef7b51c9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:24.578926 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-177d203d-b65c-4954-9a4f-9bad0954ff7e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:24.579613 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-177d203d-b65c-4954-9a4f-9bad0954ff7e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:24.580539 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-177d203d-b65c-4954-9a4f-9bad0954ff7e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:24.580958 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-177d203d-b65c-4954-9a4f-9bad0954ff7e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:24.598042 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2e8e02fc-a855-4353-a304-d0e1ef7b51c9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:24.598779 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2e8e02fc-a855-4353-a304-d0e1ef7b51c9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:24.600164 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2e8e02fc-a855-4353-a304-d0e1ef7b51c9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:24.600958 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2e8e02fc-a855-4353-a304-d0e1ef7b51c9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:25.362795 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-177d203d-b65c-4954-9a4f-9bad0954ff7e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:25.382461 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:25.392615 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-177d203d-b65c-4954-9a4f-9bad0954ff7e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1527 microversion: 2.1 time: 0.842474 Jun 16 14:47:25.396377 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 939/1875] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:24 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1527 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:25.417491 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1e08ffcc-ec15-43bf-9c3a-6469817ac708 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:25.418733 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1e08ffcc-ec15-43bf-9c3a-6469817ac708 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:25.438226 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1e08ffcc-ec15-43bf-9c3a-6469817ac708 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:25.439074 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1e08ffcc-ec15-43bf-9c3a-6469817ac708 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:25.439688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1e08ffcc-ec15-43bf-9c3a-6469817ac708 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:25.440219 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1e08ffcc-ec15-43bf-9c3a-6469817ac708 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:25.570414 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2e8e02fc-a855-4353-a304-d0e1ef7b51c9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:25.603693 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2e8e02fc-a855-4353-a304-d0e1ef7b51c9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:25.613231 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2e8e02fc-a855-4353-a304-d0e1ef7b51c9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:25.613922 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1e08ffcc-ec15-43bf-9c3a-6469817ac708 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:25.618273 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2e8e02fc-a855-4353-a304-d0e1ef7b51c9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 1.068199 Jun 16 14:47:25.622065 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 937/1876] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:24 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:25.628362 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1e08ffcc-ec15-43bf-9c3a-6469817ac708 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1274 microversion: 2.1 time: 0.229460 Jun 16 14:47:25.629594 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 940/1877] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:25 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1274 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:25.638261 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9ceaffea-9f4e-4291-8354-33fcf89369c7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:25.638991 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9ceaffea-9f4e-4291-8354-33fcf89369c7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:25.643356 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ced8d3d8-d254-43de-8585-49586fe6765a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:25.644295 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ced8d3d8-d254-43de-8585-49586fe6765a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:25.656927 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9ceaffea-9f4e-4291-8354-33fcf89369c7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:25.658641 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9ceaffea-9f4e-4291-8354-33fcf89369c7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:25.659922 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ced8d3d8-d254-43de-8585-49586fe6765a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:25.660098 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9ceaffea-9f4e-4291-8354-33fcf89369c7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:25.660550 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9ceaffea-9f4e-4291-8354-33fcf89369c7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:25.660914 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ced8d3d8-d254-43de-8585-49586fe6765a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:25.661895 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ced8d3d8-d254-43de-8585-49586fe6765a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:25.662620 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ced8d3d8-d254-43de-8585-49586fe6765a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:25.800640 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ced8d3d8-d254-43de-8585-49586fe6765a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:25.809973 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ced8d3d8-d254-43de-8585-49586fe6765a tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 200 len: 1427 microversion: 2.1 time: 0.179056 Jun 16 14:47:25.816134 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 941/1878] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:25 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 1427 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:25.821464 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-48ee3d5c-246b-4a77-b6a6-09743f03533d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:25.828016 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-48ee3d5c-246b-4a77-b6a6-09743f03533d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:25.855994 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-48ee3d5c-246b-4a77-b6a6-09743f03533d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:25.856825 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-48ee3d5c-246b-4a77-b6a6-09743f03533d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:25.858418 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-48ee3d5c-246b-4a77-b6a6-09743f03533d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:25.872242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-48ee3d5c-246b-4a77-b6a6-09743f03533d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:27.213567 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-48ee3d5c-246b-4a77-b6a6-09743f03533d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:27.240859 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-48ee3d5c-246b-4a77-b6a6-09743f03533d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1" status: 200 len: 1308 microversion: 2.1 time: 1.423244 Jun 16 14:47:27.259969 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 942/1879] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:25 2022] GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 => generated 1308 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:27.268652 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e0905db4-fb0a-4a7c-a00c-63fc8e64a2f8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:27.269744 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e0905db4-fb0a-4a7c-a00c-63fc8e64a2f8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:27.279693 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0905db4-fb0a-4a7c-a00c-63fc8e64a2f8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:27.280492 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0905db4-fb0a-4a7c-a00c-63fc8e64a2f8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:27.282081 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0905db4-fb0a-4a7c-a00c-63fc8e64a2f8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:27.282863 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0905db4-fb0a-4a7c-a00c-63fc8e64a2f8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:27.384324 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9ceaffea-9f4e-4291-8354-33fcf89369c7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:27.400647 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9ceaffea-9f4e-4291-8354-33fcf89369c7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1392 microversion: 2.1 time: 1.772998 Jun 16 14:47:27.402897 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 938/1880] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:25 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1392 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:27.416592 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-458dadf5-8570-4646-aeeb-933a1cf77c4b req-be4cd713-d887-4cde-99f7-a196b0a5eb92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e774f1-5f0b-44fc-999d-0d4473971cef", "name": "network-vif-deleted", "tag": "be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:27.447199 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-458dadf5-8570-4646-aeeb-933a1cf77c4b req-be4cd713-d887-4cde-99f7-a196b0a5eb92 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:27.451647 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-458dadf5-8570-4646-aeeb-933a1cf77c4b req-be4cd713-d887-4cde-99f7-a196b0a5eb92 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:27.916604 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e0905db4-fb0a-4a7c-a00c-63fc8e64a2f8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:27.965521 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e0905db4-fb0a-4a7c-a00c-63fc8e64a2f8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 200 len: 1310 microversion: 2.1 time: 0.685277 Jun 16 14:47:27.966755 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 943/1881] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:27 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 1310 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:28.013282 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3dcc4308-36ea-47ff-98bd-e88a0268d5b7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:28.014548 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3dcc4308-36ea-47ff-98bd-e88a0268d5b7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:28.039550 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3dcc4308-36ea-47ff-98bd-e88a0268d5b7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:28.040022 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3dcc4308-36ea-47ff-98bd-e88a0268d5b7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:28.060384 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3dcc4308-36ea-47ff-98bd-e88a0268d5b7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:28.061215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3dcc4308-36ea-47ff-98bd-e88a0268d5b7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:28.126354 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-458dadf5-8570-4646-aeeb-933a1cf77c4b req-be4cd713-d887-4cde-99f7-a196b0a5eb92 service nova] Creating event network-vif-deleted:be30e7fb-bdf0-4c3f-9862-813bf7a6a6d0 for instance d0e774f1-5f0b-44fc-999d-0d4473971cef on n-h1-836830-4 Jun 16 14:47:28.143659 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-458dadf5-8570-4646-aeeb-933a1cf77c4b req-be4cd713-d887-4cde-99f7-a196b0a5eb92 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.737884 Jun 16 14:47:28.147964 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 939/1882] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:28.165658 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-4a311317-2388-4245-8092-4e3ecf1b15bf req-7ca93d65-d6a2-4102-b0af-d099b8d97ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0480cd1-9dd6-492d-ae9f-aa52b4702e05", "name": "network-vif-plugged", "status": "completed", "tag": "65ad3aa6-d064-42ed-9694-845ef2625d96"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:28.191701 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-4a311317-2388-4245-8092-4e3ecf1b15bf req-7ca93d65-d6a2-4102-b0af-d099b8d97ed6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:28.191928 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-4a311317-2388-4245-8092-4e3ecf1b15bf req-7ca93d65-d6a2-4102-b0af-d099b8d97ed6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:28.256554 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-4a311317-2388-4245-8092-4e3ecf1b15bf req-7ca93d65-d6a2-4102-b0af-d099b8d97ed6 service nova] Creating event network-vif-plugged:65ad3aa6-d064-42ed-9694-845ef2625d96 for instance d0480cd1-9dd6-492d-ae9f-aa52b4702e05 on n-h1-836830-4 Jun 16 14:47:28.273108 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-4a311317-2388-4245-8092-4e3ecf1b15bf req-7ca93d65-d6a2-4102-b0af-d099b8d97ed6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121268 Jun 16 14:47:28.279030 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 940/1883] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:28.328535 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-214fb204-5522-483f-8595-e2b27349023f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:28.333605 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-214fb204-5522-483f-8595-e2b27349023f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:28.366978 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-214fb204-5522-483f-8595-e2b27349023f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:28.372265 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-214fb204-5522-483f-8595-e2b27349023f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:28.375532 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-214fb204-5522-483f-8595-e2b27349023f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:28.378411 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-214fb204-5522-483f-8595-e2b27349023f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:28.634261 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3dcc4308-36ea-47ff-98bd-e88a0268d5b7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:28.648831 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3dcc4308-36ea-47ff-98bd-e88a0268d5b7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:28.651066 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3dcc4308-36ea-47ff-98bd-e88a0268d5b7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:28.657037 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3dcc4308-36ea-47ff-98bd-e88a0268d5b7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.668990 Jun 16 14:47:28.660191 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 944/1884] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:27 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:28.682764 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d08a28b0-11ed-4fff-9ff5-4f5efb316d6d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:28.684013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d08a28b0-11ed-4fff-9ff5-4f5efb316d6d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: d0e774f1-5f0b-44fc-999d-0d4473971cef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:28.717522 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d08a28b0-11ed-4fff-9ff5-4f5efb316d6d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:28.718284 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d08a28b0-11ed-4fff-9ff5-4f5efb316d6d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:28.719513 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d08a28b0-11ed-4fff-9ff5-4f5efb316d6d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:28.721853 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d08a28b0-11ed-4fff-9ff5-4f5efb316d6d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:28.787795 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-d08a28b0-11ed-4fff-9ff5-4f5efb316d6d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] HTTP exception thrown: Instance d0e774f1-5f0b-44fc-999d-0d4473971cef could not be found. Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d08a28b0-11ed-4fff-9ff5-4f5efb316d6d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Request method failure captured: Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef HTTP/1.1 Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0DXFE8Vor5JLcZPE8OkQrI7LMkkoLVBI_0QSqbQpJMs4ma6obpXvLHzIvNHgOpAEXnbsibN4JdFNbYy2-56jTMWA8UuZ6fEAYyg_21_ElPANICJZlrWgGH4lnc0UOaWuCZvK7JS8SDd0o3nBkraCiM71vT5xBbdKpdc1w4yk9W6TDM Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 414e3b792647435daa2ecce22a2c6132 Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-MigrationsAdminTest-570114701 Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:47:28.799926 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:47:28.803012 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_414e3b792647435daa2ecce22a2c6132", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/414e3b792647435daa2ecce22a2c6132"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/414e3b792647435daa2ecce22a2c6132"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/414e3b792647435daa2ecce22a2c6132"}]}] Jun 16 14:47:28.803012 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-MigrationsAdminTest-570114701 Jun 16 14:47:28.803012 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 414e3b792647435daa2ecce22a2c6132 Jun 16 14:47:28.803012 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-MigrationsAdminTest-570114701 Jun 16 14:47:28.803012 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-MigrationsAdminTest-570114701-project Jun 16 14:47:28.803012 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:47:28.803012 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:47:28.803012 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 65cde69f3b52448c8b08297b548bb377 Jun 16 14:47:28.803012 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-MigrationsAdminTest-570114701-project Jun 16 14:47:28.803012 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:47:28.803012 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance d0e774f1-5f0b-44fc-999d-0d4473971cef could not be found. Jun 16 14:47:28.803012 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'd0e774f1-5f0b-44fc-999d-0d4473971cef'} Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e774f1-5f0b-44fc-999d-0d4473971cef could not be found. Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:47:28.804434 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e774f1-5f0b-44fc-999d-0d4473971cef could not be found. Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e774f1-5f0b-44fc-999d-0d4473971cef could not be found. Jun 16 14:47:28.806474 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:28.810057 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d08a28b0-11ed-4fff-9ff5-4f5efb316d6d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Returning 404 to user: Instance d0e774f1-5f0b-44fc-999d-0d4473971cef could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:47:28.810617 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d08a28b0-11ed-4fff-9ff5-4f5efb316d6d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef" status: 404 len: 111 microversion: 2.1 time: 0.138512 Jun 16 14:47:28.814061 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 945/1885] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:28 2022] GET /compute/v2.1/servers/d0e774f1-5f0b-44fc-999d-0d4473971cef => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:47:28.828428 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-3c228fdb-acc2-472d-a770-a94c5947702b req-b369d5eb-feda-4dd9-8697-ad9e5755fdc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6def9a2e-2a3a-4509-bda8-13a61358d684", "name": "network-vif-deleted", "tag": "313e4cd3-8cb5-43de-9dcc-a44d11059435"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:28.844862 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3c228fdb-acc2-472d-a770-a94c5947702b req-b369d5eb-feda-4dd9-8697-ad9e5755fdc0 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:28.859289 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3c228fdb-acc2-472d-a770-a94c5947702b req-b369d5eb-feda-4dd9-8697-ad9e5755fdc0 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:28.873803 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-3c228fdb-acc2-472d-a770-a94c5947702b req-b369d5eb-feda-4dd9-8697-ad9e5755fdc0 service nova] Creating event network-vif-deleted:313e4cd3-8cb5-43de-9dcc-a44d11059435 for instance 6def9a2e-2a3a-4509-bda8-13a61358d684 on n-h2-836830-4 Jun 16 14:47:28.880622 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-3c228fdb-acc2-472d-a770-a94c5947702b req-b369d5eb-feda-4dd9-8697-ad9e5755fdc0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064607 Jun 16 14:47:28.882091 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 946/1886] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:28.886817 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-214fb204-5522-483f-8595-e2b27349023f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:28.889408 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b6ac3123-2316-4cbd-8257-74b952d7120d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:28.890616 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b6ac3123-2316-4cbd-8257-74b952d7120d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:28.899973 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-214fb204-5522-483f-8595-e2b27349023f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1316 microversion: 2.1 time: 0.612696 Jun 16 14:47:28.904720 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 941/1887] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:28 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:28.905349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b6ac3123-2316-4cbd-8257-74b952d7120d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:28.906195 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b6ac3123-2316-4cbd-8257-74b952d7120d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:28.907470 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b6ac3123-2316-4cbd-8257-74b952d7120d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:28.912608 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b6ac3123-2316-4cbd-8257-74b952d7120d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:28.915003 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bd90f78d-28fc-4bc3-8a14-fe7edfd2aac1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:28.920388 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bd90f78d-28fc-4bc3-8a14-fe7edfd2aac1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:28.936692 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bd90f78d-28fc-4bc3-8a14-fe7edfd2aac1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:28.937225 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bd90f78d-28fc-4bc3-8a14-fe7edfd2aac1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:28.940600 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bd90f78d-28fc-4bc3-8a14-fe7edfd2aac1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:28.943077 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bd90f78d-28fc-4bc3-8a14-fe7edfd2aac1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:29.524361 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bd90f78d-28fc-4bc3-8a14-fe7edfd2aac1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:29.591828 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bd90f78d-28fc-4bc3-8a14-fe7edfd2aac1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1" status: 200 len: 1487 microversion: 2.1 time: 0.668321 Jun 16 14:47:29.593060 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 942/1888] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:28 2022] GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 => generated 1487 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:29.598237 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1960c789-5855-4666-91d0-75ddae2abc2b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:29.608032 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1960c789-5855-4666-91d0-75ddae2abc2b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:29.623683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b6ac3123-2316-4cbd-8257-74b952d7120d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:29.636084 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b6ac3123-2316-4cbd-8257-74b952d7120d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1484 microversion: 2.1 time: 0.752129 Jun 16 14:47:29.641034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1960c789-5855-4666-91d0-75ddae2abc2b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:29.647227 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 947/1889] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:28 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1484 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:29.649140 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1960c789-5855-4666-91d0-75ddae2abc2b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:29.655475 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1960c789-5855-4666-91d0-75ddae2abc2b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:29.656349 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1960c789-5855-4666-91d0-75ddae2abc2b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:29.671302 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1a9bba99-ba93-4dbb-ad50-f307afefd599 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:29.673660 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1a9bba99-ba93-4dbb-ad50-f307afefd599 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:29.696409 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1a9bba99-ba93-4dbb-ad50-f307afefd599 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:29.703303 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1a9bba99-ba93-4dbb-ad50-f307afefd599 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:29.706525 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1a9bba99-ba93-4dbb-ad50-f307afefd599 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:29.707221 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1a9bba99-ba93-4dbb-ad50-f307afefd599 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:29.787514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1a9bba99-ba93-4dbb-ad50-f307afefd599 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:47:30.044505 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1a9bba99-ba93-4dbb-ad50-f307afefd599 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 204 len: 0 microversion: 2.1 time: 0.390866 Jun 16 14:47:30.050007 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 948/1890] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:47:29 2022] DELETE /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:47:30.068160 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:30.097750 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-402e7f2a-df1c-408c-aa07-3c1df8105984 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:30.107152 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-402e7f2a-df1c-408c-aa07-3c1df8105984 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:30.155397 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-402e7f2a-df1c-408c-aa07-3c1df8105984 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:30.159231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-402e7f2a-df1c-408c-aa07-3c1df8105984 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:30.165685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-402e7f2a-df1c-408c-aa07-3c1df8105984 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:30.169023 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-402e7f2a-df1c-408c-aa07-3c1df8105984 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:30.236674 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-402e7f2a-df1c-408c-aa07-3c1df8105984 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] HTTP exception thrown: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-402e7f2a-df1c-408c-aa07-3c1df8105984 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Request method failure captured: Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 HTTP/1.1 Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0HwzjjfEOzwOCijJMwAIM9bloQokdG738AdmO2AfwSY4wjVjyQLh9lWAzH4Rn8UCfDe9NW9edyGFTRe1GgDBY6cMZzBwN1dffuTKMcXrVyPL7r_AJ0308sfSN5YHtB5BJ4xC8C7QdPv6xOmwCbcFwnW04fPzhAdrkooBYSucmrM6SQ Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:47:30.248598 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:47:30.250208 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b46102b0fb544d118e324f7fcf654eb2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b46102b0fb544d118e324f7fcf654eb2"}]}] Jun 16 14:47:30.250208 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:47:30.250208 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:47:30.250208 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:47:30.250208 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:47:30.250208 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:47:30.250208 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:47:30.250208 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 8fc694c86102467bb97072ca4972b223 Jun 16 14:47:30.250208 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:47:30.250208 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:47:30.250208 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. Jun 16 14:47:30.250208 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '6def9a2e-2a3a-4509-bda8-13a61358d684'} Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:47:30.251207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. Jun 16 14:47:30.254298 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:30.258403 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-402e7f2a-df1c-408c-aa07-3c1df8105984 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Returning 404 to user: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:47:30.260218 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-402e7f2a-df1c-408c-aa07-3c1df8105984 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 404 len: 111 microversion: 2.1 time: 0.206075 Jun 16 14:47:30.262061 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 949/1891] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:30 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:47:30.270759 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3dcd8da7-e71d-4344-96f6-50e43ca70147 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:30.273897 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3dcd8da7-e71d-4344-96f6-50e43ca70147 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:30.336304 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3dcd8da7-e71d-4344-96f6-50e43ca70147 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:30.342911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3dcd8da7-e71d-4344-96f6-50e43ca70147 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:30.346640 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3dcd8da7-e71d-4344-96f6-50e43ca70147 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:30.354485 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3dcd8da7-e71d-4344-96f6-50e43ca70147 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:30.428023 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1960c789-5855-4666-91d0-75ddae2abc2b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:30.457588 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1960c789-5855-4666-91d0-75ddae2abc2b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1392 microversion: 2.1 time: 0.863190 Jun 16 14:47:30.459907 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 943/1892] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:29 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1392 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:30.466794 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1d73cff6-a95a-4bef-8bf0-48e68bb9ee6a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:30.471460 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1d73cff6-a95a-4bef-8bf0-48e68bb9ee6a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:30.510115 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1d73cff6-a95a-4bef-8bf0-48e68bb9ee6a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:30.516176 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1d73cff6-a95a-4bef-8bf0-48e68bb9ee6a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:30.522657 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1d73cff6-a95a-4bef-8bf0-48e68bb9ee6a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:30.523618 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1d73cff6-a95a-4bef-8bf0-48e68bb9ee6a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:30.526638 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-3dcd8da7-e71d-4344-96f6-50e43ca70147 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lazy-loading 'flavor' on Instance uuid b76875a5-11a5-4d7f-9db3-7a731c2589a1 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:47:30.885163 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3dcd8da7-e71d-4344-96f6-50e43ca70147 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "POST /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1/action" status: 202 len: 0 microversion: 2.1 time: 0.621373 Jun 16 14:47:30.887451 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 950/1893] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:47:30 2022] POST /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1/action => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:47:30.898880 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8e7d7acc-f808-4283-acde-d1c752029da9 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:30.900061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8e7d7acc-f808-4283-acde-d1c752029da9 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:30.920868 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8e7d7acc-f808-4283-acde-d1c752029da9 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:30.921316 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8e7d7acc-f808-4283-acde-d1c752029da9 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:30.922194 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8e7d7acc-f808-4283-acde-d1c752029da9 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:30.922908 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8e7d7acc-f808-4283-acde-d1c752029da9 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:31.221685 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1d73cff6-a95a-4bef-8bf0-48e68bb9ee6a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:31.291779 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1d73cff6-a95a-4bef-8bf0-48e68bb9ee6a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:31.301762 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1d73cff6-a95a-4bef-8bf0-48e68bb9ee6a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:31.305553 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1d73cff6-a95a-4bef-8bf0-48e68bb9ee6a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.843617 Jun 16 14:47:31.307205 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 944/1894] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:30 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:31.317715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-448b2e05-be67-4fa7-adfd-75b7f25d7e14 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:31.319088 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-448b2e05-be67-4fa7-adfd-75b7f25d7e14 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:31.331839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-448b2e05-be67-4fa7-adfd-75b7f25d7e14 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:31.333131 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-448b2e05-be67-4fa7-adfd-75b7f25d7e14 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:31.334720 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-448b2e05-be67-4fa7-adfd-75b7f25d7e14 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:31.335420 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-448b2e05-be67-4fa7-adfd-75b7f25d7e14 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:31.366416 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=8 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:31.618363 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8e7d7acc-f808-4283-acde-d1c752029da9 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:31.638301 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8e7d7acc-f808-4283-acde-d1c752029da9 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1316 microversion: 2.1 time: 0.750561 Jun 16 14:47:31.638944 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 951/1895] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:30 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1316 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:31.653389 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-4294c56e-8995-47c0-8f1a-a9c10ad8182e req-29867d22-636f-446a-a606-4ee5b98dab38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10edf992-de67-491e-a852-b01b4d61f050", "tag": "41ff13ee-3afd-4b91-b9aa-45a9e6952aa6"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:31.674324 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-4294c56e-8995-47c0-8f1a-a9c10ad8182e req-29867d22-636f-446a-a606-4ee5b98dab38 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:31.674878 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-4294c56e-8995-47c0-8f1a-a9c10ad8182e req-29867d22-636f-446a-a606-4ee5b98dab38 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:31.710693 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-4294c56e-8995-47c0-8f1a-a9c10ad8182e req-29867d22-636f-446a-a606-4ee5b98dab38 service nova] Creating event network-changed:41ff13ee-3afd-4b91-b9aa-45a9e6952aa6 for instance 10edf992-de67-491e-a852-b01b4d61f050 on n-h1-836830-4 Jun 16 14:47:31.727737 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-4294c56e-8995-47c0-8f1a-a9c10ad8182e req-29867d22-636f-446a-a606-4ee5b98dab38 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087265 Jun 16 14:47:31.728857 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 952/1896] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:31.738187 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1798604158", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:31.881125 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] validate_networks() for [('487c2811-25df-4e80-8a06-b782ae938f03', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:47:31.910629 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-448b2e05-be67-4fa7-adfd-75b7f25d7e14 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:31.932339 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-448b2e05-be67-4fa7-adfd-75b7f25d7e14 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1534 microversion: 2.1 time: 0.623666 Jun 16 14:47:31.960996 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 945/1897] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:31 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1534 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:31.983277 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bf528c30-1bc7-4c3d-8f52-6df39389610d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:31.987826 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bf528c30-1bc7-4c3d-8f52-6df39389610d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:31.997047 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bf528c30-1bc7-4c3d-8f52-6df39389610d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:32.001281 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bf528c30-1bc7-4c3d-8f52-6df39389610d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:32.002557 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bf528c30-1bc7-4c3d-8f52-6df39389610d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:32.004704 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bf528c30-1bc7-4c3d-8f52-6df39389610d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:32.732552 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bf528c30-1bc7-4c3d-8f52-6df39389610d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:32.741385 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bf528c30-1bc7-4c3d-8f52-6df39389610d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1" status: 200 len: 1495 microversion: 2.1 time: 0.778650 Jun 16 14:47:32.742255 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 946/1898] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:31 2022] GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 => generated 1495 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:32.754647 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-2af5a876-c835-49a6-a216-85228c908aac req-ca7620db-3678-471f-b2dd-e3a08ebf4dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a730c56-4854-4563-a704-941d98df51a3", "tag": "90a27c77-c44d-42f6-8959-801e8c63a89d"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:32.776526 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-2af5a876-c835-49a6-a216-85228c908aac req-ca7620db-3678-471f-b2dd-e3a08ebf4dc9 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:32.777756 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-2af5a876-c835-49a6-a216-85228c908aac req-ca7620db-3678-471f-b2dd-e3a08ebf4dc9 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:32.804777 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-2af5a876-c835-49a6-a216-85228c908aac req-ca7620db-3678-471f-b2dd-e3a08ebf4dc9 service nova] Creating event network-changed:90a27c77-c44d-42f6-8959-801e8c63a89d for instance 7a730c56-4854-4563-a704-941d98df51a3 on n-h1-836830-4 Jun 16 14:47:32.826877 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-2af5a876-c835-49a6-a216-85228c908aac req-ca7620db-3678-471f-b2dd-e3a08ebf4dc9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079694 Jun 16 14:47:32.828854 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 947/1899] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:32.873736 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-53e210e2-ed11-4f5d-b5e6-37838b96e28e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:32.874931 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-53e210e2-ed11-4f5d-b5e6-37838b96e28e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:32.889953 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53e210e2-ed11-4f5d-b5e6-37838b96e28e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:32.892768 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53e210e2-ed11-4f5d-b5e6-37838b96e28e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:32.897543 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53e210e2-ed11-4f5d-b5e6-37838b96e28e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:32.900574 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-53e210e2-ed11-4f5d-b5e6-37838b96e28e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:33.344109 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:47:33.350944 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:47:33.353289 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:47:33.354789 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:47:33.357233 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:47:33.389178 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:33.391265 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:33.394883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:33.395785 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:33.447619 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Getting quotas for project b46102b0fb544d118e324f7fcf654eb2. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:47:33.468048 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Getting quotas for user 8fc694c86102467bb97072ca4972b223 and project b46102b0fb544d118e324f7fcf654eb2. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:47:33.538314 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:47:33.544681 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:47:33.568539 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-53e210e2-ed11-4f5d-b5e6-37838b96e28e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:33.579302 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-53e210e2-ed11-4f5d-b5e6-37838b96e28e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1573 microversion: 2.1 time: 0.747417 Jun 16 14:47:33.592184 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 948/1900] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:32 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1573 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:33.592184 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-37dbf3f1-5846-46b8-9f92-2d7a466f37cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:33.592184 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-37dbf3f1-5846-46b8-9f92-2d7a466f37cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:33.597753 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-37dbf3f1-5846-46b8-9f92-2d7a466f37cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:33.597985 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-37dbf3f1-5846-46b8-9f92-2d7a466f37cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:33.601227 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-37dbf3f1-5846-46b8-9f92-2d7a466f37cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:33.602714 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-37dbf3f1-5846-46b8-9f92-2d7a466f37cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:33.676848 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-28734d1b-7081-4e7a-a5a2-9a02f8ee4e80 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.946405 Jun 16 14:47:33.686923 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 953/1901] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:47:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:47:33.710611 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-84351360-ce0e-4f3a-b532-661f79876028 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:33.720980 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-84351360-ce0e-4f3a-b532-661f79876028 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:33.760567 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-84351360-ce0e-4f3a-b532-661f79876028 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:33.765859 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-84351360-ce0e-4f3a-b532-661f79876028 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:33.767454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-84351360-ce0e-4f3a-b532-661f79876028 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:33.768264 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-84351360-ce0e-4f3a-b532-661f79876028 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:34.164264 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-37dbf3f1-5846-46b8-9f92-2d7a466f37cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:34.182645 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-37dbf3f1-5846-46b8-9f92-2d7a466f37cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:34.184415 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-37dbf3f1-5846-46b8-9f92-2d7a466f37cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:34.185960 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-37dbf3f1-5846-46b8-9f92-2d7a466f37cf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.604277 Jun 16 14:47:34.203100 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 949/1902] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:33 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:34.214618 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d64adf6f-82c1-4361-9566-706e708e880d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:34.216090 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d64adf6f-82c1-4361-9566-706e708e880d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:34.231941 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d64adf6f-82c1-4361-9566-706e708e880d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:34.232462 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d64adf6f-82c1-4361-9566-706e708e880d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:34.233351 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d64adf6f-82c1-4361-9566-706e708e880d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:34.233920 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d64adf6f-82c1-4361-9566-706e708e880d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:34.352430 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d64adf6f-82c1-4361-9566-706e708e880d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:34.352997 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d64adf6f-82c1-4361-9566-706e708e880d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:34.353478 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-d64adf6f-82c1-4361-9566-706e708e880d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lazy-loading 'fault' on Instance uuid b628388b-e782-439f-b76a-ab248b22404a {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:47:34.471883 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d64adf6f-82c1-4361-9566-706e708e880d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:34.475288 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-84351360-ce0e-4f3a-b532-661f79876028 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:34.494455 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d64adf6f-82c1-4361-9566-706e708e880d tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 200 len: 1369 microversion: 2.1 time: 0.289531 Jun 16 14:47:34.497393 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 950/1903] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:34 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 1369 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:34.510246 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d7a002c4-2a9b-46ab-90cd-70778078cbc4 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:34.511915 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d7a002c4-2a9b-46ab-90cd-70778078cbc4 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:34.525748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d7a002c4-2a9b-46ab-90cd-70778078cbc4 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:34.527715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d7a002c4-2a9b-46ab-90cd-70778078cbc4 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:34.529502 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-84351360-ce0e-4f3a-b532-661f79876028 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1316 microversion: 2.1 time: 0.834164 Jun 16 14:47:34.530343 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d7a002c4-2a9b-46ab-90cd-70778078cbc4 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:34.531603 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d7a002c4-2a9b-46ab-90cd-70778078cbc4 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:34.537549 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 954/1904] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:33 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1316 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:34.567725 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d1dd179e-6428-4fba-84ba-50c0279ceb6d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:34.573137 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d1dd179e-6428-4fba-84ba-50c0279ceb6d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:34.810850 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d1dd179e-6428-4fba-84ba-50c0279ceb6d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:34.847895 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d1dd179e-6428-4fba-84ba-50c0279ceb6d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1225 microversion: 2.1 time: 0.306733 Jun 16 14:47:34.850366 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 955/1905] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:34 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1225 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:34.862169 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a9dcb1cb-a1b1-42c8-bd94-62f328225ad5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:34.864123 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a9dcb1cb-a1b1-42c8-bd94-62f328225ad5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:34.880057 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9dcb1cb-a1b1-42c8-bd94-62f328225ad5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:34.881409 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9dcb1cb-a1b1-42c8-bd94-62f328225ad5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:34.883249 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9dcb1cb-a1b1-42c8-bd94-62f328225ad5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:34.884593 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9dcb1cb-a1b1-42c8-bd94-62f328225ad5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:35.053411 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d7a002c4-2a9b-46ab-90cd-70778078cbc4 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.552288 Jun 16 14:47:35.067218 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 951/1906] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 16 14:47:34 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05/os-interface => generated 284 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:35.114793 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-bf165590-d834-4d40-8766-190f23f25806 req-e3c59c4f-e208-4e93-a0fe-236ea621757b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b628388b-e782-439f-b76a-ab248b22404a", "name": "network-vif-deleted", "tag": "8bb810a3-e086-4b58-bef2-f3a96202f1cd"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:35.123524 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:35.140943 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-bf165590-d834-4d40-8766-190f23f25806 req-e3c59c4f-e208-4e93-a0fe-236ea621757b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:35.141858 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-bf165590-d834-4d40-8766-190f23f25806 req-e3c59c4f-e208-4e93-a0fe-236ea621757b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:35.171668 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-bf165590-d834-4d40-8766-190f23f25806 req-e3c59c4f-e208-4e93-a0fe-236ea621757b service nova] Creating event network-vif-deleted:8bb810a3-e086-4b58-bef2-f3a96202f1cd for instance b628388b-e782-439f-b76a-ab248b22404a on n-h2-836830-4 Jun 16 14:47:35.186336 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-bf165590-d834-4d40-8766-190f23f25806 req-e3c59c4f-e208-4e93-a0fe-236ea621757b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114289 Jun 16 14:47:35.189047 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 952/1907] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:35.215481 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-72e32ed9-3077-46d3-ad76-8565fd6d3a7b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:35.219478 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-72e32ed9-3077-46d3-ad76-8565fd6d3a7b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:35.249691 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-72e32ed9-3077-46d3-ad76-8565fd6d3a7b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:35.252992 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-72e32ed9-3077-46d3-ad76-8565fd6d3a7b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:35.257876 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-72e32ed9-3077-46d3-ad76-8565fd6d3a7b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:35.262739 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-72e32ed9-3077-46d3-ad76-8565fd6d3a7b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:35.313692 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:35.700091 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a9dcb1cb-a1b1-42c8-bd94-62f328225ad5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:35.721900 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a9dcb1cb-a1b1-42c8-bd94-62f328225ad5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1" status: 200 len: 1478 microversion: 2.1 time: 0.868017 Jun 16 14:47:35.723196 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 956/1908] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:34 2022] GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 => generated 1478 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:35.759412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3db976b8-1972-4851-b572-37a898097edb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:35.760794 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3db976b8-1972-4851-b572-37a898097edb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: b628388b-e782-439f-b76a-ab248b22404a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:35.781216 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3db976b8-1972-4851-b572-37a898097edb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:35.782106 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3db976b8-1972-4851-b572-37a898097edb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:35.783468 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3db976b8-1972-4851-b572-37a898097edb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:35.784498 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3db976b8-1972-4851-b572-37a898097edb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:35.797832 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-72e32ed9-3077-46d3-ad76-8565fd6d3a7b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:35.817320 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-72e32ed9-3077-46d3-ad76-8565fd6d3a7b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:35.825823 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-72e32ed9-3077-46d3-ad76-8565fd6d3a7b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:35.829637 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-72e32ed9-3077-46d3-ad76-8565fd6d3a7b tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.626082 Jun 16 14:47:35.831455 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 953/1909] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:35 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:47:35.844689 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-3db976b8-1972-4851-b572-37a898097edb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] HTTP exception thrown: Instance b628388b-e782-439f-b76a-ab248b22404a could not be found. Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3db976b8-1972-4851-b572-37a898097edb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Request method failure captured: Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a HTTP/1.1 Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0DXFE8Vor5JLcZPE8OkQrI7LMkkoLVBI_0QSqbQpJMs4ma6obpXvLHzIvNHgOpAEXnbsibN4JdFNbYy2-56jTMWA8UuZ6fEAYyg_21_ElPANICJZlrWgGH4lnc0UOaWuCZvK7JS8SDd0o3nBkraCiM71vT5xBbdKpdc1w4yk9W6TDM Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 414e3b792647435daa2ecce22a2c6132 Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-MigrationsAdminTest-570114701 Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:47:35.847307 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:47:35.849992 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_414e3b792647435daa2ecce22a2c6132", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/414e3b792647435daa2ecce22a2c6132"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/414e3b792647435daa2ecce22a2c6132"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/414e3b792647435daa2ecce22a2c6132"}]}] Jun 16 14:47:35.849992 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-MigrationsAdminTest-570114701 Jun 16 14:47:35.849992 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 414e3b792647435daa2ecce22a2c6132 Jun 16 14:47:35.849992 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-MigrationsAdminTest-570114701 Jun 16 14:47:35.849992 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-MigrationsAdminTest-570114701-project Jun 16 14:47:35.849992 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:47:35.849992 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:47:35.849992 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 65cde69f3b52448c8b08297b548bb377 Jun 16 14:47:35.849992 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-MigrationsAdminTest-570114701-project Jun 16 14:47:35.849992 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:47:35.849992 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance b628388b-e782-439f-b76a-ab248b22404a could not be found. Jun 16 14:47:35.849992 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'b628388b-e782-439f-b76a-ab248b22404a'} Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b628388b-e782-439f-b76a-ab248b22404a could not be found. Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:47:35.851353 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b628388b-e782-439f-b76a-ab248b22404a could not be found. Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b628388b-e782-439f-b76a-ab248b22404a could not be found. Jun 16 14:47:35.853413 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:35.859666 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3db976b8-1972-4851-b572-37a898097edb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Returning 404 to user: Instance b628388b-e782-439f-b76a-ab248b22404a could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:47:35.861697 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-be9b0f30-db44-43d3-9e08-3792dc3b0371 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:35.862930 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-be9b0f30-db44-43d3-9e08-3792dc3b0371 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:35.863309 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3db976b8-1972-4851-b572-37a898097edb tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a" status: 404 len: 111 microversion: 2.1 time: 0.135921 Jun 16 14:47:35.866504 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 957/1910] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:35 2022] GET /compute/v2.1/servers/b628388b-e782-439f-b76a-ab248b22404a => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:47:35.883116 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-be9b0f30-db44-43d3-9e08-3792dc3b0371 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:35.884343 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-36307036-07f2-4ddb-98eb-d911da88651e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1444192449"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:35.885976 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-be9b0f30-db44-43d3-9e08-3792dc3b0371 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:35.889444 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-36307036-07f2-4ddb-98eb-d911da88651e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:35.891048 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-be9b0f30-db44-43d3-9e08-3792dc3b0371 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:35.891678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-be9b0f30-db44-43d3-9e08-3792dc3b0371 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:35.920756 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-36307036-07f2-4ddb-98eb-d911da88651e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:35.922893 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-36307036-07f2-4ddb-98eb-d911da88651e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:35.927718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-36307036-07f2-4ddb-98eb-d911da88651e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:35.936352 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-36307036-07f2-4ddb-98eb-d911da88651e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:36.027231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:36.804342 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-36307036-07f2-4ddb-98eb-d911da88651e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "POST /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1/action" status: 202 len: 0 microversion: 2.1 time: 0.934507 Jun 16 14:47:36.811707 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 958/1911] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:47:35 2022] POST /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1/action => generated 0 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 14:47:36.817906 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-83fd4200-a527-4f04-9590-74e2bfcc98cd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '.version_select at 0x7fdeffb9f670>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:36.851397 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-83fd4200-a527-4f04-9590-74e2bfcc98cd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116416210" status: 202 len: 0 microversion: 2.1 time: 0.035779 Jun 16 14:47:36.852817 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 959/1912] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jun 16 14:47:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116416210 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:47:36.866848 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f7da2a04-8eeb-458e-ab13-d8407fb0fc54 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:36.874494 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f7da2a04-8eeb-458e-ab13-d8407fb0fc54 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:36.891611 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f7da2a04-8eeb-458e-ab13-d8407fb0fc54 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:36.896728 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f7da2a04-8eeb-458e-ab13-d8407fb0fc54 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:36.897632 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f7da2a04-8eeb-458e-ab13-d8407fb0fc54 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:36.898092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f7da2a04-8eeb-458e-ab13-d8407fb0fc54 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:37.121474 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f7da2a04-8eeb-458e-ab13-d8407fb0fc54 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:37.148857 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f7da2a04-8eeb-458e-ab13-d8407fb0fc54 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1283 microversion: 2.1 time: 0.291647 Jun 16 14:47:37.149947 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 960/1913] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:36 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1283 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:37.172648 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-94997475-7372-4f7b-b1f2-2882960ac41f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffb459d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:37.271547 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-94997475-7372-4f7b-b1f2-2882960ac41f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.107446 Jun 16 14:47:37.273478 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 961/1914] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:37 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:37.283670 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fbf87130-2321-4acc-b8f7-b10543f3b513 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:37.285197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fbf87130-2321-4acc-b8f7-b10543f3b513 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:37.299146 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fbf87130-2321-4acc-b8f7-b10543f3b513 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:37.300362 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fbf87130-2321-4acc-b8f7-b10543f3b513 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:37.302143 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fbf87130-2321-4acc-b8f7-b10543f3b513 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:37.303310 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fbf87130-2321-4acc-b8f7-b10543f3b513 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:37.317673 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-be9b0f30-db44-43d3-9e08-3792dc3b0371 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:37.333455 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-be9b0f30-db44-43d3-9e08-3792dc3b0371 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1316 microversion: 2.1 time: 1.499282 Jun 16 14:47:37.348546 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 954/1915] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:35 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1316 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:37.937980 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fbf87130-2321-4acc-b8f7-b10543f3b513 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:37.974954 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fbf87130-2321-4acc-b8f7-b10543f3b513 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:37.977303 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fbf87130-2321-4acc-b8f7-b10543f3b513 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:37.979295 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fbf87130-2321-4acc-b8f7-b10543f3b513 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.703544 Jun 16 14:47:37.980521 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 962/1916] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:37 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:38.171748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-36cd2b08-2b9d-4e36-9c35-444dd3a0d7ed tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:38.172902 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-36cd2b08-2b9d-4e36-9c35-444dd3a0d7ed tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:38.181282 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-36cd2b08-2b9d-4e36-9c35-444dd3a0d7ed tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:38.182085 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-36cd2b08-2b9d-4e36-9c35-444dd3a0d7ed tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:38.183286 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-36cd2b08-2b9d-4e36-9c35-444dd3a0d7ed tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:38.184504 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-36cd2b08-2b9d-4e36-9c35-444dd3a0d7ed tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:38.298192 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-302b5cca-7741-4188-862c-a4433c8e77b4 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffb45820>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:38.388501 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-302b5cca-7741-4188-862c-a4433c8e77b4 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.100519 Jun 16 14:47:38.390362 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 963/1917] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:38 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:38.395797 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-43e5c6c0-a27d-4611-ae01-e3e7b0eb73f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:38.396788 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-43e5c6c0-a27d-4611-ae01-e3e7b0eb73f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:38.414574 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-43e5c6c0-a27d-4611-ae01-e3e7b0eb73f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:38.415911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-43e5c6c0-a27d-4611-ae01-e3e7b0eb73f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:38.417186 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-43e5c6c0-a27d-4611-ae01-e3e7b0eb73f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:38.418516 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-43e5c6c0-a27d-4611-ae01-e3e7b0eb73f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:38.581673 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-36cd2b08-2b9d-4e36-9c35-444dd3a0d7ed tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:38.598353 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-36cd2b08-2b9d-4e36-9c35-444dd3a0d7ed tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1283 microversion: 2.1 time: 0.433547 Jun 16 14:47:38.617252 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 955/1918] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:38 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1283 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:38.832312 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7fa24e07-f2d7-4c48-8598-6caa661d8585 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:38.833751 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7fa24e07-f2d7-4c48-8598-6caa661d8585 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:38.848276 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7fa24e07-f2d7-4c48-8598-6caa661d8585 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:38.850397 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7fa24e07-f2d7-4c48-8598-6caa661d8585 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:38.856967 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7fa24e07-f2d7-4c48-8598-6caa661d8585 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:38.858238 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7fa24e07-f2d7-4c48-8598-6caa661d8585 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:38.888123 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-43e5c6c0-a27d-4611-ae01-e3e7b0eb73f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:38.905305 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-43e5c6c0-a27d-4611-ae01-e3e7b0eb73f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1316 microversion: 2.1 time: 0.513491 Jun 16 14:47:38.907734 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 964/1919] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:38 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1316 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:38.927499 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-ced060bc-d9b0-421b-90d6-e539def06355 req-3f34ec3c-e3da-4717-b8c0-849d8cf51c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0480cd1-9dd6-492d-ae9f-aa52b4702e05", "tag": "65ad3aa6-d064-42ed-9694-845ef2625d96"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:38.959217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-ced060bc-d9b0-421b-90d6-e539def06355 req-3f34ec3c-e3da-4717-b8c0-849d8cf51c90 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:38.961606 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-ced060bc-d9b0-421b-90d6-e539def06355 req-3f34ec3c-e3da-4717-b8c0-849d8cf51c90 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:38.999708 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-ced060bc-d9b0-421b-90d6-e539def06355 req-3f34ec3c-e3da-4717-b8c0-849d8cf51c90 service nova] Creating event network-changed:65ad3aa6-d064-42ed-9694-845ef2625d96 for instance d0480cd1-9dd6-492d-ae9f-aa52b4702e05 on n-h1-836830-4 Jun 16 14:47:39.013897 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-ced060bc-d9b0-421b-90d6-e539def06355 req-3f34ec3c-e3da-4717-b8c0-849d8cf51c90 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094091 Jun 16 14:47:39.016187 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 965/1920] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:39.042822 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cad22928-5bda-4c66-bde9-3ff38ab2531c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:39.049507 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cad22928-5bda-4c66-bde9-3ff38ab2531c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:39.069230 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cad22928-5bda-4c66-bde9-3ff38ab2531c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:39.071023 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cad22928-5bda-4c66-bde9-3ff38ab2531c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:39.073066 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cad22928-5bda-4c66-bde9-3ff38ab2531c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:39.075953 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cad22928-5bda-4c66-bde9-3ff38ab2531c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:39.506111 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cad22928-5bda-4c66-bde9-3ff38ab2531c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:39.517971 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cad22928-5bda-4c66-bde9-3ff38ab2531c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:39.521398 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cad22928-5bda-4c66-bde9-3ff38ab2531c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:39.523542 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cad22928-5bda-4c66-bde9-3ff38ab2531c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.503806 Jun 16 14:47:39.524860 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 966/1921] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:39 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:39.532413 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a86928b1-dfe6-438c-935c-4cc10d9c8186 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffbeac10>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:39.593238 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a86928b1-dfe6-438c-935c-4cc10d9c8186 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.066431 Jun 16 14:47:39.600817 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 967/1922] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:39 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:39.607173 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4d7a3289-170b-4069-b8cd-556c3ae81aa5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:39.607449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4d7a3289-170b-4069-b8cd-556c3ae81aa5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:39.614286 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d7a3289-170b-4069-b8cd-556c3ae81aa5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:39.615449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d7a3289-170b-4069-b8cd-556c3ae81aa5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:39.616886 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d7a3289-170b-4069-b8cd-556c3ae81aa5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:39.616886 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d7a3289-170b-4069-b8cd-556c3ae81aa5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:39.651718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4d7a3289-170b-4069-b8cd-556c3ae81aa5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:47:39.800146 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4d7a3289-170b-4069-b8cd-556c3ae81aa5 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 204 len: 0 microversion: 2.1 time: 0.198081 Jun 16 14:47:39.801131 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 968/1923] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:47:39 2022] DELETE /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:47:39.810461 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-76fe2719-2401-4c41-a249-1bff47e38686 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:39.810768 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-76fe2719-2401-4c41-a249-1bff47e38686 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:39.820212 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-76fe2719-2401-4c41-a249-1bff47e38686 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:39.820593 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-76fe2719-2401-4c41-a249-1bff47e38686 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:39.821507 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-76fe2719-2401-4c41-a249-1bff47e38686 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:39.822004 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-76fe2719-2401-4c41-a249-1bff47e38686 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:39.925905 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7fa24e07-f2d7-4c48-8598-6caa661d8585 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:39.939036 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-76fe2719-2401-4c41-a249-1bff47e38686 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:39.954483 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-76fe2719-2401-4c41-a249-1bff47e38686 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1283 microversion: 2.1 time: 0.151818 Jun 16 14:47:39.955738 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 969/1924] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:39 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1283 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:39.962465 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a3c8853a-ff18-4b12-971d-14786307c3ce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:39.964508 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a3c8853a-ff18-4b12-971d-14786307c3ce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:39.976973 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3c8853a-ff18-4b12-971d-14786307c3ce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:39.977876 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3c8853a-ff18-4b12-971d-14786307c3ce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:39.990662 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3c8853a-ff18-4b12-971d-14786307c3ce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:39.991410 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3c8853a-ff18-4b12-971d-14786307c3ce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:40.019698 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7fa24e07-f2d7-4c48-8598-6caa661d8585 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1573 microversion: 2.1 time: 1.192838 Jun 16 14:47:40.021542 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 956/1925] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:38 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1573 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:40.050545 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-994eae6c-1df3-4cb1-a0b3-ada51303a7b6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:40.051289 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-994eae6c-1df3-4cb1-a0b3-ada51303a7b6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:40.061419 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-994eae6c-1df3-4cb1-a0b3-ada51303a7b6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:40.062183 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-994eae6c-1df3-4cb1-a0b3-ada51303a7b6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:40.063290 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-994eae6c-1df3-4cb1-a0b3-ada51303a7b6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:40.063947 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-994eae6c-1df3-4cb1-a0b3-ada51303a7b6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:40.286175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a3c8853a-ff18-4b12-971d-14786307c3ce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:40.295798 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a3c8853a-ff18-4b12-971d-14786307c3ce tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1469 microversion: 2.1 time: 0.338439 Jun 16 14:47:40.296767 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 970/1926] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:39 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1469 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:40.548132 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-aef5c3c7-7110-482a-9281-f459d3c28cc2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:40.550280 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-aef5c3c7-7110-482a-9281-f459d3c28cc2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:40.562318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aef5c3c7-7110-482a-9281-f459d3c28cc2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:40.563555 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aef5c3c7-7110-482a-9281-f459d3c28cc2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:40.565035 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aef5c3c7-7110-482a-9281-f459d3c28cc2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:40.565833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aef5c3c7-7110-482a-9281-f459d3c28cc2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:40.727512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-994eae6c-1df3-4cb1-a0b3-ada51303a7b6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:40.770293 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-994eae6c-1df3-4cb1-a0b3-ada51303a7b6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1316 microversion: 2.1 time: 0.745958 Jun 16 14:47:40.791145 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 957/1927] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:40 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1316 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:40.816428 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f67a49a2-1a04-4a36-9ee5-07a4a26d0951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf11103280>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:40.849683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-aef5c3c7-7110-482a-9281-f459d3c28cc2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:40.867872 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-aef5c3c7-7110-482a-9281-f459d3c28cc2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:40.874511 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-aef5c3c7-7110-482a-9281-f459d3c28cc2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:40.876458 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-aef5c3c7-7110-482a-9281-f459d3c28cc2 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.334188 Jun 16 14:47:40.882518 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 971/1928] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:40 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:40.967707 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f67a49a2-1a04-4a36-9ee5-07a4a26d0951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.172120 Jun 16 14:47:40.970221 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 958/1929] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:40 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:40.975677 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-05cef3d5-70e9-41cf-a2ee-53d0f03c2293 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:40.977009 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-05cef3d5-70e9-41cf-a2ee-53d0f03c2293 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:40.988765 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:40.992121 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-05cef3d5-70e9-41cf-a2ee-53d0f03c2293 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:40.993711 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-05cef3d5-70e9-41cf-a2ee-53d0f03c2293 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:40.995515 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-05cef3d5-70e9-41cf-a2ee-53d0f03c2293 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:40.998149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-05cef3d5-70e9-41cf-a2ee-53d0f03c2293 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:41.181749 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-12de7dba-feda-438a-b4bd-d25374f47466 req-c9268032-db39-4cb3-9155-88604ce547b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a730c56-4854-4563-a704-941d98df51a3", "name": "network-vif-plugged", "status": "completed", "tag": "90a27c77-c44d-42f6-8959-801e8c63a89d"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:41.241042 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-12de7dba-feda-438a-b4bd-d25374f47466 req-c9268032-db39-4cb3-9155-88604ce547b2 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:41.243226 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-12de7dba-feda-438a-b4bd-d25374f47466 req-c9268032-db39-4cb3-9155-88604ce547b2 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:41.269561 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-05cef3d5-70e9-41cf-a2ee-53d0f03c2293 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:41.293905 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-12de7dba-feda-438a-b4bd-d25374f47466 req-c9268032-db39-4cb3-9155-88604ce547b2 service nova] Creating event network-vif-plugged:90a27c77-c44d-42f6-8959-801e8c63a89d for instance 7a730c56-4854-4563-a704-941d98df51a3 on n-h1-836830-4 Jun 16 14:47:41.300963 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-05cef3d5-70e9-41cf-a2ee-53d0f03c2293 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1283 microversion: 2.1 time: 0.327108 Jun 16 14:47:41.302022 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 972/1930] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:40 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1283 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:47:41.310821 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-12de7dba-feda-438a-b4bd-d25374f47466 req-c9268032-db39-4cb3-9155-88604ce547b2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139903 Jun 16 14:47:41.313286 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 959/1931] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:47:41.327000 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-abe493e2-b4dd-4bf6-a3dd-eaf4f378d2c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:41.327973 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-abe493e2-b4dd-4bf6-a3dd-eaf4f378d2c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:41.346179 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-abe493e2-b4dd-4bf6-a3dd-eaf4f378d2c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:41.349295 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-abe493e2-b4dd-4bf6-a3dd-eaf4f378d2c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:41.351376 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-abe493e2-b4dd-4bf6-a3dd-eaf4f378d2c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:41.351847 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-abe493e2-b4dd-4bf6-a3dd-eaf4f378d2c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:41.667333 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-abe493e2-b4dd-4bf6-a3dd-eaf4f378d2c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:41.680756 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-abe493e2-b4dd-4bf6-a3dd-eaf4f378d2c3 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1469 microversion: 2.1 time: 0.361570 Jun 16 14:47:41.682108 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 973/1932] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:41 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1469 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:41.807595 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fcb79763-426c-41a6-ac1e-9a3ae1c75585 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:41.809392 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fcb79763-426c-41a6-ac1e-9a3ae1c75585 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:41.827028 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fcb79763-426c-41a6-ac1e-9a3ae1c75585 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:41.842192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fcb79763-426c-41a6-ac1e-9a3ae1c75585 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:41.843362 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fcb79763-426c-41a6-ac1e-9a3ae1c75585 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:41.844010 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fcb79763-426c-41a6-ac1e-9a3ae1c75585 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:41.907817 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-10ef533b-6ecd-4d2d-a966-a7b9568229a8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:41.908684 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-10ef533b-6ecd-4d2d-a966-a7b9568229a8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:41.927665 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10ef533b-6ecd-4d2d-a966-a7b9568229a8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:41.928367 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10ef533b-6ecd-4d2d-a966-a7b9568229a8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:41.932598 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10ef533b-6ecd-4d2d-a966-a7b9568229a8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:41.933995 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10ef533b-6ecd-4d2d-a966-a7b9568229a8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:42.234437 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-10ef533b-6ecd-4d2d-a966-a7b9568229a8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:42.260454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-10ef533b-6ecd-4d2d-a966-a7b9568229a8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:42.274982 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-10ef533b-6ecd-4d2d-a966-a7b9568229a8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:42.276499 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-10ef533b-6ecd-4d2d-a966-a7b9568229a8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.375779 Jun 16 14:47:42.278724 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 974/1933] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:41 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:42.285618 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d10af5ee-e6ac-46b6-9838-897432ae38fb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffbbc0d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:42.362001 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d10af5ee-e6ac-46b6-9838-897432ae38fb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.081696 Jun 16 14:47:42.363219 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 975/1934] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:42 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:42.368405 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6ec0c564-7db8-42c6-96ef-fdda033f31a8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:42.369057 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6ec0c564-7db8-42c6-96ef-fdda033f31a8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:42.376152 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6ec0c564-7db8-42c6-96ef-fdda033f31a8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:42.376945 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6ec0c564-7db8-42c6-96ef-fdda033f31a8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:42.377978 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6ec0c564-7db8-42c6-96ef-fdda033f31a8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:42.378746 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6ec0c564-7db8-42c6-96ef-fdda033f31a8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:42.713695 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6ec0c564-7db8-42c6-96ef-fdda033f31a8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:42.728195 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6ec0c564-7db8-42c6-96ef-fdda033f31a8 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1325 microversion: 2.1 time: 0.363635 Jun 16 14:47:42.732801 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 976/1935] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:42 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1325 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:42.743709 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e6302704-959a-43ad-893c-4e6471e0b4dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:42.745376 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e6302704-959a-43ad-893c-4e6471e0b4dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:42.763931 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6302704-959a-43ad-893c-4e6471e0b4dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:42.764826 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6302704-959a-43ad-893c-4e6471e0b4dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:42.766364 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6302704-959a-43ad-893c-4e6471e0b4dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:42.767408 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e6302704-959a-43ad-893c-4e6471e0b4dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:42.802296 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:43.112912 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e6302704-959a-43ad-893c-4e6471e0b4dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:43.147895 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e6302704-959a-43ad-893c-4e6471e0b4dd tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1469 microversion: 2.1 time: 0.411762 Jun 16 14:47:43.166563 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 977/1936] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:42 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1469 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:43.318524 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6a3bcd88-df2a-4e99-8b3a-00ff11a4f3f9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:43.323674 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6a3bcd88-df2a-4e99-8b3a-00ff11a4f3f9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:43.367880 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a3bcd88-df2a-4e99-8b3a-00ff11a4f3f9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:43.373495 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a3bcd88-df2a-4e99-8b3a-00ff11a4f3f9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:43.375591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a3bcd88-df2a-4e99-8b3a-00ff11a4f3f9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:43.380080 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a3bcd88-df2a-4e99-8b3a-00ff11a4f3f9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:43.455321 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:43.622653 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fcb79763-426c-41a6-ac1e-9a3ae1c75585 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:43.636974 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fcb79763-426c-41a6-ac1e-9a3ae1c75585 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1316 microversion: 2.1 time: 1.833465 Jun 16 14:47:43.637635 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 960/1937] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:41 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1316 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:43.662953 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-939abc1d-2238-49f2-a89d-1e392aed0084 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf111033a0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:43.750646 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6a3bcd88-df2a-4e99-8b3a-00ff11a4f3f9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:43.764638 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6a3bcd88-df2a-4e99-8b3a-00ff11a4f3f9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:43.767602 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6a3bcd88-df2a-4e99-8b3a-00ff11a4f3f9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:43.769275 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6a3bcd88-df2a-4e99-8b3a-00ff11a4f3f9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.464053 Jun 16 14:47:43.784237 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-939abc1d-2238-49f2-a89d-1e392aed0084 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.141819 Jun 16 14:47:43.790805 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 978/1938] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:43 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:43.794690 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 961/1939] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:43 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:43.801932 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c6e04911-f28c-4c75-a692-9309f8abb24a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:43.803247 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c6e04911-f28c-4c75-a692-9309f8abb24a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:43.814226 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c6e04911-f28c-4c75-a692-9309f8abb24a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:43.814226 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c6e04911-f28c-4c75-a692-9309f8abb24a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:43.815898 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c6e04911-f28c-4c75-a692-9309f8abb24a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:43.815898 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c6e04911-f28c-4c75-a692-9309f8abb24a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:44.113808 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c6e04911-f28c-4c75-a692-9309f8abb24a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:44.129103 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c6e04911-f28c-4c75-a692-9309f8abb24a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1325 microversion: 2.1 time: 0.334094 Jun 16 14:47:44.129738 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 979/1940] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:43 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1325 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:44.184032 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b3adf58e-73f7-4af8-83c4-eb9c95ddefde tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:44.189902 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b3adf58e-73f7-4af8-83c4-eb9c95ddefde tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:44.203940 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b3adf58e-73f7-4af8-83c4-eb9c95ddefde tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:44.204433 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b3adf58e-73f7-4af8-83c4-eb9c95ddefde tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:44.209021 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b3adf58e-73f7-4af8-83c4-eb9c95ddefde tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:44.209933 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b3adf58e-73f7-4af8-83c4-eb9c95ddefde tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:44.563721 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-62f29469-d142-46ea-93f2-ce659f43e382 req-381a981f-adc8-4e28-8e65-9deee21c697b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76875a5-11a5-4d7f-9db3-7a731c2589a1", "name": "network-vif-plugged", "status": "completed", "tag": "b6ac5e50-81ef-41de-8ac9-bed451827a4f"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:44.583087 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-62f29469-d142-46ea-93f2-ce659f43e382 req-381a981f-adc8-4e28-8e65-9deee21c697b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:44.584595 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-62f29469-d142-46ea-93f2-ce659f43e382 req-381a981f-adc8-4e28-8e65-9deee21c697b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:44.625492 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-62f29469-d142-46ea-93f2-ce659f43e382 req-381a981f-adc8-4e28-8e65-9deee21c697b service nova] Creating event network-vif-plugged:b6ac5e50-81ef-41de-8ac9-bed451827a4f for instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 on n-h2-836830-4 Jun 16 14:47:44.644022 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-62f29469-d142-46ea-93f2-ce659f43e382 req-381a981f-adc8-4e28-8e65-9deee21c697b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086576 Jun 16 14:47:44.647521 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 980/1941] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:47:44.661032 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-121fe98e-010e-4a2e-9912-101684e65082 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:44.666147 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-121fe98e-010e-4a2e-9912-101684e65082 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:44.681217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-121fe98e-010e-4a2e-9912-101684e65082 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:44.684831 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-121fe98e-010e-4a2e-9912-101684e65082 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:44.688928 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-121fe98e-010e-4a2e-9912-101684e65082 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:44.690431 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-121fe98e-010e-4a2e-9912-101684e65082 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:44.697963 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b3adf58e-73f7-4af8-83c4-eb9c95ddefde tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:44.713090 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b3adf58e-73f7-4af8-83c4-eb9c95ddefde tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1469 microversion: 2.1 time: 0.536260 Jun 16 14:47:44.716662 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 962/1942] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:44 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1469 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:44.796440 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8b0748ea-aaf4-4ecc-be64-0ebc513f10c1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:44.798031 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8b0748ea-aaf4-4ecc-be64-0ebc513f10c1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:44.815478 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8b0748ea-aaf4-4ecc-be64-0ebc513f10c1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:44.817369 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8b0748ea-aaf4-4ecc-be64-0ebc513f10c1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:44.819715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8b0748ea-aaf4-4ecc-be64-0ebc513f10c1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:44.824611 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8b0748ea-aaf4-4ecc-be64-0ebc513f10c1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:44.843540 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=8 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:44.974702 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-121fe98e-010e-4a2e-9912-101684e65082 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:44.988107 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-121fe98e-010e-4a2e-9912-101684e65082 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1316 microversion: 2.1 time: 0.337982 Jun 16 14:47:44.989409 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 981/1943] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:44 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:45.027999 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a4e76981-0982-411b-b17d-c65f84b5dd99 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffbeac10>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:45.129942 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a4e76981-0982-411b-b17d-c65f84b5dd99 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.138373 Jun 16 14:47:45.131934 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 982/1944] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:44 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:45.151182 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-839503d9-2548-4211-8240-ebb85733e260 req-bac1c567-3368-46a8-96fd-417bb71f05f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c77529a-f41c-4253-b703-8ef094f934f2", "name": "network-vif-unplugged", "status": "completed", "tag": "a569649a-653d-4712-9e65-932e9431dcd3"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:45.172364 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-839503d9-2548-4211-8240-ebb85733e260 req-bac1c567-3368-46a8-96fd-417bb71f05f9 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:45.173059 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-839503d9-2548-4211-8240-ebb85733e260 req-bac1c567-3368-46a8-96fd-417bb71f05f9 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:45.189722 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-839503d9-2548-4211-8240-ebb85733e260 req-bac1c567-3368-46a8-96fd-417bb71f05f9 service nova] Creating event network-vif-unplugged:a569649a-653d-4712-9e65-932e9431dcd3 for instance 2c77529a-f41c-4253-b703-8ef094f934f2 on n-h2-836830-4 Jun 16 14:47:45.198677 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-839503d9-2548-4211-8240-ebb85733e260 req-bac1c567-3368-46a8-96fd-417bb71f05f9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061633 Jun 16 14:47:45.200562 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 983/1945] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:45.206509 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f29d3d2a-0388-4283-85df-cfb1688495a1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:45.207348 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f29d3d2a-0388-4283-85df-cfb1688495a1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:45.215709 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f29d3d2a-0388-4283-85df-cfb1688495a1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:45.216151 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f29d3d2a-0388-4283-85df-cfb1688495a1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:45.217210 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f29d3d2a-0388-4283-85df-cfb1688495a1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:45.217672 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f29d3d2a-0388-4283-85df-cfb1688495a1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:45.537689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f29d3d2a-0388-4283-85df-cfb1688495a1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:45.568211 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f29d3d2a-0388-4283-85df-cfb1688495a1 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1325 microversion: 2.1 time: 0.365698 Jun 16 14:47:45.570138 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 984/1946] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:45 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1325 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:45.785380 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4f2c52e9-8b7e-40ef-b895-0e1031b342d1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:45.786265 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4f2c52e9-8b7e-40ef-b895-0e1031b342d1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:45.809536 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4f2c52e9-8b7e-40ef-b895-0e1031b342d1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:45.810254 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4f2c52e9-8b7e-40ef-b895-0e1031b342d1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:45.811372 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4f2c52e9-8b7e-40ef-b895-0e1031b342d1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:45.812128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4f2c52e9-8b7e-40ef-b895-0e1031b342d1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:46.043735 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8b0748ea-aaf4-4ecc-be64-0ebc513f10c1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:46.117103 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8b0748ea-aaf4-4ecc-be64-0ebc513f10c1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:46.120832 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8b0748ea-aaf4-4ecc-be64-0ebc513f10c1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:46.123720 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8b0748ea-aaf4-4ecc-be64-0ebc513f10c1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 1.334440 Jun 16 14:47:46.125499 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 963/1947] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:44 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:47:46.141192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d1afa440-5465-4dd3-aedc-be95d1e5309a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:46.143612 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d1afa440-5465-4dd3-aedc-be95d1e5309a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:46.159811 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d1afa440-5465-4dd3-aedc-be95d1e5309a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:46.161138 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d1afa440-5465-4dd3-aedc-be95d1e5309a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:46.164299 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d1afa440-5465-4dd3-aedc-be95d1e5309a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:46.166095 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d1afa440-5465-4dd3-aedc-be95d1e5309a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:46.266812 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-4f2c52e9-8b7e-40ef-b895-0e1031b342d1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:46.276670 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4f2c52e9-8b7e-40ef-b895-0e1031b342d1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1469 microversion: 2.1 time: 0.512779 Jun 16 14:47:46.287722 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 985/1948] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:45 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1469 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:46.293281 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b3a1e2b3-94b3-43f5-bd9e-e478af60cb5b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffb9f430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:46.466144 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b3a1e2b3-94b3-43f5-bd9e-e478af60cb5b tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.176959 Jun 16 14:47:46.467185 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 986/1949] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:46 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:46.593771 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5ec12f75-e9f9-4eb2-b37c-afa52d9fbbc5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:46.594894 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5ec12f75-e9f9-4eb2-b37c-afa52d9fbbc5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:46.627658 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5ec12f75-e9f9-4eb2-b37c-afa52d9fbbc5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:46.629010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5ec12f75-e9f9-4eb2-b37c-afa52d9fbbc5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:46.634261 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5ec12f75-e9f9-4eb2-b37c-afa52d9fbbc5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:46.638688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5ec12f75-e9f9-4eb2-b37c-afa52d9fbbc5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:46.979143 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5ec12f75-e9f9-4eb2-b37c-afa52d9fbbc5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:46.990993 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5ec12f75-e9f9-4eb2-b37c-afa52d9fbbc5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1325 microversion: 2.1 time: 0.403067 Jun 16 14:47:46.993170 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 987/1950] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:46 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1325 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:47:47.164869 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-817c08e6-5c21-49e2-8ce7-dc4362744061 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:47.166154 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-817c08e6-5c21-49e2-8ce7-dc4362744061 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:47.185591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-817c08e6-5c21-49e2-8ce7-dc4362744061 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:47.187319 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-817c08e6-5c21-49e2-8ce7-dc4362744061 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:47.190828 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-817c08e6-5c21-49e2-8ce7-dc4362744061 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:47.191472 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-817c08e6-5c21-49e2-8ce7-dc4362744061 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:47.342305 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d1afa440-5465-4dd3-aedc-be95d1e5309a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:47.417993 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d1afa440-5465-4dd3-aedc-be95d1e5309a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1466 microversion: 2.1 time: 1.289020 Jun 16 14:47:47.434864 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 964/1951] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:46 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1466 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:47.447914 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7a0c4d53-4eb9-4974-a5ce-5a4c719c7b73 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:47.457710 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7a0c4d53-4eb9-4974-a5ce-5a4c719c7b73 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:47.501079 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a0c4d53-4eb9-4974-a5ce-5a4c719c7b73 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:47.504923 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a0c4d53-4eb9-4974-a5ce-5a4c719c7b73 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:47.516055 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a0c4d53-4eb9-4974-a5ce-5a4c719c7b73 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:47.516892 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a0c4d53-4eb9-4974-a5ce-5a4c719c7b73 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:47.712977 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a0c4d53-4eb9-4974-a5ce-5a4c719c7b73 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:47.713690 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-817c08e6-5c21-49e2-8ce7-dc4362744061 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:47.722862 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a0c4d53-4eb9-4974-a5ce-5a4c719c7b73 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:47.725645 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-7a0c4d53-4eb9-4974-a5ce-5a4c719c7b73 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lazy-loading 'fault' on Instance uuid 5b2e2338-dec8-4753-a740-584fb8e9c439 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:47:47.781010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-817c08e6-5c21-49e2-8ce7-dc4362744061 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:47.807689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-817c08e6-5c21-49e2-8ce7-dc4362744061 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:47.817670 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-817c08e6-5c21-49e2-8ce7-dc4362744061 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.658048 Jun 16 14:47:47.825309 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 988/1952] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:47 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:47.883431 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-2be2452c-d1b9-4403-bfb2-eecb0d7b61e7 req-27a5e4d5-ca66-491c-8ccf-5a4d1dc8c154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2e2338-dec8-4753-a740-584fb8e9c439", "name": "network-vif-deleted", "tag": "91c43310-3cd5-422d-9c57-aa5e15664ff8"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:47.982921 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-2be2452c-d1b9-4403-bfb2-eecb0d7b61e7 req-27a5e4d5-ca66-491c-8ccf-5a4d1dc8c154 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:47.984128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-2be2452c-d1b9-4403-bfb2-eecb0d7b61e7 req-27a5e4d5-ca66-491c-8ccf-5a4d1dc8c154 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:48.077578 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-2be2452c-d1b9-4403-bfb2-eecb0d7b61e7 req-27a5e4d5-ca66-491c-8ccf-5a4d1dc8c154 service nova] Creating event network-vif-deleted:91c43310-3cd5-422d-9c57-aa5e15664ff8 for instance 5b2e2338-dec8-4753-a740-584fb8e9c439 on n-h2-836830-4 Jun 16 14:47:48.109129 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-2be2452c-d1b9-4403-bfb2-eecb0d7b61e7 req-27a5e4d5-ca66-491c-8ccf-5a4d1dc8c154 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275223 Jun 16 14:47:48.114275 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 989/1953] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:48.141080 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-af742c2c-be88-41bd-85a8-4cb3cee9dda2 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:48.141836 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-af742c2c-be88-41bd-85a8-4cb3cee9dda2 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:48.162501 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af742c2c-be88-41bd-85a8-4cb3cee9dda2 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:48.164042 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af742c2c-be88-41bd-85a8-4cb3cee9dda2 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:48.165067 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af742c2c-be88-41bd-85a8-4cb3cee9dda2 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:48.166855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-af742c2c-be88-41bd-85a8-4cb3cee9dda2 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:48.198798 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7a0c4d53-4eb9-4974-a5ce-5a4c719c7b73 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:48.224553 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7a0c4d53-4eb9-4974-a5ce-5a4c719c7b73 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 200 len: 1303 microversion: 2.1 time: 0.786627 Jun 16 14:47:48.250930 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 965/1954] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:47 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 1303 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:48.300534 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1b40ea55-c7cd-453d-a127-4527f5d2b2b9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf110b01f0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:48.449074 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1b40ea55-c7cd-453d-a127-4527f5d2b2b9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.193660 Jun 16 14:47:48.451092 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 966/1955] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:48 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:48.465343 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0d250c88-8407-490c-a21c-2b2a5eb942a5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:48.466588 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0d250c88-8407-490c-a21c-2b2a5eb942a5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:48.476575 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0d250c88-8407-490c-a21c-2b2a5eb942a5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:48.477367 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0d250c88-8407-490c-a21c-2b2a5eb942a5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:48.479299 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0d250c88-8407-490c-a21c-2b2a5eb942a5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:48.481398 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0d250c88-8407-490c-a21c-2b2a5eb942a5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:48.653912 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-af742c2c-be88-41bd-85a8-4cb3cee9dda2 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1617 microversion: 2.1 time: 0.530628 Jun 16 14:47:48.679417 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 990/1956] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:48 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1617 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:49.131763 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7f386d43-740e-433f-9ff1-1e01194f7b28 tempest-FloatingIPsNegativeTestJSON-1889125653 tempest-FloatingIPsNegativeTestJSON-1889125653-project] Calling method '.version_select at 0x7fdeffbfa310>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:49.238987 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7f386d43-740e-433f-9ff1-1e01194f7b28 tempest-FloatingIPsNegativeTestJSON-1889125653 tempest-FloatingIPsNegativeTestJSON-1889125653-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.558465 Jun 16 14:47:49.239868 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 991/1957] 10.222.0.57 () {58 vars in 1148 bytes} [Thu Jun 16 14:47:48 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:47:49.254055 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a7189ac2-fc4e-499c-8845-2ca4d81fd001 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:49.257950 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a7189ac2-fc4e-499c-8845-2ca4d81fd001 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:49.282571 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a7189ac2-fc4e-499c-8845-2ca4d81fd001 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:49.283696 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a7189ac2-fc4e-499c-8845-2ca4d81fd001 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:49.285312 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a7189ac2-fc4e-499c-8845-2ca4d81fd001 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:49.286128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a7189ac2-fc4e-499c-8845-2ca4d81fd001 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:49.434997 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0d250c88-8407-490c-a21c-2b2a5eb942a5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:49.461096 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0d250c88-8407-490c-a21c-2b2a5eb942a5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1325 microversion: 2.1 time: 0.998516 Jun 16 14:47:49.476010 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 967/1958] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:48 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1325 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:49.488588 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1348671999", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc"]}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:49.539419 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a7189ac2-fc4e-499c-8845-2ca4d81fd001 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:49.551822 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a7189ac2-fc4e-499c-8845-2ca4d81fd001 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:49.553728 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a7189ac2-fc4e-499c-8845-2ca4d81fd001 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:49.555430 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a7189ac2-fc4e-499c-8845-2ca4d81fd001 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.305873 Jun 16 14:47:49.568249 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 992/1959] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:49 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:49.574446 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8d6e10ac-104a-4e3c-9180-cc8317593bb4 tempest-FloatingIPsNegativeTestJSON-1889125653 tempest-FloatingIPsNegativeTestJSON-1889125653-project] Action: 'create', calling method: .version_select at 0x7fdeffb3f820>, body: {"pool": "non_exist_pool"} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:49.617515 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-8d6e10ac-104a-4e3c-9180-cc8317593bb4 tempest-FloatingIPsNegativeTestJSON-1889125653 tempest-FloatingIPsNegativeTestJSON-1889125653-project] HTTP exception thrown: Floating IP pool not found. Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8d6e10ac-104a-4e3c-9180-cc8317593bb4 tempest-FloatingIPsNegativeTestJSON-1889125653 tempest-FloatingIPsNegativeTestJSON-1889125653-project] Request method failure captured: Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 26 Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0KTWtJAo3pwtLR72Jpr0AYiwP2akyUhYpdMiyhU-2XEfeyk3jbcvainkeERV7IhK17PU4rhAnKosGA6HUZ9yF5hIkMDa8xAn6SBpbfq6DRC4LYFEpBK94_dvZ8PGdVjXJRSEMUKJGkelasMGf9tWFcoctwhRW-MMcjCprfU2wB4ACU Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: c18e561f3b0d4c57b58f4b1c86205407 Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1889125653 Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:47:49.620295 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:47:49.624354 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c18e561f3b0d4c57b58f4b1c86205407", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c18e561f3b0d4c57b58f4b1c86205407"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c18e561f3b0d4c57b58f4b1c86205407"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c18e561f3b0d4c57b58f4b1c86205407"}]}] Jun 16 14:47:49.624354 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1889125653 Jun 16 14:47:49.624354 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: c18e561f3b0d4c57b58f4b1c86205407 Jun 16 14:47:49.624354 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1889125653 Jun 16 14:47:49.624354 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-FloatingIPsNegativeTestJSON-1889125653-project Jun 16 14:47:49.624354 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:47:49.624354 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:47:49.624354 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: b57129f7c2ed496b84e05c8b8c694bf1 Jun 16 14:47:49.624354 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1889125653-project Jun 16 14:47:49.624354 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:47:49.624354 n-d-836830-4 devstack@n-api.service[125862]: {"pool": "non_exist_pool"} Jun 16 14:47:49.624354 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:47:49.624354 n-d-836830-4 devstack@n-api.service[125862]: exception: Floating IP pool not found. Jun 16 14:47:49.624354 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'body': {'pool': 'non_exist_pool'}} Jun 16 14:47:49.624354 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:47:49.626782 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:47:49.630135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jun 16 14:47:49.630135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:47:49.630135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jun 16 14:47:49.630135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.630135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:49.630135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.630135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:49.630135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:49.630135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:49.630135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:47:49.630135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:47:49.630135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jun 16 14:47:49.630135 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.630135 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8d6e10ac-104a-4e3c-9180-cc8317593bb4 tempest-FloatingIPsNegativeTestJSON-1889125653 tempest-FloatingIPsNegativeTestJSON-1889125653-project] Returning 404 to user: Floating IP pool not found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:47:49.630135 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8d6e10ac-104a-4e3c-9180-cc8317593bb4 tempest-FloatingIPsNegativeTestJSON-1889125653 tempest-FloatingIPsNegativeTestJSON-1889125653-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.053835 Jun 16 14:47:49.632567 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 993/1960] 10.222.0.57 () {60 vars in 1169 bytes} [Thu Jun 16 14:47:49 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:47:49.634423 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:47:49.638418 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a1020b7d-63a8-4c0d-9ff0-d836e658073f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:49.638418 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a1020b7d-63a8-4c0d-9ff0-d836e658073f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: 5b2e2338-dec8-4753-a740-584fb8e9c439] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:49.646007 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a1020b7d-63a8-4c0d-9ff0-d836e658073f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:49.646514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a1020b7d-63a8-4c0d-9ff0-d836e658073f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:49.647353 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a1020b7d-63a8-4c0d-9ff0-d836e658073f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:49.647824 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a1020b7d-63a8-4c0d-9ff0-d836e658073f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:49.683262 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-a1020b7d-63a8-4c0d-9ff0-d836e658073f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] HTTP exception thrown: Instance 5b2e2338-dec8-4753-a740-584fb8e9c439 could not be found. Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a1020b7d-63a8-4c0d-9ff0-d836e658073f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Request method failure captured: Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 HTTP/1.1 Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0DXFE8Vor5JLcZPE8OkQrI7LMkkoLVBI_0QSqbQpJMs4ma6obpXvLHzIvNHgOpAEXnbsibN4JdFNbYy2-56jTMWA8UuZ6fEAYyg_21_ElPANICJZlrWgGH4lnc0UOaWuCZvK7JS8SDd0o3nBkraCiM71vT5xBbdKpdc1w4yk9W6TDM Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 414e3b792647435daa2ecce22a2c6132 Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-MigrationsAdminTest-570114701 Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:47:49.685360 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:47:49.689121 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_414e3b792647435daa2ecce22a2c6132", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/414e3b792647435daa2ecce22a2c6132"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/414e3b792647435daa2ecce22a2c6132"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/414e3b792647435daa2ecce22a2c6132"}]}] Jun 16 14:47:49.689121 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-MigrationsAdminTest-570114701 Jun 16 14:47:49.689121 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 414e3b792647435daa2ecce22a2c6132 Jun 16 14:47:49.689121 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-MigrationsAdminTest-570114701 Jun 16 14:47:49.689121 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-MigrationsAdminTest-570114701-project Jun 16 14:47:49.689121 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:47:49.689121 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:47:49.689121 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 65cde69f3b52448c8b08297b548bb377 Jun 16 14:47:49.689121 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-MigrationsAdminTest-570114701-project Jun 16 14:47:49.689121 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:47:49.689121 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 5b2e2338-dec8-4753-a740-584fb8e9c439 could not be found. Jun 16 14:47:49.689121 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '5b2e2338-dec8-4753-a740-584fb8e9c439'} Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b2e2338-dec8-4753-a740-584fb8e9c439 could not be found. Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:47:49.690919 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b2e2338-dec8-4753-a740-584fb8e9c439 could not be found. Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b2e2338-dec8-4753-a740-584fb8e9c439 could not be found. Jun 16 14:47:49.693833 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.697019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a1020b7d-63a8-4c0d-9ff0-d836e658073f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Returning 404 to user: Instance 5b2e2338-dec8-4753-a740-584fb8e9c439 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:47:49.697019 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a1020b7d-63a8-4c0d-9ff0-d836e658073f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439" status: 404 len: 111 microversion: 2.1 time: 0.057147 Jun 16 14:47:49.697019 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 994/1961] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:49 2022] GET /compute/v2.1/servers/5b2e2338-dec8-4753-a740-584fb8e9c439 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:47:49.697019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1715f921-7017-4cd6-9397-4ddde502c3cc tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffb5ec10>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:49.767725 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1715f921-7017-4cd6-9397-4ddde502c3cc tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.078014 Jun 16 14:47:49.779849 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 995/1962] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:49 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:49.790973 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6dd835a2-8b5a-496e-9a1f-e3b61c2364a1 tempest-FloatingIPsNegativeTestJSON-1889125653 tempest-FloatingIPsNegativeTestJSON-1889125653-project] Calling method '.version_select at 0x7fdeffb5e670>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:49.891589 n-d-836830-4 devstack@n-api.service[125862]: DEBUG neutronclient.v2_0.client [None req-6dd835a2-8b5a-496e-9a1f-e3b61c2364a1 tempest-FloatingIPsNegativeTestJSON-1889125653 tempest-FloatingIPsNegativeTestJSON-1889125653-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3c63b31f-abfc-4b22-b57c-80f0fb9d98c1 could not be found", "detail": ""}} {{(pid=125862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:47:49.892309 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-6dd835a2-8b5a-496e-9a1f-e3b61c2364a1 tempest-FloatingIPsNegativeTestJSON-1889125653 tempest-FloatingIPsNegativeTestJSON-1889125653-project] HTTP exception thrown: Floating IP not found for ID 3c63b31f-abfc-4b22-b57c-80f0fb9d98c1 Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6dd835a2-8b5a-496e-9a1f-e3b61c2364a1 tempest-FloatingIPsNegativeTestJSON-1889125653 tempest-FloatingIPsNegativeTestJSON-1889125653-project] Request method failure captured: Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/os-floating-ips/3c63b31f-abfc-4b22-b57c-80f0fb9d98c1 HTTP/1.1 Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0KTWtJAo3pwtLR72Jpr0AYiwP2akyUhYpdMiyhU-2XEfeyk3jbcvainkeERV7IhK17PU4rhAnKosGA6HUZ9yF5hIkMDa8xAn6SBpbfq6DRC4LYFEpBK94_dvZ8PGdVjXJRSEMUKJGkelasMGf9tWFcoctwhRW-MMcjCprfU2wB4ACU Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: c18e561f3b0d4c57b58f4b1c86205407 Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1889125653 Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:47:49.895095 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:47:49.898269 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c18e561f3b0d4c57b58f4b1c86205407", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c18e561f3b0d4c57b58f4b1c86205407"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c18e561f3b0d4c57b58f4b1c86205407"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c18e561f3b0d4c57b58f4b1c86205407"}]}] Jun 16 14:47:49.898269 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1889125653 Jun 16 14:47:49.898269 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: c18e561f3b0d4c57b58f4b1c86205407 Jun 16 14:47:49.898269 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1889125653 Jun 16 14:47:49.898269 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-FloatingIPsNegativeTestJSON-1889125653-project Jun 16 14:47:49.898269 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:47:49.898269 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:47:49.898269 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: b57129f7c2ed496b84e05c8b8c694bf1 Jun 16 14:47:49.898269 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1889125653-project Jun 16 14:47:49.898269 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:47:49.898269 n-d-836830-4 devstack@n-api.service[125862]: exception: Floating IP not found for ID 3c63b31f-abfc-4b22-b57c-80f0fb9d98c1 Jun 16 14:47:49.898269 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '3c63b31f-abfc-4b22-b57c-80f0fb9d98c1'} Jun 16 14:47:49.898269 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:47:49.900010 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3c63b31f-abfc-4b22-b57c-80f0fb9d98c1 could not be found Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b0c3c17-0d9b-4837-a260-989feacfb03c'] Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3c63b31f-abfc-4b22-b57c-80f0fb9d98c1. Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:49.911558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3c63b31f-abfc-4b22-b57c-80f0fb9d98c1 Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:47:49.919366 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:47:49.924332 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3c63b31f-abfc-4b22-b57c-80f0fb9d98c1 Jun 16 14:47:49.924332 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:49.924332 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6dd835a2-8b5a-496e-9a1f-e3b61c2364a1 tempest-FloatingIPsNegativeTestJSON-1889125653 tempest-FloatingIPsNegativeTestJSON-1889125653-project] Returning 404 to user: Floating IP not found for ID 3c63b31f-abfc-4b22-b57c-80f0fb9d98c1 {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:47:49.924332 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6dd835a2-8b5a-496e-9a1f-e3b61c2364a1 tempest-FloatingIPsNegativeTestJSON-1889125653 tempest-FloatingIPsNegativeTestJSON-1889125653-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/3c63b31f-abfc-4b22-b57c-80f0fb9d98c1" status: 404 len: 111 microversion: 2.1 time: 0.118111 Jun 16 14:47:49.924332 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 996/1963] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jun 16 14:47:49 2022] DELETE /compute/v2.1/os-floating-ips/3c63b31f-abfc-4b22-b57c-80f0fb9d98c1 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:47:49.924332 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-664889b8-faa0-45cd-8866-608e3da1e602 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:49.925716 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-664889b8-faa0-45cd-8866-608e3da1e602 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:49.932530 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-664889b8-faa0-45cd-8866-608e3da1e602 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:49.933070 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-664889b8-faa0-45cd-8866-608e3da1e602 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:49.935411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-664889b8-faa0-45cd-8866-608e3da1e602 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:49.935881 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-664889b8-faa0-45cd-8866-608e3da1e602 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:49.976437 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-664889b8-faa0-45cd-8866-608e3da1e602 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:47:50.128134 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-664889b8-faa0-45cd-8866-608e3da1e602 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 204 len: 0 microversion: 2.1 time: 0.222954 Jun 16 14:47:50.133725 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 997/1964] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:47:49 2022] DELETE /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:47:50.142750 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-72f4ffde-b084-47f3-a837-81832549398b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:50.144372 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-72f4ffde-b084-47f3-a837-81832549398b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:50.152934 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-72f4ffde-b084-47f3-a837-81832549398b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:50.153555 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-72f4ffde-b084-47f3-a837-81832549398b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:50.156474 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-72f4ffde-b084-47f3-a837-81832549398b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:50.157117 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-72f4ffde-b084-47f3-a837-81832549398b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:50.414624 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-72f4ffde-b084-47f3-a837-81832549398b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:50.426256 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-72f4ffde-b084-47f3-a837-81832549398b tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1469 microversion: 2.1 time: 0.290064 Jun 16 14:47:50.427020 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 998/1965] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:50 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1469 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:50.445629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-e2ab2649-04e0-425a-95c7-1bfd0a962fc2 req-eaa58895-9696-43de-9e97-2b26f7d88125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c77529a-f41c-4253-b703-8ef094f934f2", "tag": "a569649a-653d-4712-9e65-932e9431dcd3"}, {"name": "network-changed", "server_uuid": "60fff8da-3571-43cc-b8cf-448588a42929", "tag": "9b4f163d-66bc-44e4-9a13-6550ecad517d"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:50.480677 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-e2ab2649-04e0-425a-95c7-1bfd0a962fc2 req-eaa58895-9696-43de-9e97-2b26f7d88125 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:50.481627 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-e2ab2649-04e0-425a-95c7-1bfd0a962fc2 req-eaa58895-9696-43de-9e97-2b26f7d88125 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:50.513069 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-e2ab2649-04e0-425a-95c7-1bfd0a962fc2 req-eaa58895-9696-43de-9e97-2b26f7d88125 service nova] Creating event network-changed:a569649a-653d-4712-9e65-932e9431dcd3 for instance 2c77529a-f41c-4253-b703-8ef094f934f2 on n-h2-836830-4 Jun 16 14:47:50.518864 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-e2ab2649-04e0-425a-95c7-1bfd0a962fc2 req-eaa58895-9696-43de-9e97-2b26f7d88125 service nova] Creating event network-changed:9b4f163d-66bc-44e4-9a13-6550ecad517d for instance 60fff8da-3571-43cc-b8cf-448588a42929 on n-h2-836830-4 Jun 16 14:47:50.536070 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-e2ab2649-04e0-425a-95c7-1bfd0a962fc2 req-eaa58895-9696-43de-9e97-2b26f7d88125 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096537 Jun 16 14:47:50.539299 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 999/1966] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:50.553230 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9eb352cf-fe20-4d74-adcd-bb099edbcfbe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:50.555864 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9eb352cf-fe20-4d74-adcd-bb099edbcfbe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:50.569992 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9eb352cf-fe20-4d74-adcd-bb099edbcfbe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:50.572440 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9eb352cf-fe20-4d74-adcd-bb099edbcfbe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:50.575558 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9eb352cf-fe20-4d74-adcd-bb099edbcfbe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:50.577199 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9eb352cf-fe20-4d74-adcd-bb099edbcfbe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:50.980069 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9eb352cf-fe20-4d74-adcd-bb099edbcfbe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:50.991000 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9eb352cf-fe20-4d74-adcd-bb099edbcfbe tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1325 microversion: 2.1 time: 0.446776 Jun 16 14:47:51.005165 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1000/1967] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:50 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1325 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:51.007932 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2451056a-3509-48ff-8d02-1da4b8f05c17 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:51.008734 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2451056a-3509-48ff-8d02-1da4b8f05c17 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:51.038546 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2451056a-3509-48ff-8d02-1da4b8f05c17 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:51.039564 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2451056a-3509-48ff-8d02-1da4b8f05c17 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:51.041448 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2451056a-3509-48ff-8d02-1da4b8f05c17 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:51.042518 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2451056a-3509-48ff-8d02-1da4b8f05c17 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:51.228981 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:47:51.232154 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:47:51.233622 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:47:51.235269 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:47:51.243486 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:47:51.282866 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:51.284107 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:51.286086 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:51.291654 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:51.349146 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:47:51.362949 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:47:51.399733 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:47:51.405831 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:47:51.469274 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2451056a-3509-48ff-8d02-1da4b8f05c17 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:51.491181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:51.507978 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2451056a-3509-48ff-8d02-1da4b8f05c17 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:51.512665 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2451056a-3509-48ff-8d02-1da4b8f05c17 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:51.517449 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2451056a-3509-48ff-8d02-1da4b8f05c17 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.511966 Jun 16 14:47:51.521606 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1001/1968] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:51 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:51.539146 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b8911637-befa-41ea-bed2-2d51a49ec7d9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffbbce50>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:51.618768 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-39a076b1-c692-457a-9d45-7f091871690a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.140936 Jun 16 14:47:51.624601 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 968/1969] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:47:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:47:51.639106 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-90f8a729-b8b6-43c6-bdcb-68fde920eec1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:51.647487 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-90f8a729-b8b6-43c6-bdcb-68fde920eec1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:51.663022 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-90f8a729-b8b6-43c6-bdcb-68fde920eec1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:51.664624 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-90f8a729-b8b6-43c6-bdcb-68fde920eec1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:51.666765 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-90f8a729-b8b6-43c6-bdcb-68fde920eec1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:51.669581 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-90f8a729-b8b6-43c6-bdcb-68fde920eec1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:51.719806 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b8911637-befa-41ea-bed2-2d51a49ec7d9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.181473 Jun 16 14:47:51.736297 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1002/1970] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:51 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:51.766624 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-979973ca-3045-465a-a222-bf723b5e0469 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:51.768686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-979973ca-3045-465a-a222-bf723b5e0469 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:52.020718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-979973ca-3045-465a-a222-bf723b5e0469 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:52.102352 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-979973ca-3045-465a-a222-bf723b5e0469 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1217 microversion: 2.1 time: 0.351749 Jun 16 14:47:52.105361 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1003/1971] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:51 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1217 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:52.134203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fc7d6cfb-1cf8-49f6-bea9-204071e1ab68 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:52.135632 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fc7d6cfb-1cf8-49f6-bea9-204071e1ab68 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:52.173676 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fc7d6cfb-1cf8-49f6-bea9-204071e1ab68 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:52.174179 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fc7d6cfb-1cf8-49f6-bea9-204071e1ab68 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:52.178459 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fc7d6cfb-1cf8-49f6-bea9-204071e1ab68 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:52.178903 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fc7d6cfb-1cf8-49f6-bea9-204071e1ab68 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:52.554224 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fc7d6cfb-1cf8-49f6-bea9-204071e1ab68 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:52.573731 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fc7d6cfb-1cf8-49f6-bea9-204071e1ab68 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1325 microversion: 2.1 time: 0.464317 Jun 16 14:47:52.586560 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1004/1972] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:52 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1325 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:52.594635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-60d83805-f773-4e18-b2c3-e71c3eed5dbf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:52.595652 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-60d83805-f773-4e18-b2c3-e71c3eed5dbf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:52.603783 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-60d83805-f773-4e18-b2c3-e71c3eed5dbf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:52.604983 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-60d83805-f773-4e18-b2c3-e71c3eed5dbf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:52.607786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-60d83805-f773-4e18-b2c3-e71c3eed5dbf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:52.608940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-60d83805-f773-4e18-b2c3-e71c3eed5dbf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:53.022437 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-60d83805-f773-4e18-b2c3-e71c3eed5dbf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:53.042410 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-60d83805-f773-4e18-b2c3-e71c3eed5dbf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:53.046593 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-60d83805-f773-4e18-b2c3-e71c3eed5dbf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:53.052440 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-60d83805-f773-4e18-b2c3-e71c3eed5dbf tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.464208 Jun 16 14:47:53.065303 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1005/1973] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:52 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:53.087022 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f6826086-a8e1-4e8e-9dc0-8ea88e455733 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffb31790>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:53.223863 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f6826086-a8e1-4e8e-9dc0-8ea88e455733 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.163423 Jun 16 14:47:53.228433 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1006/1974] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:53 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:53.260511 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-47e114c5-3094-49c3-87e4-c219294bbc38 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:53.262724 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-47e114c5-3094-49c3-87e4-c219294bbc38 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:53.276565 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-47e114c5-3094-49c3-87e4-c219294bbc38 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:53.278229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-47e114c5-3094-49c3-87e4-c219294bbc38 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:53.280091 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-47e114c5-3094-49c3-87e4-c219294bbc38 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:53.280971 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-47e114c5-3094-49c3-87e4-c219294bbc38 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:53.427242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-47e114c5-3094-49c3-87e4-c219294bbc38 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:53.447870 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-47e114c5-3094-49c3-87e4-c219294bbc38 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1213 microversion: 2.1 time: 0.217132 Jun 16 14:47:53.451810 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1007/1975] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:53 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1213 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:53.475047 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-90f8a729-b8b6-43c6-bdcb-68fde920eec1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:53.490790 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-90f8a729-b8b6-43c6-bdcb-68fde920eec1 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1469 microversion: 2.1 time: 1.859066 Jun 16 14:47:53.494944 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 969/1976] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:51 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1469 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:53.601316 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-35a9f750-fa85-4d94-ac80-4048e5bf4f2a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:53.603067 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-35a9f750-fa85-4d94-ac80-4048e5bf4f2a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:53.619743 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35a9f750-fa85-4d94-ac80-4048e5bf4f2a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:53.621584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35a9f750-fa85-4d94-ac80-4048e5bf4f2a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:53.623538 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35a9f750-fa85-4d94-ac80-4048e5bf4f2a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:53.624486 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35a9f750-fa85-4d94-ac80-4048e5bf4f2a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:54.037771 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-35a9f750-fa85-4d94-ac80-4048e5bf4f2a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:54.070020 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-35a9f750-fa85-4d94-ac80-4048e5bf4f2a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1325 microversion: 2.1 time: 0.479975 Jun 16 14:47:54.078697 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f0186dac-35ec-4aa5-8df5-5bbc245701eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:54.079626 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f0186dac-35ec-4aa5-8df5-5bbc245701eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:54.086639 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1008/1977] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:53 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1325 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:54.095775 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f0186dac-35ec-4aa5-8df5-5bbc245701eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:54.096430 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f0186dac-35ec-4aa5-8df5-5bbc245701eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:54.097363 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f0186dac-35ec-4aa5-8df5-5bbc245701eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:54.100345 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f0186dac-35ec-4aa5-8df5-5bbc245701eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:54.250007 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-78446c59-53b5-4778-9d68-435d3128c213 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffb31430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:54.380642 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-78446c59-53b5-4778-9d68-435d3128c213 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.136761 Jun 16 14:47:54.382065 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1009/1978] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:54 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:54.473034 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ffa0290f-c599-48da-8c33-a52b991e882b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:54.474855 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ffa0290f-c599-48da-8c33-a52b991e882b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:54.502433 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffa0290f-c599-48da-8c33-a52b991e882b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:54.503667 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffa0290f-c599-48da-8c33-a52b991e882b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:54.507665 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffa0290f-c599-48da-8c33-a52b991e882b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:54.509610 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffa0290f-c599-48da-8c33-a52b991e882b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:54.697959 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ffa0290f-c599-48da-8c33-a52b991e882b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:54.729146 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ffa0290f-c599-48da-8c33-a52b991e882b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1275 microversion: 2.1 time: 0.260852 Jun 16 14:47:54.735881 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1010/1979] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:54 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1275 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:47:54.752588 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3d846ec7-4df4-4656-85ac-1006f82f4cd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:54.756670 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3d846ec7-4df4-4656-85ac-1006f82f4cd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:54.780214 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d846ec7-4df4-4656-85ac-1006f82f4cd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:54.783036 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d846ec7-4df4-4656-85ac-1006f82f4cd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:54.785994 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d846ec7-4df4-4656-85ac-1006f82f4cd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:54.790004 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d846ec7-4df4-4656-85ac-1006f82f4cd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:54.813016 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f0186dac-35ec-4aa5-8df5-5bbc245701eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:54.831493 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f0186dac-35ec-4aa5-8df5-5bbc245701eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:54.833186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f0186dac-35ec-4aa5-8df5-5bbc245701eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:54.841471 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f0186dac-35ec-4aa5-8df5-5bbc245701eb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.767939 Jun 16 14:47:54.854943 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 970/1980] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:54 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:54.995400 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-37636de1-2dd1-4844-a894-b35185ee19ea req-259c68af-0f1b-4e89-85a4-8c40c395de82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e428ca7a-f7f8-4dff-a272-52fb03083fd2", "name": "network-vif-unplugged", "status": "completed", "tag": "e583603f-657e-4f58-aa10-f2482dfad9de"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:55.048578 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-37636de1-2dd1-4844-a894-b35185ee19ea req-259c68af-0f1b-4e89-85a4-8c40c395de82 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:55.049215 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-37636de1-2dd1-4844-a894-b35185ee19ea req-259c68af-0f1b-4e89-85a4-8c40c395de82 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:55.142838 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-37636de1-2dd1-4844-a894-b35185ee19ea req-259c68af-0f1b-4e89-85a4-8c40c395de82 service nova] Creating event network-vif-unplugged:e583603f-657e-4f58-aa10-f2482dfad9de for instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 on n-h2-836830-4 Jun 16 14:47:55.163232 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-37636de1-2dd1-4844-a894-b35185ee19ea req-259c68af-0f1b-4e89-85a4-8c40c395de82 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.182819 Jun 16 14:47:55.167701 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 971/1981] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:47:55.190814 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e01c93f5-be32-486e-abe7-2d1afd7cd565 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:55.201359 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e01c93f5-be32-486e-abe7-2d1afd7cd565 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:55.243579 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e01c93f5-be32-486e-abe7-2d1afd7cd565 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:55.247075 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e01c93f5-be32-486e-abe7-2d1afd7cd565 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:55.252279 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e01c93f5-be32-486e-abe7-2d1afd7cd565 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:55.255943 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e01c93f5-be32-486e-abe7-2d1afd7cd565 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:55.372087 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3d846ec7-4df4-4656-85ac-1006f82f4cd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:55.423544 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3d846ec7-4df4-4656-85ac-1006f82f4cd8 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1469 microversion: 2.1 time: 0.684334 Jun 16 14:47:55.445955 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1011/1982] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:54 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1469 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:55.466678 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3fc84e02-2b3d-46c1-8622-f545b6ef45e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffbfa310>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:55.647759 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3fc84e02-2b3d-46c1-8622-f545b6ef45e9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.209625 Jun 16 14:47:55.655496 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1012/1983] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:55 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:55.756834 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-843f5d28-4b41-4283-8351-6e0384ceb0e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:55.760074 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-843f5d28-4b41-4283-8351-6e0384ceb0e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:55.820744 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-843f5d28-4b41-4283-8351-6e0384ceb0e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:55.826273 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-843f5d28-4b41-4283-8351-6e0384ceb0e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:55.829365 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-843f5d28-4b41-4283-8351-6e0384ceb0e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:55.838665 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-843f5d28-4b41-4283-8351-6e0384ceb0e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:56.126901 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-843f5d28-4b41-4283-8351-6e0384ceb0e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:56.147381 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-843f5d28-4b41-4283-8351-6e0384ceb0e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1275 microversion: 2.1 time: 0.398013 Jun 16 14:47:56.159645 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1013/1984] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:55 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1275 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:56.182693 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-be59c17c-147d-4658-8872-adea278188b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:56.192524 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-be59c17c-147d-4658-8872-adea278188b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:56.212883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be59c17c-147d-4658-8872-adea278188b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:56.213933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be59c17c-147d-4658-8872-adea278188b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:56.216015 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be59c17c-147d-4658-8872-adea278188b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:56.217021 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be59c17c-147d-4658-8872-adea278188b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:56.812014 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-be59c17c-147d-4658-8872-adea278188b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:56.845288 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-be59c17c-147d-4658-8872-adea278188b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:56.852459 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-be59c17c-147d-4658-8872-adea278188b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:56.859607 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-be59c17c-147d-4658-8872-adea278188b0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.695140 Jun 16 14:47:56.864552 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1014/1985] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:56 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:56.879992 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-39ed2d8c-55bd-4238-bbe4-40ee17e20c4f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:56.884390 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-39ed2d8c-55bd-4238-bbe4-40ee17e20c4f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:56.903957 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39ed2d8c-55bd-4238-bbe4-40ee17e20c4f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:56.906412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39ed2d8c-55bd-4238-bbe4-40ee17e20c4f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:56.912839 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39ed2d8c-55bd-4238-bbe4-40ee17e20c4f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:56.928300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e01c93f5-be32-486e-abe7-2d1afd7cd565 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:56.929338 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39ed2d8c-55bd-4238-bbe4-40ee17e20c4f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:56.961189 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e01c93f5-be32-486e-abe7-2d1afd7cd565 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1325 microversion: 2.1 time: 1.789464 Jun 16 14:47:56.963375 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 972/1986] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:55 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1325 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:56.988734 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b9fb2c1f-b131-4496-8319-38257cca7a4f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffe718b0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:57.151756 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-39ed2d8c-55bd-4238-bbe4-40ee17e20c4f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65cde69f3b52448c8b08297b548bb377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '414e3b792647435daa2ecce22a2c6132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:57.153809 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b9fb2c1f-b131-4496-8319-38257cca7a4f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.185383 Jun 16 14:47:57.156993 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 973/1987] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:56 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:57.171668 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-39ed2d8c-55bd-4238-bbe4-40ee17e20c4f tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 200 len: 1427 microversion: 2.1 time: 0.304795 Jun 16 14:47:57.173019 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1015/1988] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:56 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 1427 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:57.197101 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-262e2aaa-efc1-4547-a747-d6684002580f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:57.200396 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-262e2aaa-efc1-4547-a747-d6684002580f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:57.249176 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-07fbac88-029d-4eb8-a4c9-aa297ee3d15f req-bfadc9b3-8767-4931-bdd4-c0a4f360622c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c77529a-f41c-4253-b703-8ef094f934f2", "name": "network-vif-unplugged", "status": "completed", "tag": "a569649a-653d-4712-9e65-932e9431dcd3"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:57.273230 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-262e2aaa-efc1-4547-a747-d6684002580f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:57.274060 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-262e2aaa-efc1-4547-a747-d6684002580f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:57.280330 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-262e2aaa-efc1-4547-a747-d6684002580f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:57.280871 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-262e2aaa-efc1-4547-a747-d6684002580f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:57.287918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-07fbac88-029d-4eb8-a4c9-aa297ee3d15f req-bfadc9b3-8767-4931-bdd4-c0a4f360622c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:57.288652 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-07fbac88-029d-4eb8-a4c9-aa297ee3d15f req-bfadc9b3-8767-4931-bdd4-c0a4f360622c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:57.319996 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-07fbac88-029d-4eb8-a4c9-aa297ee3d15f req-bfadc9b3-8767-4931-bdd4-c0a4f360622c service nova] Creating event network-vif-unplugged:a569649a-653d-4712-9e65-932e9431dcd3 for instance 2c77529a-f41c-4253-b703-8ef094f934f2 on n-h2-836830-4 Jun 16 14:47:57.336911 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-07fbac88-029d-4eb8-a4c9-aa297ee3d15f req-bfadc9b3-8767-4931-bdd4-c0a4f360622c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098951 Jun 16 14:47:57.337957 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1016/1989] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 16 14:47:57.521586 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-262e2aaa-efc1-4547-a747-d6684002580f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:57.543649 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-262e2aaa-efc1-4547-a747-d6684002580f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1275 microversion: 2.1 time: 0.362125 Jun 16 14:47:57.558793 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 974/1990] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:57 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1275 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:57.582663 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-965d5317-b88a-4732-8276-82a4145704bd req-fa1472ac-af5a-4a0f-aab6-40a2bd419914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e428ca7a-f7f8-4dff-a272-52fb03083fd2", "name": "network-vif-deleted", "tag": "e583603f-657e-4f58-aa10-f2482dfad9de"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:57.605099 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-965d5317-b88a-4732-8276-82a4145704bd req-fa1472ac-af5a-4a0f-aab6-40a2bd419914 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:57.606550 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-965d5317-b88a-4732-8276-82a4145704bd req-fa1472ac-af5a-4a0f-aab6-40a2bd419914 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:57.636215 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-965d5317-b88a-4732-8276-82a4145704bd req-fa1472ac-af5a-4a0f-aab6-40a2bd419914 service nova] Creating event network-vif-deleted:e583603f-657e-4f58-aa10-f2482dfad9de for instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 on n-h2-836830-4 Jun 16 14:47:57.663299 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-965d5317-b88a-4732-8276-82a4145704bd req-fa1472ac-af5a-4a0f-aab6-40a2bd419914 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084610 Jun 16 14:47:57.664296 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1017/1991] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:47:57.893308 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-78f8c49f-bdaa-4584-b524-91e1c42cf0c0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:57.908621 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-78f8c49f-bdaa-4584-b524-91e1c42cf0c0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:57.944578 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-78f8c49f-bdaa-4584-b524-91e1c42cf0c0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:57.947395 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-78f8c49f-bdaa-4584-b524-91e1c42cf0c0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:57.951828 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-78f8c49f-bdaa-4584-b524-91e1c42cf0c0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:57.960791 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-78f8c49f-bdaa-4584-b524-91e1c42cf0c0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:58.002002 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2b26c657-6746-427c-bed6-237d2595564e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:58.004105 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:58.004390 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2b26c657-6746-427c-bed6-237d2595564e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:58.055257 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2b26c657-6746-427c-bed6-237d2595564e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:58.091765 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2b26c657-6746-427c-bed6-237d2595564e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:58.094996 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2b26c657-6746-427c-bed6-237d2595564e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:58.100966 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2b26c657-6746-427c-bed6-237d2595564e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:58.429390 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2b26c657-6746-427c-bed6-237d2595564e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:58.457350 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2b26c657-6746-427c-bed6-237d2595564e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1325 microversion: 2.1 time: 0.478628 Jun 16 14:47:58.486937 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1018/1992] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:57 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1325 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:58.499811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e631a69a-23df-4d40-88a4-f8b24e6fbbe1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffb31430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:58.723087 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e631a69a-23df-4d40-88a4-f8b24e6fbbe1 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.234168 Jun 16 14:47:58.724311 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1019/1993] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:58 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:58.745178 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d0f8640c-27ad-45a8-a93d-cca9f5322f39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:58.755233 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d0f8640c-27ad-45a8-a93d-cca9f5322f39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] [instance: e428ca7a-f7f8-4dff-a272-52fb03083fd2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:58.799334 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d0f8640c-27ad-45a8-a93d-cca9f5322f39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:58.800684 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d0f8640c-27ad-45a8-a93d-cca9f5322f39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:58.805768 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d0f8640c-27ad-45a8-a93d-cca9f5322f39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:58.807106 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d0f8640c-27ad-45a8-a93d-cca9f5322f39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:58.856191 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-d0f8640c-27ad-45a8-a93d-cca9f5322f39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] HTTP exception thrown: Instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 could not be found. Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d0f8640c-27ad-45a8-a93d-cca9f5322f39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Request method failure captured: Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 HTTP/1.1 Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0DXFE8Vor5JLcZPE8OkQrI7LMkkoLVBI_0QSqbQpJMs4ma6obpXvLHzIvNHgOpAEXnbsibN4JdFNbYy2-56jTMWA8UuZ6fEAYyg_21_ElPANICJZlrWgGH4lnc0UOaWuCZvK7JS8SDd0o3nBkraCiM71vT5xBbdKpdc1w4yk9W6TDM Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 414e3b792647435daa2ecce22a2c6132 Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-MigrationsAdminTest-570114701 Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:47:58.861040 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:47:58.864424 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_414e3b792647435daa2ecce22a2c6132", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/414e3b792647435daa2ecce22a2c6132"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/414e3b792647435daa2ecce22a2c6132"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/414e3b792647435daa2ecce22a2c6132"}]}] Jun 16 14:47:58.864424 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-MigrationsAdminTest-570114701 Jun 16 14:47:58.864424 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 414e3b792647435daa2ecce22a2c6132 Jun 16 14:47:58.864424 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-MigrationsAdminTest-570114701 Jun 16 14:47:58.864424 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-MigrationsAdminTest-570114701-project Jun 16 14:47:58.864424 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:47:58.864424 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:47:58.864424 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 65cde69f3b52448c8b08297b548bb377 Jun 16 14:47:58.864424 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-MigrationsAdminTest-570114701-project Jun 16 14:47:58.864424 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:47:58.864424 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 could not be found. Jun 16 14:47:58.864424 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'e428ca7a-f7f8-4dff-a272-52fb03083fd2'} Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 could not be found. Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:47:58.866670 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 could not be found. Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 could not be found. Jun 16 14:47:58.872041 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:47:58.880176 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d0f8640c-27ad-45a8-a93d-cca9f5322f39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] Returning 404 to user: Instance e428ca7a-f7f8-4dff-a272-52fb03083fd2 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:47:58.880892 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d0f8640c-27ad-45a8-a93d-cca9f5322f39 tempest-MigrationsAdminTest-570114701 tempest-MigrationsAdminTest-570114701-project] 10.222.0.57 "GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2" status: 404 len: 111 microversion: 2.1 time: 0.152149 Jun 16 14:47:58.882768 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1020/1994] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:58 2022] GET /compute/v2.1/servers/e428ca7a-f7f8-4dff-a272-52fb03083fd2 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:47:58.905724 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f8ab9aae-155d-45d1-b64f-2e34eb6f36de tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:58.908831 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f8ab9aae-155d-45d1-b64f-2e34eb6f36de tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:58.926995 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f8ab9aae-155d-45d1-b64f-2e34eb6f36de tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:58.928250 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f8ab9aae-155d-45d1-b64f-2e34eb6f36de tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:58.930074 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f8ab9aae-155d-45d1-b64f-2e34eb6f36de tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:58.931559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f8ab9aae-155d-45d1-b64f-2e34eb6f36de tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:59.151132 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-78f8c49f-bdaa-4584-b524-91e1c42cf0c0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:59.220279 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-78f8c49f-bdaa-4584-b524-91e1c42cf0c0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:59.231315 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-78f8c49f-bdaa-4584-b524-91e1c42cf0c0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:59.235734 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-78f8c49f-bdaa-4584-b524-91e1c42cf0c0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 1.351448 Jun 16 14:47:59.273379 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 975/1995] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:47:57 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:47:59.419420 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-85addea7-603a-46e4-a078-bb2fdfb12ffe req-5ff00d84-e577-4aa3-82c2-d323a42bfe98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fff8da-3571-43cc-b8cf-448588a42929", "name": "network-vif-plugged", "status": "completed", "tag": "9b4f163d-66bc-44e4-9a13-6550ecad517d"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:47:59.480869 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-85addea7-603a-46e4-a078-bb2fdfb12ffe req-5ff00d84-e577-4aa3-82c2-d323a42bfe98 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:59.482116 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-85addea7-603a-46e4-a078-bb2fdfb12ffe req-5ff00d84-e577-4aa3-82c2-d323a42bfe98 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:59.524510 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-85addea7-603a-46e4-a078-bb2fdfb12ffe req-5ff00d84-e577-4aa3-82c2-d323a42bfe98 service nova] Creating event network-vif-plugged:9b4f163d-66bc-44e4-9a13-6550ecad517d for instance 60fff8da-3571-43cc-b8cf-448588a42929 on n-h2-836830-4 Jun 16 14:47:59.542684 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-85addea7-603a-46e4-a078-bb2fdfb12ffe req-5ff00d84-e577-4aa3-82c2-d323a42bfe98 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144303 Jun 16 14:47:59.543210 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 976/1996] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:47:59.570723 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9c939ab0-f174-452c-bbbe-fdf34e581017 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:59.571711 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9c939ab0-f174-452c-bbbe-fdf34e581017 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:47:59.602279 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9c939ab0-f174-452c-bbbe-fdf34e581017 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:59.603687 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9c939ab0-f174-452c-bbbe-fdf34e581017 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:59.604637 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9c939ab0-f174-452c-bbbe-fdf34e581017 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:59.605205 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9c939ab0-f174-452c-bbbe-fdf34e581017 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:59.614518 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f8ab9aae-155d-45d1-b64f-2e34eb6f36de tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:47:59.668746 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f8ab9aae-155d-45d1-b64f-2e34eb6f36de tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1317 microversion: 2.1 time: 0.770086 Jun 16 14:47:59.672342 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1021/1997] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:58 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1317 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:47:59.770103 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-228b8b87-a865-48ae-a690-e416c06ed3bc tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffbfa670>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:59.918874 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-228b8b87-a865-48ae-a690-e416c06ed3bc tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.168872 Jun 16 14:47:59.927083 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1022/1998] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:47:59 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:00.278264 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c83787b4-ae53-4d27-81ad-50f081901e02 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:00.282367 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c83787b4-ae53-4d27-81ad-50f081901e02 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:00.308656 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c83787b4-ae53-4d27-81ad-50f081901e02 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:00.309382 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c83787b4-ae53-4d27-81ad-50f081901e02 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:00.310435 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c83787b4-ae53-4d27-81ad-50f081901e02 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:00.312747 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c83787b4-ae53-4d27-81ad-50f081901e02 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:00.741060 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c83787b4-ae53-4d27-81ad-50f081901e02 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:00.755573 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c83787b4-ae53-4d27-81ad-50f081901e02 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:00.759432 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c83787b4-ae53-4d27-81ad-50f081901e02 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:00.761211 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c83787b4-ae53-4d27-81ad-50f081901e02 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.495574 Jun 16 14:48:00.776334 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1023/1999] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:00 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:00.783661 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5f95f7ff-c20b-418a-a2cc-88b70cecef46 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:00.785433 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5f95f7ff-c20b-418a-a2cc-88b70cecef46 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:00.795959 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5f95f7ff-c20b-418a-a2cc-88b70cecef46 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:00.796893 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5f95f7ff-c20b-418a-a2cc-88b70cecef46 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:00.798028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5f95f7ff-c20b-418a-a2cc-88b70cecef46 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:00.799251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5f95f7ff-c20b-418a-a2cc-88b70cecef46 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:01.201198 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5f95f7ff-c20b-418a-a2cc-88b70cecef46 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:01.214147 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5f95f7ff-c20b-418a-a2cc-88b70cecef46 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1317 microversion: 2.1 time: 0.435836 Jun 16 14:48:01.216590 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1024/2000] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:00 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:01.225319 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cf9ec8ad-5a7d-4294-84a7-765e71d713d2 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffb453a0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:01.256673 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9c939ab0-f174-452c-bbbe-fdf34e581017 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:01.300488 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9c939ab0-f174-452c-bbbe-fdf34e581017 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1325 microversion: 2.1 time: 1.753913 Jun 16 14:48:01.302271 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 977/2001] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:47:59 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1325 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:01.361573 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cf9ec8ad-5a7d-4294-84a7-765e71d713d2 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.144000 Jun 16 14:48:01.363100 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1025/2002] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:48:01 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:01.787187 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3e9bd15f-f944-4949-bca1-4e56493f070d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:01.790631 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3e9bd15f-f944-4949-bca1-4e56493f070d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:01.805853 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:01.808189 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=6 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:01.819899 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3e9bd15f-f944-4949-bca1-4e56493f070d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:01.822835 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3e9bd15f-f944-4949-bca1-4e56493f070d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:01.824926 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3e9bd15f-f944-4949-bca1-4e56493f070d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:01.826621 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3e9bd15f-f944-4949-bca1-4e56493f070d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:02.244789 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:02.270785 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a61e25e2-f499-4438-a2bb-32cc2c2ca2e0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:02.278856 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a61e25e2-f499-4438-a2bb-32cc2c2ca2e0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:02.306731 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a61e25e2-f499-4438-a2bb-32cc2c2ca2e0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:02.308057 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a61e25e2-f499-4438-a2bb-32cc2c2ca2e0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:02.309974 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a61e25e2-f499-4438-a2bb-32cc2c2ca2e0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:02.311240 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a61e25e2-f499-4438-a2bb-32cc2c2ca2e0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:03.583250 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a61e25e2-f499-4438-a2bb-32cc2c2ca2e0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:03.614945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3e9bd15f-f944-4949-bca1-4e56493f070d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:03.634263 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a61e25e2-f499-4438-a2bb-32cc2c2ca2e0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1317 microversion: 2.1 time: 1.383151 Jun 16 14:48:03.639754 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1026/2003] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:02 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1317 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:48:03.660847 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-99f32aaa-2b3c-4178-8c1d-770cc12c147b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:03.662933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-99f32aaa-2b3c-4178-8c1d-770cc12c147b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:03.714093 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-99f32aaa-2b3c-4178-8c1d-770cc12c147b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:03.718818 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-99f32aaa-2b3c-4178-8c1d-770cc12c147b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:03.727239 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-99f32aaa-2b3c-4178-8c1d-770cc12c147b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:03.729213 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-99f32aaa-2b3c-4178-8c1d-770cc12c147b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:03.761590 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3e9bd15f-f944-4949-bca1-4e56493f070d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:03.778401 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3e9bd15f-f944-4949-bca1-4e56493f070d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:03.783188 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3e9bd15f-f944-4949-bca1-4e56493f070d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 2.003829 Jun 16 14:48:03.827279 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 978/2004] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:01 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:48:03.851956 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-079f6d70-fd86-4703-87fc-974fb57409d3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeff4cd550>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:04.025511 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-079f6d70-fd86-4703-87fc-974fb57409d3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.196095 Jun 16 14:48:04.050876 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 979/2005] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:48:03 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:04.195341 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-32b4b9e2-cf02-4caa-aac3-01c944bf4248 req-1296634c-e1f9-45a4-8536-5c92b88463be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de", "tag": "4f2964ee-bda2-45df-955e-ebf34a3e9f77"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:04.256086 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-32b4b9e2-cf02-4caa-aac3-01c944bf4248 req-1296634c-e1f9-45a4-8536-5c92b88463be service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:04.260338 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-32b4b9e2-cf02-4caa-aac3-01c944bf4248 req-1296634c-e1f9-45a4-8536-5c92b88463be service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:04.335994 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-32b4b9e2-cf02-4caa-aac3-01c944bf4248 req-1296634c-e1f9-45a4-8536-5c92b88463be service nova] Creating event network-changed:4f2964ee-bda2-45df-955e-ebf34a3e9f77 for instance 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de on n-h1-836830-4 Jun 16 14:48:04.368351 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-32b4b9e2-cf02-4caa-aac3-01c944bf4248 req-1296634c-e1f9-45a4-8536-5c92b88463be service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198942 Jun 16 14:48:04.376805 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 980/2006] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:48:04.615558 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-99f32aaa-2b3c-4178-8c1d-770cc12c147b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:04.636665 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-99f32aaa-2b3c-4178-8c1d-770cc12c147b tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1521 microversion: 2.1 time: 0.985996 Jun 16 14:48:04.654458 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1027/2007] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:03 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1521 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:04.693171 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-24db103b-2b19-49c7-a529-49017fe39d1f tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:04.693171 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-24db103b-2b19-49c7-a529-49017fe39d1f tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:04.699570 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-372dce1b-023b-4f3f-af7d-ad4ec13b077e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:04.703750 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-372dce1b-023b-4f3f-af7d-ad4ec13b077e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:04.725699 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-372dce1b-023b-4f3f-af7d-ad4ec13b077e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:04.726915 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-372dce1b-023b-4f3f-af7d-ad4ec13b077e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:04.729056 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-372dce1b-023b-4f3f-af7d-ad4ec13b077e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:04.733538 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-372dce1b-023b-4f3f-af7d-ad4ec13b077e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:04.779950 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-24db103b-2b19-49c7-a529-49017fe39d1f tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:04.781710 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-24db103b-2b19-49c7-a529-49017fe39d1f tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:04.783281 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-24db103b-2b19-49c7-a529-49017fe39d1f tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:04.784107 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-24db103b-2b19-49c7-a529-49017fe39d1f tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:04.931277 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:04.955654 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-24db103b-2b19-49c7-a529-49017fe39d1f tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:48:05.217594 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-24db103b-2b19-49c7-a529-49017fe39d1f tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "DELETE /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 204 len: 0 microversion: 2.1 time: 0.534952 Jun 16 14:48:05.219547 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1028/2008] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:48:04 2022] DELETE /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:48:05.226351 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fb908518-851d-43a0-8785-cc5c0dbe259f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:05.227584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fb908518-851d-43a0-8785-cc5c0dbe259f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:05.236738 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:05.239904 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb908518-851d-43a0-8785-cc5c0dbe259f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:05.240791 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb908518-851d-43a0-8785-cc5c0dbe259f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:05.243047 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb908518-851d-43a0-8785-cc5c0dbe259f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:05.243901 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fb908518-851d-43a0-8785-cc5c0dbe259f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:05.729838 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fb908518-851d-43a0-8785-cc5c0dbe259f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:05.770522 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fb908518-851d-43a0-8785-cc5c0dbe259f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:05.778083 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fb908518-851d-43a0-8785-cc5c0dbe259f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:05.788512 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fb908518-851d-43a0-8785-cc5c0dbe259f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 0.566837 Jun 16 14:48:05.796555 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1029/2009] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:05 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:05.821119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-49c3de11-51c0-4c6d-bfc4-61d73fbda45c tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffafbe50>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:06.001455 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-49c3de11-51c0-4c6d-bfc4-61d73fbda45c tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.200802 Jun 16 14:48:06.002568 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1030/2010] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:48:05 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:06.035266 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4ae57a76-3bb2-439f-9424-47cf67dca62e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:06.040154 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4ae57a76-3bb2-439f-9424-47cf67dca62e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:06.082045 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4ae57a76-3bb2-439f-9424-47cf67dca62e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:06.083198 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4ae57a76-3bb2-439f-9424-47cf67dca62e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:06.084783 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4ae57a76-3bb2-439f-9424-47cf67dca62e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:06.089385 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4ae57a76-3bb2-439f-9424-47cf67dca62e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:06.308186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-372dce1b-023b-4f3f-af7d-ad4ec13b077e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:06.339603 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-372dce1b-023b-4f3f-af7d-ad4ec13b077e tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1317 microversion: 2.1 time: 1.674295 Jun 16 14:48:06.369842 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 981/2011] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:04 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1317 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:06.852066 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5a78c998-3aeb-4d7b-aab2-9ce97d28c1a0 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Calling method '.version_select at 0x7fdf11103a60>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:06.948567 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:06.970211 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5a78c998-3aeb-4d7b-aab2-9ce97d28c1a0 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81" status: 200 len: 371 microversion: 2.1 time: 0.406127 Jun 16 14:48:06.971668 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 982/2012] 10.222.0.57 () {58 vars in 1241 bytes} [Thu Jun 16 14:48:06 2022] GET /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81 => generated 371 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:06.978580 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5be4a170-c87e-429c-a9ee-8c832d504ea8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:06.979634 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5be4a170-c87e-429c-a9ee-8c832d504ea8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:06.989942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5be4a170-c87e-429c-a9ee-8c832d504ea8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:06.990762 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5be4a170-c87e-429c-a9ee-8c832d504ea8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:06.991896 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5be4a170-c87e-429c-a9ee-8c832d504ea8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:06.992636 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5be4a170-c87e-429c-a9ee-8c832d504ea8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:07.516126 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-4ae57a76-3bb2-439f-9424-47cf67dca62e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:07.530478 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4ae57a76-3bb2-439f-9424-47cf67dca62e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1527 microversion: 2.1 time: 1.514902 Jun 16 14:48:07.531973 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1031/2013] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:06 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1527 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:07.538972 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-712ee6d6-8eda-48a3-af97-2309d9072b32 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Action: 'update', calling method: .version_select at 0x7fdeffae50d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:07.694154 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-712ee6d6-8eda-48a3-af97-2309d9072b32 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:07.695100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-712ee6d6-8eda-48a3-af97-2309d9072b32 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:07.697602 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-712ee6d6-8eda-48a3-af97-2309d9072b32 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:07.699503 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-712ee6d6-8eda-48a3-af97-2309d9072b32 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:07.884801 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-712ee6d6-8eda-48a3-af97-2309d9072b32 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81" status: 200 len: 328 microversion: 2.1 time: 0.351139 Jun 16 14:48:07.890532 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1032/2014] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jun 16 14:48:07 2022] PUT /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81 => generated 328 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:07.904392 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bc14f987-803c-4937-9847-d9668a8e9ac7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffa8fdc0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:08.098981 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bc14f987-803c-4937-9847-d9668a8e9ac7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.206287 Jun 16 14:48:08.109550 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1033/2015] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:48:07 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:08.125823 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-98d703e2-c33b-4880-aeb5-7bf2fadd6c70 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:08.129349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-98d703e2-c33b-4880-aeb5-7bf2fadd6c70 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:08.147833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98d703e2-c33b-4880-aeb5-7bf2fadd6c70 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:08.151026 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98d703e2-c33b-4880-aeb5-7bf2fadd6c70 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:08.154991 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98d703e2-c33b-4880-aeb5-7bf2fadd6c70 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:08.159254 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98d703e2-c33b-4880-aeb5-7bf2fadd6c70 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:08.524897 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5be4a170-c87e-429c-a9ee-8c832d504ea8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:08.572272 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5be4a170-c87e-429c-a9ee-8c832d504ea8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:08.587154 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5be4a170-c87e-429c-a9ee-8c832d504ea8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:08.594319 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5be4a170-c87e-429c-a9ee-8c832d504ea8 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1484 microversion: 2.25 time: 1.618556 Jun 16 14:48:08.600554 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 983/2016] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:06 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1484 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:08.635262 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5e0aefda-eaca-4a86-8ec8-2101833ffa0f tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:08.661088 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5e0aefda-eaca-4a86-8ec8-2101833ffa0f tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:08.670446 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5e0aefda-eaca-4a86-8ec8-2101833ffa0f tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Searching by: {'deleted': False, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb'} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:48:08.677148 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-98d703e2-c33b-4880-aeb5-7bf2fadd6c70 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:08.689714 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-98d703e2-c33b-4880-aeb5-7bf2fadd6c70 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1317 microversion: 2.1 time: 0.575763 Jun 16 14:48:08.694082 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1034/2017] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:08 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:08.737275 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5e0aefda-eaca-4a86-8ec8-2101833ffa0f tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:08.738460 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5e0aefda-eaca-4a86-8ec8-2101833ffa0f tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:08.740578 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5e0aefda-eaca-4a86-8ec8-2101833ffa0f tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:08.741056 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5e0aefda-eaca-4a86-8ec8-2101833ffa0f tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:08.853196 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.multi_cell_list [None req-5e0aefda-eaca-4a86-8ec8-2101833ffa0f tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:48:08.877682 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1976743582", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:08.936126 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5e0aefda-eaca-4a86-8ec8-2101833ffa0f tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.325430 Jun 16 14:48:08.937563 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 984/2018] 10.222.0.57 () {58 vars in 1124 bytes} [Thu Jun 16 14:48:08 2022] GET /compute/v2.1/servers => generated 344 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:08.952557 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-44cd1125-98cb-4f2d-b7a9-2b699c07534a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:08.958012 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-44cd1125-98cb-4f2d-b7a9-2b699c07534a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:08.979371 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] validate_networks() for None {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:48:08.998800 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44cd1125-98cb-4f2d-b7a9-2b699c07534a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:09.000649 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44cd1125-98cb-4f2d-b7a9-2b699c07534a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:09.006009 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44cd1125-98cb-4f2d-b7a9-2b699c07534a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:09.009241 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44cd1125-98cb-4f2d-b7a9-2b699c07534a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:09.321493 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-44cd1125-98cb-4f2d-b7a9-2b699c07534a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc694c86102467bb97072ca4972b223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46102b0fb544d118e324f7fcf654eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:09.368660 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-44cd1125-98cb-4f2d-b7a9-2b699c07534a tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 200 len: 1485 microversion: 2.1 time: 0.427718 Jun 16 14:48:09.398880 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 985/2019] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:08 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 1485 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:09.430661 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5389a12f-721d-4ae5-9d1e-28e7748cadf0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:09.456675 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5389a12f-721d-4ae5-9d1e-28e7748cadf0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:09.456675 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5389a12f-721d-4ae5-9d1e-28e7748cadf0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Searching by: {'deleted': False, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb'} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:48:09.481453 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5389a12f-721d-4ae5-9d1e-28e7748cadf0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:09.488063 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5389a12f-721d-4ae5-9d1e-28e7748cadf0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:09.489319 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5389a12f-721d-4ae5-9d1e-28e7748cadf0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:09.489980 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5389a12f-721d-4ae5-9d1e-28e7748cadf0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:09.562985 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.multi_cell_list [None req-5389a12f-721d-4ae5-9d1e-28e7748cadf0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:48:09.659047 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5389a12f-721d-4ae5-9d1e-28e7748cadf0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:09.673771 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5389a12f-721d-4ae5-9d1e-28e7748cadf0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:09.674346 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5389a12f-721d-4ae5-9d1e-28e7748cadf0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:09.952714 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5389a12f-721d-4ae5-9d1e-28e7748cadf0 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.551267 Jun 16 14:48:09.954284 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 986/2020] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:48:09 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:09.977431 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:48:09.978078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:48:09.981271 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:48:09.982341 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:48:09.983060 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:48:10.037774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:10.038543 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:10.039949 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:10.040747 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:10.125706 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Getting quotas for project 537923f1aae7469e97a6166b1d317d81. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:48:10.153107 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Getting quotas for user fe87ed67b8f749bd9680408ac899ff79 and project 537923f1aae7469e97a6166b1d317d81. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:48:10.163004 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-11907677-20a5-4281-a333-24639612b519 req-0c25f39d-7035-4a8b-bf48-b82b03306890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fff8da-3571-43cc-b8cf-448588a42929", "name": "network-vif-deleted", "tag": "9b4f163d-66bc-44e4-9a13-6550ecad517d"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:10.196666 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-11907677-20a5-4281-a333-24639612b519 req-0c25f39d-7035-4a8b-bf48-b82b03306890 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:10.200588 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-11907677-20a5-4281-a333-24639612b519 req-0c25f39d-7035-4a8b-bf48-b82b03306890 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:10.226027 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.utils [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] cores quota exceeded for 537923f1aae7469e97a6166b1d317d81, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125862) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 16 14:48:10.232231 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 16 14:48:10.249110 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-11907677-20a5-4281-a333-24639612b519 req-0c25f39d-7035-4a8b-bf48-b82b03306890 service nova] Creating event network-vif-deleted:9b4f163d-66bc-44e4-9a13-6550ecad517d for instance 60fff8da-3571-43cc-b8cf-448588a42929 on n-h2-836830-4 Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Request method failure captured: Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 145 Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0KkZwfDiERFkC42RZe8FporYiIU-sOu3vdCCi9s9BeBOLFJI7zOqUq5lJZM7aH4x2IfZoqoR8WDrrYkwDG09LJH-kzOFUozNysPUDyVvyXJg60seYaJzgIKAf_TLUF7ErJ1GgY1jyWXRQq4qFpMjIH8fS0Ei9fAYZR2SFObrm5nupA Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 537923f1aae7469e97a6166b1d317d81 Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-QuotasAdminNegativeTest-1496990499 Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:48:10.257114 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:48:10.259166 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_537923f1aae7469e97a6166b1d317d81", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/537923f1aae7469e97a6166b1d317d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/537923f1aae7469e97a6166b1d317d81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/537923f1aae7469e97a6166b1d317d81"}]}] Jun 16 14:48:10.259166 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-QuotasAdminNegativeTest-1496990499 Jun 16 14:48:10.259166 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 537923f1aae7469e97a6166b1d317d81 Jun 16 14:48:10.259166 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1496990499 Jun 16 14:48:10.259166 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-QuotasAdminNegativeTest-1496990499-project Jun 16 14:48:10.259166 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:48:10.259166 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:48:10.259166 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: fe87ed67b8f749bd9680408ac899ff79 Jun 16 14:48:10.259166 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-QuotasAdminNegativeTest-1496990499-project Jun 16 14:48:10.259166 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:48:10.259166 n-d-836830-4 devstack@n-api.service[125862]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1976743582", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} Jun 16 14:48:10.259166 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1976743582', 'imageRef': '3c5b2063-0858-477e-a4dd-6736a4c60e42', 'flavorRef': '452'}}} Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 16 14:48:10.260292 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:10.263400 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:10.266209 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:10.270258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:10.270258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:10.270258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:10.270258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:10.270258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 16 14:48:10.270258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:10.271620 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:10.272783 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2a725cef-9f9e-4dc7-a240-8e5f9c386242 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.577202 Jun 16 14:48:10.273638 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1035/2021] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:48:08 2022] POST /compute/v2.1/servers => generated 111 bytes in 1579 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:48:10.280886 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a9587c60-d1c5-4763-a005-51f6751e7cd3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffb3f310>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:10.282909 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-11907677-20a5-4281-a333-24639612b519 req-0c25f39d-7035-4a8b-bf48-b82b03306890 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.323962 Jun 16 14:48:10.285964 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 987/2022] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:10.316473 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-544a45f1-e387-4adb-bbb7-4307de7943bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:10.320619 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-544a45f1-e387-4adb-bbb7-4307de7943bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:10.337527 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-544a45f1-e387-4adb-bbb7-4307de7943bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:10.346654 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-544a45f1-e387-4adb-bbb7-4307de7943bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:10.350020 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-544a45f1-e387-4adb-bbb7-4307de7943bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:10.351130 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-544a45f1-e387-4adb-bbb7-4307de7943bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:10.376992 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a9587c60-d1c5-4763-a005-51f6751e7cd3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1440 microversion: 2.1 time: 0.101939 Jun 16 14:48:10.382439 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1036/2023] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:48:10 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1440 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:10.392737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c839d210-7317-41c6-b0aa-953aafa55363 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:10.395097 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c839d210-7317-41c6-b0aa-953aafa55363 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:10.409396 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c839d210-7317-41c6-b0aa-953aafa55363 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:10.410221 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c839d210-7317-41c6-b0aa-953aafa55363 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:10.412666 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c839d210-7317-41c6-b0aa-953aafa55363 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:10.415394 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c839d210-7317-41c6-b0aa-953aafa55363 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:10.689037 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-544a45f1-e387-4adb-bbb7-4307de7943bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:10.703787 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-544a45f1-e387-4adb-bbb7-4307de7943bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:10.709304 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-544a45f1-e387-4adb-bbb7-4307de7943bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:10.712366 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-544a45f1-e387-4adb-bbb7-4307de7943bc tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1474 microversion: 2.25 time: 0.423309 Jun 16 14:48:10.725569 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 988/2024] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:10 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1474 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:10.731682 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-302dfed2-acea-4293-8a35-378ae0339b6c tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:10.749762 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-302dfed2-acea-4293-8a35-378ae0339b6c tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022627 Jun 16 14:48:10.751031 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 989/2025] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:48:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:10.767132 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2506dcde-cfad-43ae-aca0-bb35b500ca73 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Action: 'update', calling method: .version_select at 0x7fdeffbb7d30>, body: {"quota_set": {"cores": 20}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:10.790647 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c839d210-7317-41c6-b0aa-953aafa55363 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:10.802955 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c839d210-7317-41c6-b0aa-953aafa55363 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1317 microversion: 2.1 time: 0.420596 Jun 16 14:48:10.803880 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1037/2026] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:10 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:10.822083 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4fb982c9-89e8-4929-9a26-ff16f39e24b5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:10.823388 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4fb982c9-89e8-4929-9a26-ff16f39e24b5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 60fff8da-3571-43cc-b8cf-448588a42929] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:10.835816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4fb982c9-89e8-4929-9a26-ff16f39e24b5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:10.837192 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4fb982c9-89e8-4929-9a26-ff16f39e24b5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:10.839071 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4fb982c9-89e8-4929-9a26-ff16f39e24b5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:10.840640 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4fb982c9-89e8-4929-9a26-ff16f39e24b5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:10.871469 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-4fb982c9-89e8-4929-9a26-ff16f39e24b5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] HTTP exception thrown: Instance 60fff8da-3571-43cc-b8cf-448588a42929 could not be found. Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4fb982c9-89e8-4929-9a26-ff16f39e24b5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Request method failure captured: Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 HTTP/1.1 Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0HwzjjfEOzwOCijJMwAIM9bloQokdG738AdmO2AfwSY4wjVjyQLh9lWAzH4Rn8UCfDe9NW9edyGFTRe1GgDBY6cMZzBwN1dffuTKMcXrVyPL7r_AJ0308sfSN5YHtB5BJ4xC8C7QdPv6xOmwCbcFwnW04fPzhAdrkooBYSucmrM6SQ Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:48:10.879258 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:48:10.882414 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b46102b0fb544d118e324f7fcf654eb2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b46102b0fb544d118e324f7fcf654eb2"}]}] Jun 16 14:48:10.882414 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:10.882414 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:48:10.882414 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:10.882414 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:48:10.882414 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:48:10.882414 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:48:10.882414 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 8fc694c86102467bb97072ca4972b223 Jun 16 14:48:10.882414 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:48:10.882414 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:48:10.882414 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 60fff8da-3571-43cc-b8cf-448588a42929 could not be found. Jun 16 14:48:10.882414 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '60fff8da-3571-43cc-b8cf-448588a42929'} Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60fff8da-3571-43cc-b8cf-448588a42929 could not be found. Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:10.890283 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60fff8da-3571-43cc-b8cf-448588a42929 could not be found. Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60fff8da-3571-43cc-b8cf-448588a42929 could not be found. Jun 16 14:48:10.893917 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:10.899073 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4fb982c9-89e8-4929-9a26-ff16f39e24b5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Returning 404 to user: Instance 60fff8da-3571-43cc-b8cf-448588a42929 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:10.899073 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4fb982c9-89e8-4929-9a26-ff16f39e24b5 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929" status: 404 len: 111 microversion: 2.1 time: 0.079474 Jun 16 14:48:10.899073 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1038/2027] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:10 2022] GET /compute/v2.1/servers/60fff8da-3571-43cc-b8cf-448588a42929 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:48:10.899073 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-98be72c8-af76-4344-90b1-d720350acc66 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '.version_select at 0x7fdeffb3f8b0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:10.901891 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98be72c8-af76-4344-90b1-d720350acc66 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:10.903958 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98be72c8-af76-4344-90b1-d720350acc66 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:10.925433 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-98be72c8-af76-4344-90b1-d720350acc66 tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/os-migrations" status: 200 len: 1943 microversion: 2.25 time: 0.037735 Jun 16 14:48:10.926952 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1039/2028] 10.222.0.57 () {60 vars in 1183 bytes} [Thu Jun 16 14:48:10 2022] GET /compute/v2.1/os-migrations => generated 1943 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:10.938430 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-21b5cb17-11b5-468f-a713-e60dcc0d555d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '.version_select at 0x7fdeffb31a60>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:11.044823 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-21b5cb17-11b5-468f-a713-e60dcc0d555d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] HTTP exception thrown: Image not found. Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-21b5cb17-11b5-468f-a713-e60dcc0d555d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Request method failure captured: Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/images/6ec746a2-6c9a-4036-bf0e-fb9c269f7e4f HTTP/1.1 Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0HwzjjfEOzwOCijJMwAIM9bloQokdG738AdmO2AfwSY4wjVjyQLh9lWAzH4Rn8UCfDe9NW9edyGFTRe1GgDBY6cMZzBwN1dffuTKMcXrVyPL7r_AJ0308sfSN5YHtB5BJ4xC8C7QdPv6xOmwCbcFwnW04fPzhAdrkooBYSucmrM6SQ Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:48:11.048246 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:48:11.049958 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b46102b0fb544d118e324f7fcf654eb2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b46102b0fb544d118e324f7fcf654eb2"}]}] Jun 16 14:48:11.049958 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:11.049958 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:48:11.049958 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:11.049958 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:48:11.049958 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:48:11.049958 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:48:11.049958 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 8fc694c86102467bb97072ca4972b223 Jun 16 14:48:11.049958 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:48:11.049958 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:48:11.049958 n-d-836830-4 devstack@n-api.service[125862]: exception: Image not found. Jun 16 14:48:11.049958 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '6ec746a2-6c9a-4036-bf0e-fb9c269f7e4f'} Jun 16 14:48:11.049958 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6ec746a2-6c9a-4036-bf0e-fb9c269f7e4f to delete Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:11.051140 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6ec746a2-6c9a-4036-bf0e-fb9c269f7e4f could not be found. Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:11.053081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:11.060060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 14:48:11.060060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:48:11.060060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:48:11.060060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:11.060060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:11.060060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:11.060060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:11.060060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:11.060060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:11.060060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:11.060060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:11.060060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:48:11.060060 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:11.060060 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-21b5cb17-11b5-468f-a713-e60dcc0d555d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Returning 404 to user: Image not found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:11.060060 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-21b5cb17-11b5-468f-a713-e60dcc0d555d tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "DELETE /compute/v2.1/images/6ec746a2-6c9a-4036-bf0e-fb9c269f7e4f" status: 404 len: 62 microversion: 2.1 time: 0.125519 Jun 16 14:48:11.062100 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1040/2029] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:10 2022] DELETE /compute/v2.1/images/6ec746a2-6c9a-4036-bf0e-fb9c269f7e4f => generated 62 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:48:11.071236 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e64e1779-181c-49d5-9417-a82be37c8c0e tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:11.072321 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e64e1779-181c-49d5-9417-a82be37c8c0e tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:11.088824 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e64e1779-181c-49d5-9417-a82be37c8c0e tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:11.089741 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e64e1779-181c-49d5-9417-a82be37c8c0e tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:11.092380 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e64e1779-181c-49d5-9417-a82be37c8c0e tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:11.093806 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e64e1779-181c-49d5-9417-a82be37c8c0e tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:11.281406 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2506dcde-cfad-43ae-aca0-bb35b500ca73 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:11.287161 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2506dcde-cfad-43ae-aca0-bb35b500ca73 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:11.289326 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2506dcde-cfad-43ae-aca0-bb35b500ca73 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:11.290179 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2506dcde-cfad-43ae-aca0-bb35b500ca73 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:11.438226 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2506dcde-cfad-43ae-aca0-bb35b500ca73 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81" status: 200 len: 329 microversion: 2.1 time: 0.686210 Jun 16 14:48:11.450750 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 990/2030] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jun 16 14:48:10 2022] PUT /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81 => generated 329 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:11.456245 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b4ea9851-0e72-4102-a1ad-724ff9cd7876 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:11.458873 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b4ea9851-0e72-4102-a1ad-724ff9cd7876 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:11.461449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-e64e1779-181c-49d5-9417-a82be37c8c0e tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] Lazy-loading 'services' on Instance uuid 2c77529a-f41c-4253-b703-8ef094f934f2 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:48:11.479905 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4ea9851-0e72-4102-a1ad-724ff9cd7876 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:11.482553 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4ea9851-0e72-4102-a1ad-724ff9cd7876 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:11.483842 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4ea9851-0e72-4102-a1ad-724ff9cd7876 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:11.484524 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b4ea9851-0e72-4102-a1ad-724ff9cd7876 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:11.502332 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e64e1779-181c-49d5-9417-a82be37c8c0e tempest-LiveAutoBlockMigrationV225Test-1202376521 tempest-LiveAutoBlockMigrationV225Test-1202376521-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1965 microversion: 2.25 time: 0.444191 Jun 16 14:48:11.504062 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1041/2031] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:11 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1965 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:11.514412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6a720fb7-cf88-4be3-85b1-915d8e68286e tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:11.515958 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6a720fb7-cf88-4be3-85b1-915d8e68286e tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:11.530461 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a720fb7-cf88-4be3-85b1-915d8e68286e tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:11.531859 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a720fb7-cf88-4be3-85b1-915d8e68286e tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:11.533909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a720fb7-cf88-4be3-85b1-915d8e68286e tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:11.535262 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6a720fb7-cf88-4be3-85b1-915d8e68286e tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:11.560421 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-b4ea9851-0e72-4102-a1ad-724ff9cd7876 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] HTTP exception thrown: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b4ea9851-0e72-4102-a1ad-724ff9cd7876 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Request method failure captured: Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 HTTP/1.1 Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0HwzjjfEOzwOCijJMwAIM9bloQokdG738AdmO2AfwSY4wjVjyQLh9lWAzH4Rn8UCfDe9NW9edyGFTRe1GgDBY6cMZzBwN1dffuTKMcXrVyPL7r_AJ0308sfSN5YHtB5BJ4xC8C7QdPv6xOmwCbcFwnW04fPzhAdrkooBYSucmrM6SQ Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:48:11.573106 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:48:11.576804 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b46102b0fb544d118e324f7fcf654eb2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b46102b0fb544d118e324f7fcf654eb2"}]}] Jun 16 14:48:11.576804 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:11.576804 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:48:11.576804 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:11.576804 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:48:11.576804 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:48:11.576804 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:48:11.576804 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 8fc694c86102467bb97072ca4972b223 Jun 16 14:48:11.576804 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:48:11.576804 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:48:11.576804 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. Jun 16 14:48:11.576804 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '6def9a2e-2a3a-4509-bda8-13a61358d684'} Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:11.578525 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. Jun 16 14:48:11.581337 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:11.588891 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b4ea9851-0e72-4102-a1ad-724ff9cd7876 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Returning 404 to user: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:11.588891 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b4ea9851-0e72-4102-a1ad-724ff9cd7876 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 404 len: 111 microversion: 2.1 time: 0.132541 Jun 16 14:48:11.588891 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 991/2032] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:48:11 2022] DELETE /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:48:11.591819 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9b58013f-74f5-4c70-bcdc-efbdd5b5a93c tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffbf6820>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:11.611769 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6a720fb7-cf88-4be3-85b1-915d8e68286e tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:48:11.695177 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9b58013f-74f5-4c70-bcdc-efbdd5b5a93c tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1449 microversion: 2.1 time: 0.113037 Jun 16 14:48:11.695937 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 992/2033] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:48:11 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1449 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:11.701625 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c82df073-a226-42db-929c-714709eca58e tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Calling method '.version_select at 0x7fdeff4cd550>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:11.780681 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6a720fb7-cf88-4be3-85b1-915d8e68286e tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "DELETE /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 204 len: 0 microversion: 2.1 time: 0.274235 Jun 16 14:48:11.781959 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1042/2034] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:48:11 2022] DELETE /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:48:11.789349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a371b70b-0b70-41fb-81ec-eb67cb930e37 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:11.790701 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a371b70b-0b70-41fb-81ec-eb67cb930e37 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:11.800191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a371b70b-0b70-41fb-81ec-eb67cb930e37 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:11.800812 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a371b70b-0b70-41fb-81ec-eb67cb930e37 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:11.802093 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a371b70b-0b70-41fb-81ec-eb67cb930e37 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:11.802779 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a371b70b-0b70-41fb-81ec-eb67cb930e37 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:11.892076 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a371b70b-0b70-41fb-81ec-eb67cb930e37 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:48:12.048896 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c82df073-a226-42db-929c-714709eca58e tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81" status: 200 len: 371 microversion: 2.1 time: 0.351459 Jun 16 14:48:12.053612 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 993/2035] 10.222.0.57 () {58 vars in 1241 bytes} [Thu Jun 16 14:48:11 2022] GET /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81 => generated 371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:12.065481 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-18deb4d3-d23d-4f13-960e-85bce376f678 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:12.066154 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-18deb4d3-d23d-4f13-960e-85bce376f678 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 6def9a2e-2a3a-4509-bda8-13a61358d684] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:12.077534 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-18deb4d3-d23d-4f13-960e-85bce376f678 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:12.083232 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-18deb4d3-d23d-4f13-960e-85bce376f678 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:12.084306 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-18deb4d3-d23d-4f13-960e-85bce376f678 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:12.084600 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-18deb4d3-d23d-4f13-960e-85bce376f678 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:12.097024 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a371b70b-0b70-41fb-81ec-eb67cb930e37 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 204 len: 0 microversion: 2.25 time: 0.311801 Jun 16 14:48:12.098658 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1043/2036] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 16 14:48:11 2022] DELETE /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 14:48:12.117464 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e7a07e13-97f8-45df-8ba5-c9a711903d81 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffa930d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:12.122784 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-18deb4d3-d23d-4f13-960e-85bce376f678 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] HTTP exception thrown: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-18deb4d3-d23d-4f13-960e-85bce376f678 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Request method failure captured: Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 HTTP/1.1 Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0HwzjjfEOzwOCijJMwAIM9bloQokdG738AdmO2AfwSY4wjVjyQLh9lWAzH4Rn8UCfDe9NW9edyGFTRe1GgDBY6cMZzBwN1dffuTKMcXrVyPL7r_AJ0308sfSN5YHtB5BJ4xC8C7QdPv6xOmwCbcFwnW04fPzhAdrkooBYSucmrM6SQ Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:48:12.123098 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:48:12.125251 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b46102b0fb544d118e324f7fcf654eb2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b46102b0fb544d118e324f7fcf654eb2"}]}] Jun 16 14:48:12.125251 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:12.125251 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:48:12.125251 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:12.125251 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:48:12.125251 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:48:12.125251 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:48:12.125251 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 8fc694c86102467bb97072ca4972b223 Jun 16 14:48:12.125251 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:48:12.125251 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:48:12.125251 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. Jun 16 14:48:12.125251 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '6def9a2e-2a3a-4509-bda8-13a61358d684'} Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:12.126292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. Jun 16 14:48:12.128398 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:12.129990 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-18deb4d3-d23d-4f13-960e-85bce376f678 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Returning 404 to user: Instance 6def9a2e-2a3a-4509-bda8-13a61358d684 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:12.129990 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-18deb4d3-d23d-4f13-960e-85bce376f678 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684" status: 404 len: 111 microversion: 2.1 time: 0.068778 Jun 16 14:48:12.129990 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 994/2037] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:12 2022] GET /compute/v2.1/servers/6def9a2e-2a3a-4509-bda8-13a61358d684 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:48:12.133899 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4652e480-5fc9-4e7d-b34c-d61b35dd05e6 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:12.134605 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4652e480-5fc9-4e7d-b34c-d61b35dd05e6 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:12.142232 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4652e480-5fc9-4e7d-b34c-d61b35dd05e6 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:12.142633 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4652e480-5fc9-4e7d-b34c-d61b35dd05e6 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:12.143564 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4652e480-5fc9-4e7d-b34c-d61b35dd05e6 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:12.144332 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4652e480-5fc9-4e7d-b34c-d61b35dd05e6 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:12.228821 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e7a07e13-97f8-45df-8ba5-c9a711903d81 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 200 len: 1449 microversion: 2.1 time: 0.124243 Jun 16 14:48:12.229918 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1044/2038] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:48:12 2022] GET /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 1449 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:12.244416 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ec93e0f6-c9fb-4c25-959d-3d49c4485e29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:12.245280 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ec93e0f6-c9fb-4c25-959d-3d49c4485e29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:12.256106 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec93e0f6-c9fb-4c25-959d-3d49c4485e29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:12.256562 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec93e0f6-c9fb-4c25-959d-3d49c4485e29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:12.257396 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec93e0f6-c9fb-4c25-959d-3d49c4485e29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:12.257838 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec93e0f6-c9fb-4c25-959d-3d49c4485e29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:12.435062 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ec93e0f6-c9fb-4c25-959d-3d49c4485e29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:12.447091 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ec93e0f6-c9fb-4c25-959d-3d49c4485e29 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1317 microversion: 2.1 time: 0.213660 Jun 16 14:48:12.448721 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1045/2039] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:12 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:12.455487 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-06436ef5-c0f6-4a33-a86f-b5b35c5465c7 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Action: 'update', calling method: .version_select at 0x7fdeffb31c10>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:12.508733 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4652e480-5fc9-4e7d-b34c-d61b35dd05e6 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:12.524566 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4652e480-5fc9-4e7d-b34c-d61b35dd05e6 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1608 microversion: 2.1 time: 0.397418 Jun 16 14:48:12.538942 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 995/2040] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:12 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1608 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:12.560006 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-143781f6-4ea1-481a-94d3-c3a1295c6244 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:12.562783 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-143781f6-4ea1-481a-94d3-c3a1295c6244 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:12.596203 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-143781f6-4ea1-481a-94d3-c3a1295c6244 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:12.598889 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-143781f6-4ea1-481a-94d3-c3a1295c6244 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:12.602096 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-143781f6-4ea1-481a-94d3-c3a1295c6244 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:12.604589 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-143781f6-4ea1-481a-94d3-c3a1295c6244 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:13.058043 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06436ef5-c0f6-4a33-a86f-b5b35c5465c7 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:13.059982 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06436ef5-c0f6-4a33-a86f-b5b35c5465c7 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:13.061595 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06436ef5-c0f6-4a33-a86f-b5b35c5465c7 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:13.062458 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-06436ef5-c0f6-4a33-a86f-b5b35c5465c7 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:13.156123 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-06436ef5-c0f6-4a33-a86f-b5b35c5465c7 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81" status: 200 len: 328 microversion: 2.1 time: 0.705115 Jun 16 14:48:13.156847 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1046/2041] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jun 16 14:48:12 2022] PUT /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81 => generated 328 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:13.161881 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b61f3002-5da9-4f69-83ef-0389aeb25544 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '.version_select at 0x7fdeffa6a670>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:13.203976 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b61f3002-5da9-4f69-83ef-0389aeb25544 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1987501787" status: 202 len: 0 microversion: 2.1 time: 0.045071 Jun 16 14:48:13.205038 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1047/2042] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jun 16 14:48:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1987501787 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:48:13.215454 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8b9bc089-98b1-4596-b545-ec3fe860c83d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffb31ca0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:13.357900 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-143781f6-4ea1-481a-94d3-c3a1295c6244 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:13.375777 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-143781f6-4ea1-481a-94d3-c3a1295c6244 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:13.379032 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-143781f6-4ea1-481a-94d3-c3a1295c6244 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:13.381663 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-143781f6-4ea1-481a-94d3-c3a1295c6244 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1480 microversion: 2.25 time: 0.840954 Jun 16 14:48:13.395719 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 996/2043] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:12 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1480 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:13.408790 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-749020904", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:13.510462 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:48:14.336708 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8b9bc089-98b1-4596-b545-ec3fe860c83d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 204 len: 0 microversion: 2.1 time: 1.129835 Jun 16 14:48:14.338505 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1048/2044] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:13 2022] DELETE /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 0 bytes in 1133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:48:14.345030 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2dd1b994-74be-4e6a-b7ab-d953108f4fce tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:14.346132 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2dd1b994-74be-4e6a-b7ab-d953108f4fce tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:14.354969 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2dd1b994-74be-4e6a-b7ab-d953108f4fce tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:14.357198 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2dd1b994-74be-4e6a-b7ab-d953108f4fce tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:14.358813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2dd1b994-74be-4e6a-b7ab-d953108f4fce tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:14.359735 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2dd1b994-74be-4e6a-b7ab-d953108f4fce tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:14.437696 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:48:14.439053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:48:14.439940 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:48:14.440678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:48:14.441600 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:48:14.460898 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:14.462205 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:14.463997 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:14.466909 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:14.521685 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Getting quotas for project 537923f1aae7469e97a6166b1d317d81. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:48:14.535901 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Getting quotas for user fe87ed67b8f749bd9680408ac899ff79 and project 537923f1aae7469e97a6166b1d317d81. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:48:14.568125 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.utils [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] instances quota exceeded for 537923f1aae7469e97a6166b1d317d81, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125863) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 16 14:48:14.570924 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Request method failure captured: Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 144 Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0KkZwfDiERFkC42RZe8FporYiIU-sOu3vdCCi9s9BeBOLFJI7zOqUq5lJZM7aH4x2IfZoqoR8WDrrYkwDG09LJH-kzOFUozNysPUDyVvyXJg60seYaJzgIKAf_TLUF7ErJ1GgY1jyWXRQq4qFpMjIH8fS0Ei9fAYZR2SFObrm5nupA Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 537923f1aae7469e97a6166b1d317d81 Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-QuotasAdminNegativeTest-1496990499 Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:48:14.579678 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:48:14.581723 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_537923f1aae7469e97a6166b1d317d81", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/537923f1aae7469e97a6166b1d317d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/537923f1aae7469e97a6166b1d317d81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/537923f1aae7469e97a6166b1d317d81"}]}] Jun 16 14:48:14.581723 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-QuotasAdminNegativeTest-1496990499 Jun 16 14:48:14.581723 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 537923f1aae7469e97a6166b1d317d81 Jun 16 14:48:14.581723 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1496990499 Jun 16 14:48:14.581723 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-QuotasAdminNegativeTest-1496990499-project Jun 16 14:48:14.581723 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:48:14.581723 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:48:14.581723 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: fe87ed67b8f749bd9680408ac899ff79 Jun 16 14:48:14.581723 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-QuotasAdminNegativeTest-1496990499-project Jun 16 14:48:14.581723 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:48:14.581723 n-d-836830-4 devstack@n-api.service[125863]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-749020904", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} Jun 16 14:48:14.581723 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-749020904', 'imageRef': '3c5b2063-0858-477e-a4dd-6736a4c60e42', 'flavorRef': '452'}}} Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 16 14:48:14.584591 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:14.588340 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:14.596597 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:14.601090 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:14.601090 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:14.601090 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:14.601090 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:14.601090 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 16 14:48:14.601090 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:14.601090 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:14.601090 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4e41e43c-14f5-4335-a478-5017815f9976 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.185723 Jun 16 14:48:14.601090 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 997/2045] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:48:13 2022] POST /compute/v2.1/servers => generated 119 bytes in 1195 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:48:14.602655 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-71d9d3cb-3540-4628-8cad-0e552f864fc3 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:14.602655 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-71d9d3cb-3540-4628-8cad-0e552f864fc3 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:14.616859 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-71d9d3cb-3540-4628-8cad-0e552f864fc3 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:14.618186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-71d9d3cb-3540-4628-8cad-0e552f864fc3 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:14.619230 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-71d9d3cb-3540-4628-8cad-0e552f864fc3 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:14.620355 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-71d9d3cb-3540-4628-8cad-0e552f864fc3 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:14.772737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2dd1b994-74be-4e6a-b7ab-d953108f4fce tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:14.793698 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2dd1b994-74be-4e6a-b7ab-d953108f4fce tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1317 microversion: 2.1 time: 0.452772 Jun 16 14:48:14.795277 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1049/2046] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:14 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:14.815180 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-72297449-6557-49de-9ff3-7de106940a01 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:14.816278 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-72297449-6557-49de-9ff3-7de106940a01 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:14.830366 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-72297449-6557-49de-9ff3-7de106940a01 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:14.832209 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-72297449-6557-49de-9ff3-7de106940a01 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:14.835689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-72297449-6557-49de-9ff3-7de106940a01 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:14.836861 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-72297449-6557-49de-9ff3-7de106940a01 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:14.845844 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:14.895926 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-72297449-6557-49de-9ff3-7de106940a01 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:48:15.022541 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-72297449-6557-49de-9ff3-7de106940a01 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1" status: 204 len: 0 microversion: 2.1 time: 0.216283 Jun 16 14:48:15.031283 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1050/2047] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:48:14 2022] DELETE /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:48:15.042158 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5d50a137-e5d1-4963-bf69-793c114d9ac0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:15.045129 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5d50a137-e5d1-4963-bf69-793c114d9ac0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:15.058783 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d50a137-e5d1-4963-bf69-793c114d9ac0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:15.059109 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d50a137-e5d1-4963-bf69-793c114d9ac0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:15.060822 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d50a137-e5d1-4963-bf69-793c114d9ac0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:15.061950 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d50a137-e5d1-4963-bf69-793c114d9ac0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:15.187556 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-71d9d3cb-3540-4628-8cad-0e552f864fc3 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:15.217661 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-71d9d3cb-3540-4628-8cad-0e552f864fc3 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1608 microversion: 2.1 time: 0.624115 Jun 16 14:48:15.218733 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 998/2048] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:14 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1608 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:15.232132 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-12357caf-c915-4be1-80ae-da8abad5024f tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Action: 'update', calling method: .version_select at 0x7fdf0c2b2700>, body: {"quota_set": {"instances": 10}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:15.626154 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5d50a137-e5d1-4963-bf69-793c114d9ac0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:15.643279 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5d50a137-e5d1-4963-bf69-793c114d9ac0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:15.653558 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5d50a137-e5d1-4963-bf69-793c114d9ac0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:15.657125 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5d50a137-e5d1-4963-bf69-793c114d9ac0 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1438 microversion: 2.25 time: 0.624024 Jun 16 14:48:15.658836 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1051/2049] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:15 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1438 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:15.669853 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-752299041", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "3140785d-f673-4aae-abcb-d2ef972abb5e"}]}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:15.778716 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-12357caf-c915-4be1-80ae-da8abad5024f tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:15.779884 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-12357caf-c915-4be1-80ae-da8abad5024f tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:15.780963 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-12357caf-c915-4be1-80ae-da8abad5024f tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:15.781744 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-12357caf-c915-4be1-80ae-da8abad5024f tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:15.910481 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] validate_networks() for [('3140785d-f673-4aae-abcb-d2ef972abb5e', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:48:15.941777 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-12357caf-c915-4be1-80ae-da8abad5024f tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81" status: 200 len: 329 microversion: 2.1 time: 0.719943 Jun 16 14:48:15.944041 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 999/2050] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jun 16 14:48:15 2022] PUT /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81 => generated 329 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:15.963489 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-e61cd812-27ce-4fd2-a0e6-fb4cba600b7d req-6da292cc-a04d-4b92-b74d-1620d9cdcea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c77529a-f41c-4253-b703-8ef094f934f2", "name": "network-vif-deleted", "tag": "a569649a-653d-4712-9e65-932e9431dcd3"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:15.994902 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-e61cd812-27ce-4fd2-a0e6-fb4cba600b7d req-6da292cc-a04d-4b92-b74d-1620d9cdcea2 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:15.996941 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-e61cd812-27ce-4fd2-a0e6-fb4cba600b7d req-6da292cc-a04d-4b92-b74d-1620d9cdcea2 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:16.065758 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-e61cd812-27ce-4fd2-a0e6-fb4cba600b7d req-6da292cc-a04d-4b92-b74d-1620d9cdcea2 service nova] Creating event network-vif-deleted:a569649a-653d-4712-9e65-932e9431dcd3 for instance 2c77529a-f41c-4253-b703-8ef094f934f2 on n-h1-836830-4 Jun 16 14:48:16.105381 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-e61cd812-27ce-4fd2-a0e6-fb4cba600b7d req-6da292cc-a04d-4b92-b74d-1620d9cdcea2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153293 Jun 16 14:48:16.109095 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1000/2051] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:16.131075 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e319a208-fb51-4fda-a47e-6f77eb11bdcc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '.version_select at 0x7fdeffb600d0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:16.195457 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-e319a208-fb51-4fda-a47e-6f77eb11bdcc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] HTTP exception thrown: Image not found. Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e319a208-fb51-4fda-a47e-6f77eb11bdcc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Request method failure captured: Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/images/3eafe73e-7326-4aeb-b70f-0901aed35135 HTTP/1.1 Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0HwzjjfEOzwOCijJMwAIM9bloQokdG738AdmO2AfwSY4wjVjyQLh9lWAzH4Rn8UCfDe9NW9edyGFTRe1GgDBY6cMZzBwN1dffuTKMcXrVyPL7r_AJ0308sfSN5YHtB5BJ4xC8C7QdPv6xOmwCbcFwnW04fPzhAdrkooBYSucmrM6SQ Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:48:16.197691 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:48:16.203183 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b46102b0fb544d118e324f7fcf654eb2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b46102b0fb544d118e324f7fcf654eb2"}]}] Jun 16 14:48:16.203183 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:16.203183 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:48:16.203183 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:16.203183 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:48:16.203183 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:48:16.203183 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:48:16.203183 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 8fc694c86102467bb97072ca4972b223 Jun 16 14:48:16.203183 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:48:16.203183 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:48:16.203183 n-d-836830-4 devstack@n-api.service[125863]: exception: Image not found. Jun 16 14:48:16.203183 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '3eafe73e-7326-4aeb-b70f-0901aed35135'} Jun 16 14:48:16.203183 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3eafe73e-7326-4aeb-b70f-0901aed35135 to delete Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:16.205988 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3eafe73e-7326-4aeb-b70f-0901aed35135 could not be found. Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:16.210314 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:16.216952 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 14:48:16.216952 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:48:16.216952 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:48:16.216952 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:16.216952 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:16.216952 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:16.216952 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:16.216952 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:16.216952 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:16.216952 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:16.216952 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:16.216952 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:48:16.216952 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:16.216952 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e319a208-fb51-4fda-a47e-6f77eb11bdcc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Returning 404 to user: Image not found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:16.216952 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e319a208-fb51-4fda-a47e-6f77eb11bdcc tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "DELETE /compute/v2.1/images/3eafe73e-7326-4aeb-b70f-0901aed35135" status: 404 len: 62 microversion: 2.1 time: 0.089358 Jun 16 14:48:16.219412 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1001/2052] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:16 2022] DELETE /compute/v2.1/images/3eafe73e-7326-4aeb-b70f-0901aed35135 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:48:16.219412 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-44bec91c-3b11-4d6b-842c-eff81b0a8a5d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:16.219816 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-44bec91c-3b11-4d6b-842c-eff81b0a8a5d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:16.242766 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44bec91c-3b11-4d6b-842c-eff81b0a8a5d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:16.247762 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44bec91c-3b11-4d6b-842c-eff81b0a8a5d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:16.248939 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44bec91c-3b11-4d6b-842c-eff81b0a8a5d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:16.249471 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44bec91c-3b11-4d6b-842c-eff81b0a8a5d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:16.978822 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-44bec91c-3b11-4d6b-842c-eff81b0a8a5d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:17.008342 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-44bec91c-3b11-4d6b-842c-eff81b0a8a5d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1317 microversion: 2.1 time: 0.805244 Jun 16 14:48:17.009707 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1002/2053] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:16 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1317 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:17.053264 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d46a2839-ca49-4490-8790-d811ae19301d tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Calling method '.version_select at 0x7fdf11004310>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:17.366237 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d46a2839-ca49-4490-8790-d811ae19301d tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81" status: 200 len: 371 microversion: 2.1 time: 0.326837 Jun 16 14:48:17.367399 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1003/2054] 10.222.0.57 () {58 vars in 1241 bytes} [Thu Jun 16 14:48:17 2022] GET /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81 => generated 371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:17.389116 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-4673df22-fea1-41dd-b27a-44bfc685c9e7 req-0595c4dd-d820-4bd3-8846-2cc3be0c8361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de", "name": "network-vif-plugged", "status": "completed", "tag": "4f2964ee-bda2-45df-955e-ebf34a3e9f77"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:17.425169 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-4673df22-fea1-41dd-b27a-44bfc685c9e7 req-0595c4dd-d820-4bd3-8846-2cc3be0c8361 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:17.428999 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-4673df22-fea1-41dd-b27a-44bfc685c9e7 req-0595c4dd-d820-4bd3-8846-2cc3be0c8361 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:17.472669 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:17.477173 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-4673df22-fea1-41dd-b27a-44bfc685c9e7 req-0595c4dd-d820-4bd3-8846-2cc3be0c8361 service nova] Creating event network-vif-plugged:4f2964ee-bda2-45df-955e-ebf34a3e9f77 for instance 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de on n-h1-836830-4 Jun 16 14:48:17.488856 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-4673df22-fea1-41dd-b27a-44bfc685c9e7 req-0595c4dd-d820-4bd3-8846-2cc3be0c8361 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119233 Jun 16 14:48:17.490451 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1004/2055] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:17.503484 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-be683d0b-63cb-4969-8021-78d875d0c61e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:17.505055 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-be683d0b-63cb-4969-8021-78d875d0c61e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:17.521710 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-be683d0b-63cb-4969-8021-78d875d0c61e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:17.523182 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-be683d0b-63cb-4969-8021-78d875d0c61e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:17.524967 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-be683d0b-63cb-4969-8021-78d875d0c61e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:17.526051 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-be683d0b-63cb-4969-8021-78d875d0c61e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:17.556456 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-be683d0b-63cb-4969-8021-78d875d0c61e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] HTTP exception thrown: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-be683d0b-63cb-4969-8021-78d875d0c61e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Request method failure captured: Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d HTTP/1.1 Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0HwzjjfEOzwOCijJMwAIM9bloQokdG738AdmO2AfwSY4wjVjyQLh9lWAzH4Rn8UCfDe9NW9edyGFTRe1GgDBY6cMZzBwN1dffuTKMcXrVyPL7r_AJ0308sfSN5YHtB5BJ4xC8C7QdPv6xOmwCbcFwnW04fPzhAdrkooBYSucmrM6SQ Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:48:17.562301 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:48:17.565094 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b46102b0fb544d118e324f7fcf654eb2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b46102b0fb544d118e324f7fcf654eb2"}]}] Jun 16 14:48:17.565094 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:17.565094 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:48:17.565094 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:17.565094 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:48:17.565094 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:48:17.565094 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:48:17.565094 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 8fc694c86102467bb97072ca4972b223 Jun 16 14:48:17.565094 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:48:17.565094 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:48:17.565094 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. Jun 16 14:48:17.565094 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '93a4bc09-c518-4934-842c-4ab2b5a50e0d'} Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:17.566669 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. Jun 16 14:48:17.570588 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:17.579192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-be683d0b-63cb-4969-8021-78d875d0c61e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Returning 404 to user: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:17.581458 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-be683d0b-63cb-4969-8021-78d875d0c61e tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "DELETE /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 404 len: 111 microversion: 2.1 time: 0.088198 Jun 16 14:48:17.583431 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1005/2056] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:48:17 2022] DELETE /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:48:17.597271 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-706941e6-a7ab-4f52-b2b4-52772518c70d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:17.598828 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-706941e6-a7ab-4f52-b2b4-52772518c70d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:17.617076 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-706941e6-a7ab-4f52-b2b4-52772518c70d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:17.617076 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-706941e6-a7ab-4f52-b2b4-52772518c70d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:17.619193 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-706941e6-a7ab-4f52-b2b4-52772518c70d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:17.620158 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-706941e6-a7ab-4f52-b2b4-52772518c70d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:18.482422 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-706941e6-a7ab-4f52-b2b4-52772518c70d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:18.530730 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-706941e6-a7ab-4f52-b2b4-52772518c70d tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1540 microversion: 2.1 time: 0.932936 Jun 16 14:48:18.534180 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1006/2057] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:17 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1540 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:18.554248 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-85f93b7c-8951-41e8-bfe0-7d096a1408b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:18.556303 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-85f93b7c-8951-41e8-bfe0-7d096a1408b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:18.576649 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85f93b7c-8951-41e8-bfe0-7d096a1408b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:18.578863 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85f93b7c-8951-41e8-bfe0-7d096a1408b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:18.587341 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85f93b7c-8951-41e8-bfe0-7d096a1408b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:18.592033 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85f93b7c-8951-41e8-bfe0-7d096a1408b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:18.782940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:48:18.784908 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:48:18.791440 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:48:18.794242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:48:18.798347 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:48:18.814548 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-85f93b7c-8951-41e8-bfe0-7d096a1408b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:18.829644 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-85f93b7c-8951-41e8-bfe0-7d096a1408b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:18.847021 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-85f93b7c-8951-41e8-bfe0-7d096a1408b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:18.848384 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-85f93b7c-8951-41e8-bfe0-7d096a1408b9 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1264 microversion: 2.25 time: 0.312081 Jun 16 14:48:18.848984 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1007/2058] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:18 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1264 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:18.864148 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:18.865406 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:18.867440 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-81704745-35d4-4a1c-ac93-5240919279e4 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Action: 'update', calling method: .version_select at 0x7fdf11004310>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:18.876892 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:18.885577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:19.027876 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Getting quotas for project 1ac65ee04fbf47608c18c173900ad8f7. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:48:19.069922 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Getting quotas for user f91d14d5fb884048a0b12279c62e963d and project 1ac65ee04fbf47608c18c173900ad8f7. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:48:19.113137 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81704745-35d4-4a1c-ac93-5240919279e4 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:19.113975 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81704745-35d4-4a1c-ac93-5240919279e4 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:19.121950 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81704745-35d4-4a1c-ac93-5240919279e4 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:19.122985 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81704745-35d4-4a1c-ac93-5240919279e4 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:19.139175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:48:19.155497 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:48:19.209967 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:19.252004 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:19.295643 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-81704745-35d4-4a1c-ac93-5240919279e4 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81" status: 200 len: 325 microversion: 2.1 time: 0.441274 Jun 16 14:48:19.297945 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1008/2059] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jun 16 14:48:18 2022] PUT /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81 => generated 325 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:19.309626 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b546fdc1-601f-4bf0-98a2-8edb97c27081 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:19.312907 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b546fdc1-601f-4bf0-98a2-8edb97c27081 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] [instance: 93a4bc09-c518-4934-842c-4ab2b5a50e0d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:19.333180 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b546fdc1-601f-4bf0-98a2-8edb97c27081 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:19.334267 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b546fdc1-601f-4bf0-98a2-8edb97c27081 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:19.335910 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b546fdc1-601f-4bf0-98a2-8edb97c27081 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:19.340701 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b546fdc1-601f-4bf0-98a2-8edb97c27081 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:19.391338 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-b546fdc1-601f-4bf0-98a2-8edb97c27081 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] HTTP exception thrown: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b546fdc1-601f-4bf0-98a2-8edb97c27081 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Request method failure captured: Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d HTTP/1.1 Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0HwzjjfEOzwOCijJMwAIM9bloQokdG738AdmO2AfwSY4wjVjyQLh9lWAzH4Rn8UCfDe9NW9edyGFTRe1GgDBY6cMZzBwN1dffuTKMcXrVyPL7r_AJ0308sfSN5YHtB5BJ4xC8C7QdPv6xOmwCbcFwnW04fPzhAdrkooBYSucmrM6SQ Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:48:19.396199 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:48:19.399279 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b46102b0fb544d118e324f7fcf654eb2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b46102b0fb544d118e324f7fcf654eb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b46102b0fb544d118e324f7fcf654eb2"}]}] Jun 16 14:48:19.399279 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:19.399279 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b46102b0fb544d118e324f7fcf654eb2 Jun 16 14:48:19.399279 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918 Jun 16 14:48:19.399279 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:48:19.399279 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:48:19.399279 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:48:19.399279 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 8fc694c86102467bb97072ca4972b223 Jun 16 14:48:19.399279 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1690104918-project Jun 16 14:48:19.399279 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:48:19.399279 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. Jun 16 14:48:19.399279 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '93a4bc09-c518-4934-842c-4ab2b5a50e0d'} Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:19.400738 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. Jun 16 14:48:19.405069 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:19.411262 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b546fdc1-601f-4bf0-98a2-8edb97c27081 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] Returning 404 to user: Instance 93a4bc09-c518-4934-842c-4ab2b5a50e0d could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:19.411262 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b546fdc1-601f-4bf0-98a2-8edb97c27081 tempest-ImagesOneServerNegativeTestJSON-1690104918 tempest-ImagesOneServerNegativeTestJSON-1690104918-project] 10.222.0.57 "GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d" status: 404 len: 111 microversion: 2.1 time: 0.110588 Jun 16 14:48:19.422196 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1009/2060] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:19 2022] GET /compute/v2.1/servers/93a4bc09-c518-4934-842c-4ab2b5a50e0d => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:48:19.427839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-31010e7b-5952-4a2d-843a-ffe3d020ff5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:19.430184 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-31010e7b-5952-4a2d-843a-ffe3d020ff5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:19.453515 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8e118acd-19a2-45be-8684-8795bd73dc98 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.792474 Jun 16 14:48:19.459296 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1052/2061] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:48:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:48:19.478439 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31010e7b-5952-4a2d-843a-ffe3d020ff5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:19.479283 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31010e7b-5952-4a2d-843a-ffe3d020ff5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:19.481854 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31010e7b-5952-4a2d-843a-ffe3d020ff5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:19.482754 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31010e7b-5952-4a2d-843a-ffe3d020ff5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:19.491737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-b97fc429-6d7c-46fc-b9ea-3ee3441473c3 req-2624b6df-14e1-4e62-9c18-696ef5342264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10edf992-de67-491e-a852-b01b4d61f050", "name": "network-vif-deleted", "tag": "41ff13ee-3afd-4b91-b9aa-45a9e6952aa6"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:19.542100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-b97fc429-6d7c-46fc-b9ea-3ee3441473c3 req-2624b6df-14e1-4e62-9c18-696ef5342264 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:19.543652 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-b97fc429-6d7c-46fc-b9ea-3ee3441473c3 req-2624b6df-14e1-4e62-9c18-696ef5342264 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:19.612657 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-b97fc429-6d7c-46fc-b9ea-3ee3441473c3 req-2624b6df-14e1-4e62-9c18-696ef5342264 service nova] Creating event network-vif-deleted:41ff13ee-3afd-4b91-b9aa-45a9e6952aa6 for instance 10edf992-de67-491e-a852-b01b4d61f050 on n-h1-836830-4 Jun 16 14:48:19.629304 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-b97fc429-6d7c-46fc-b9ea-3ee3441473c3 req-2624b6df-14e1-4e62-9c18-696ef5342264 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164137 Jun 16 14:48:19.636283 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1053/2062] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:19.667201 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-340546093", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:19.850552 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] validate_networks() for None {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:48:19.989085 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-31010e7b-5952-4a2d-843a-ffe3d020ff5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:20.009708 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-31010e7b-5952-4a2d-843a-ffe3d020ff5f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1317 microversion: 2.1 time: 0.585765 Jun 16 14:48:20.013319 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1010/2063] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:19 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:20.021946 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-31d7db67-2fb5-4d2a-b695-94e3c58d5125 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:20.026826 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-31d7db67-2fb5-4d2a-b695-94e3c58d5125 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:20.245682 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-31d7db67-2fb5-4d2a-b695-94e3c58d5125 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:20.268477 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-31d7db67-2fb5-4d2a-b695-94e3c58d5125 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1207 microversion: 2.1 time: 0.251501 Jun 16 14:48:20.271526 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1011/2064] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:20 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1207 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:20.290619 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d37503af-8945-4421-b983-c5889dcebcd1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:20.292415 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d37503af-8945-4421-b983-c5889dcebcd1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:20.332770 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d37503af-8945-4421-b983-c5889dcebcd1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:20.335736 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d37503af-8945-4421-b983-c5889dcebcd1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:20.345034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d37503af-8945-4421-b983-c5889dcebcd1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:20.346244 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d37503af-8945-4421-b983-c5889dcebcd1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:20.588884 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d37503af-8945-4421-b983-c5889dcebcd1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:20.678052 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d37503af-8945-4421-b983-c5889dcebcd1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1253 microversion: 2.1 time: 0.388457 Jun 16 14:48:20.700886 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1012/2065] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:20 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1253 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:20.729086 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c2c7c364-e694-4e76-a700-bb6ace0d3eeb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:20.732056 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c2c7c364-e694-4e76-a700-bb6ace0d3eeb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:20.761494 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c2c7c364-e694-4e76-a700-bb6ace0d3eeb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:20.767507 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c2c7c364-e694-4e76-a700-bb6ace0d3eeb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:20.769554 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c2c7c364-e694-4e76-a700-bb6ace0d3eeb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:20.778310 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c2c7c364-e694-4e76-a700-bb6ace0d3eeb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:21.128855 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c2c7c364-e694-4e76-a700-bb6ace0d3eeb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:21.150614 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c2c7c364-e694-4e76-a700-bb6ace0d3eeb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:21.153430 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c2c7c364-e694-4e76-a700-bb6ace0d3eeb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:21.155370 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c2c7c364-e694-4e76-a700-bb6ace0d3eeb tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1264 microversion: 2.25 time: 0.463606 Jun 16 14:48:21.156839 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1013/2066] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:20 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1264 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:21.183070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-1289c1fc-d0e0-4736-bc07-ea76690a2d88 req-14f21ed6-9fa7-4b2e-9be1-b5c43a521ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76875a5-11a5-4d7f-9db3-7a731c2589a1", "name": "network-vif-unplugged", "status": "completed", "tag": "b6ac5e50-81ef-41de-8ac9-bed451827a4f"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:21.194924 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:48:21.195823 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:48:21.196966 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:48:21.197995 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:48:21.199138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:48:21.210209 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-1289c1fc-d0e0-4736-bc07-ea76690a2d88 req-14f21ed6-9fa7-4b2e-9be1-b5c43a521ffd service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:21.210959 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-1289c1fc-d0e0-4736-bc07-ea76690a2d88 req-14f21ed6-9fa7-4b2e-9be1-b5c43a521ffd service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:21.240398 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:21.241580 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:21.247400 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-1289c1fc-d0e0-4736-bc07-ea76690a2d88 req-14f21ed6-9fa7-4b2e-9be1-b5c43a521ffd service nova] Creating event network-vif-unplugged:b6ac5e50-81ef-41de-8ac9-bed451827a4f for instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 on n-h2-836830-4 Jun 16 14:48:21.249650 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:21.250850 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:21.257693 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-1289c1fc-d0e0-4736-bc07-ea76690a2d88 req-14f21ed6-9fa7-4b2e-9be1-b5c43a521ffd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098759 Jun 16 14:48:21.259075 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1014/2067] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:21.271225 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-60d7cd0b-163b-4698-a80d-e898be5c713a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:21.272765 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-60d7cd0b-163b-4698-a80d-e898be5c713a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:21.289759 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-60d7cd0b-163b-4698-a80d-e898be5c713a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:21.293635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-60d7cd0b-163b-4698-a80d-e898be5c713a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:21.297386 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-60d7cd0b-163b-4698-a80d-e898be5c713a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:21.297386 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-60d7cd0b-163b-4698-a80d-e898be5c713a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:21.361140 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Getting quotas for project 537923f1aae7469e97a6166b1d317d81. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:48:21.382627 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Getting quotas for user fe87ed67b8f749bd9680408ac899ff79 and project 537923f1aae7469e97a6166b1d317d81. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:48:21.445148 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.utils [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] ram quota exceeded for 537923f1aae7469e97a6166b1d317d81, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125862) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 16 14:48:21.446606 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Request method failure captured: Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 144 Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0KkZwfDiERFkC42RZe8FporYiIU-sOu3vdCCi9s9BeBOLFJI7zOqUq5lJZM7aH4x2IfZoqoR8WDrrYkwDG09LJH-kzOFUozNysPUDyVvyXJg60seYaJzgIKAf_TLUF7ErJ1GgY1jyWXRQq4qFpMjIH8fS0Ei9fAYZR2SFObrm5nupA Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 537923f1aae7469e97a6166b1d317d81 Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-QuotasAdminNegativeTest-1496990499 Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:48:21.458098 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:48:21.461465 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_537923f1aae7469e97a6166b1d317d81", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/537923f1aae7469e97a6166b1d317d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/537923f1aae7469e97a6166b1d317d81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/537923f1aae7469e97a6166b1d317d81"}]}] Jun 16 14:48:21.461465 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-QuotasAdminNegativeTest-1496990499 Jun 16 14:48:21.461465 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 537923f1aae7469e97a6166b1d317d81 Jun 16 14:48:21.461465 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1496990499 Jun 16 14:48:21.461465 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-QuotasAdminNegativeTest-1496990499-project Jun 16 14:48:21.461465 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:48:21.461465 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:48:21.461465 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: fe87ed67b8f749bd9680408ac899ff79 Jun 16 14:48:21.461465 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-QuotasAdminNegativeTest-1496990499-project Jun 16 14:48:21.461465 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:48:21.461465 n-d-836830-4 devstack@n-api.service[125862]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-340546093", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} Jun 16 14:48:21.461465 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-340546093', 'imageRef': '3c5b2063-0858-477e-a4dd-6736a4c60e42', 'flavorRef': '452'}}} Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 16 14:48:21.463349 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:21.467457 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:21.470633 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:21.473732 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:21.473732 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:21.473732 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:21.473732 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:21.473732 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 16 14:48:21.473732 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:21.478412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:21.478412 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cef50d22-4a64-4184-a8e7-444c4999d099 tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.832473 Jun 16 14:48:21.483601 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1054/2068] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:48:19 2022] POST /compute/v2.1/servers => generated 110 bytes in 1846 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:48:21.501848 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ffc8fdcf-d409-4783-9193-9e7132fd49ce tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:21.516750 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ffc8fdcf-d409-4783-9193-9e7132fd49ce tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:21.540061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffc8fdcf-d409-4783-9193-9e7132fd49ce tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:21.544802 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffc8fdcf-d409-4783-9193-9e7132fd49ce tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:21.550456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffc8fdcf-d409-4783-9193-9e7132fd49ce tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:21.555640 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ffc8fdcf-d409-4783-9193-9e7132fd49ce tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:21.712752 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-60d7cd0b-163b-4698-a80d-e898be5c713a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:21.766527 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-60d7cd0b-163b-4698-a80d-e898be5c713a tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1467 microversion: 2.1 time: 0.504359 Jun 16 14:48:21.782438 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1015/2069] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:21 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1467 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:21.802369 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c6ac683f-2532-4ac2-8d80-fb4eb5c907d4 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Action: 'update', calling method: .version_select at 0x7fdf11097a60>, body: {"quota_set": {"ram": 51200}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:21.972151 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ffc8fdcf-d409-4783-9193-9e7132fd49ce tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:21.975541 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c6ac683f-2532-4ac2-8d80-fb4eb5c907d4 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:21.985987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c6ac683f-2532-4ac2-8d80-fb4eb5c907d4 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:21.988156 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c6ac683f-2532-4ac2-8d80-fb4eb5c907d4 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:21.988988 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c6ac683f-2532-4ac2-8d80-fb4eb5c907d4 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:22.011219 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ffc8fdcf-d409-4783-9193-9e7132fd49ce tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1203 microversion: 2.1 time: 0.525148 Jun 16 14:48:22.016273 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1055/2070] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:21 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1203 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:22.031346 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-6fca613f-1819-4581-ad1e-051fbb95dbbc req-8eb1247d-ec44-4d47-90ae-2ca763d7ff5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76875a5-11a5-4d7f-9db3-7a731c2589a1", "name": "network-vif-deleted", "tag": "b6ac5e50-81ef-41de-8ac9-bed451827a4f"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:22.104089 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-6fca613f-1819-4581-ad1e-051fbb95dbbc req-8eb1247d-ec44-4d47-90ae-2ca763d7ff5e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:22.104930 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-6fca613f-1819-4581-ad1e-051fbb95dbbc req-8eb1247d-ec44-4d47-90ae-2ca763d7ff5e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:22.132183 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-6fca613f-1819-4581-ad1e-051fbb95dbbc req-8eb1247d-ec44-4d47-90ae-2ca763d7ff5e service nova] Creating event network-vif-deleted:b6ac5e50-81ef-41de-8ac9-bed451827a4f for instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 on n-h2-836830-4 Jun 16 14:48:22.143762 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-6fca613f-1819-4581-ad1e-051fbb95dbbc req-8eb1247d-ec44-4d47-90ae-2ca763d7ff5e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124295 Jun 16 14:48:22.150893 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1056/2071] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:22.163276 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d7426634-65db-4446-a4b6-92673186c6fb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:22.164203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d7426634-65db-4446-a4b6-92673186c6fb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:22.193984 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d7426634-65db-4446-a4b6-92673186c6fb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:22.194538 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d7426634-65db-4446-a4b6-92673186c6fb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:22.200501 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d7426634-65db-4446-a4b6-92673186c6fb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:22.203392 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d7426634-65db-4446-a4b6-92673186c6fb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:22.204846 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c6ac683f-2532-4ac2-8d80-fb4eb5c907d4 tempest-QuotasAdminNegativeTest-265976910 tempest-QuotasAdminNegativeTest-265976910-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81" status: 200 len: 329 microversion: 2.1 time: 0.428294 Jun 16 14:48:22.207299 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1016/2072] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jun 16 14:48:21 2022] PUT /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81 => generated 329 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:22.217922 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5a9bf38e-6a85-44b4-ac7a-4ccd5970cbd7 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:22.219315 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5a9bf38e-6a85-44b4-ac7a-4ccd5970cbd7 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:22.238240 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5a9bf38e-6a85-44b4-ac7a-4ccd5970cbd7 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:22.239394 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5a9bf38e-6a85-44b4-ac7a-4ccd5970cbd7 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:22.240703 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5a9bf38e-6a85-44b4-ac7a-4ccd5970cbd7 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:22.241352 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5a9bf38e-6a85-44b4-ac7a-4ccd5970cbd7 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:22.444202 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d7426634-65db-4446-a4b6-92673186c6fb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:22.463941 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d7426634-65db-4446-a4b6-92673186c6fb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1253 microversion: 2.1 time: 0.311596 Jun 16 14:48:22.466047 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1057/2073] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:22 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1253 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:22.481871 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3d71fffd-9d93-4ca5-9a99-d1be00a56b16 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:22.486001 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3d71fffd-9d93-4ca5-9a99-d1be00a56b16 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:22.505632 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d71fffd-9d93-4ca5-9a99-d1be00a56b16 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:22.508803 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d71fffd-9d93-4ca5-9a99-d1be00a56b16 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:22.510039 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d71fffd-9d93-4ca5-9a99-d1be00a56b16 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:22.512260 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d71fffd-9d93-4ca5-9a99-d1be00a56b16 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:22.579819 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5a9bf38e-6a85-44b4-ac7a-4ccd5970cbd7 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1618 microversion: 2.1 time: 0.369181 Jun 16 14:48:22.585283 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1017/2074] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:22 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1618 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:22.608828 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f1744667-d7d1-4c83-a291-6a399da7d78c tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Action: 'update', calling method: .version_select at 0x7fdf110973a0>, body: {"quota_set": {"ram": 0}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:22.619474 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f1744667-d7d1-4c83-a291-6a399da7d78c tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'fe87ed67b8f749bd9680408ac899ff79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537923f1aae7469e97a6166b1d317d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f1744667-d7d1-4c83-a291-6a399da7d78c tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Request method failure captured: Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: request: PUT /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81 HTTP/1.1 Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 25 Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0KkZwfDiERFkC42RZe8FporYiIU-sOu3vdCCi9s9BeBOLFJI7zOqUq5lJZM7aH4x2IfZoqoR8WDrrYkwDG09LJH-kzOFUozNysPUDyVvyXJg60seYaJzgIKAf_TLUF7ErJ1GgY1jyWXRQq4qFpMjIH8fS0Ei9fAYZR2SFObrm5nupA Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 537923f1aae7469e97a6166b1d317d81 Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-QuotasAdminNegativeTest-1496990499 Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:48:22.633463 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:48:22.635360 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_537923f1aae7469e97a6166b1d317d81", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/537923f1aae7469e97a6166b1d317d81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/537923f1aae7469e97a6166b1d317d81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/537923f1aae7469e97a6166b1d317d81"}]}] Jun 16 14:48:22.635360 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-QuotasAdminNegativeTest-1496990499 Jun 16 14:48:22.635360 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 537923f1aae7469e97a6166b1d317d81 Jun 16 14:48:22.635360 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1496990499 Jun 16 14:48:22.635360 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-QuotasAdminNegativeTest-1496990499-project Jun 16 14:48:22.635360 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:48:22.635360 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:48:22.635360 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: fe87ed67b8f749bd9680408ac899ff79 Jun 16 14:48:22.635360 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-QuotasAdminNegativeTest-1496990499-project Jun 16 14:48:22.635360 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:48:22.635360 n-d-836830-4 devstack@n-api.service[125863]: {"quota_set": {"ram": 0}} Jun 16 14:48:22.635360 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:48:22.635360 n-d-836830-4 devstack@n-api.service[125863]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 16 14:48:22.635360 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '537923f1aae7469e97a6166b1d317d81', 'body': {'quota_set': {'ram': 0}}} Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:48:22.637178 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:22.643561 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:22.645246 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:22.645246 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:22.645246 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:48:22.645246 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:48:22.645246 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 16 14:48:22.645246 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:22.645246 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f1744667-d7d1-4c83-a291-6a399da7d78c tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:22.645246 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f1744667-d7d1-4c83-a291-6a399da7d78c tempest-QuotasAdminNegativeTest-1496990499 tempest-QuotasAdminNegativeTest-1496990499-project] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81" status: 403 len: 116 microversion: 2.1 time: 0.048626 Jun 16 14:48:22.645246 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1018/2075] 10.222.0.57 () {60 vars in 1261 bytes} [Thu Jun 16 14:48:22 2022] PUT /compute/v2.1/os-quota-sets/537923f1aae7469e97a6166b1d317d81 => generated 116 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:48:22.912035 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3d71fffd-9d93-4ca5-9a99-d1be00a56b16 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:22.936001 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3d71fffd-9d93-4ca5-9a99-d1be00a56b16 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:22.945776 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3d71fffd-9d93-4ca5-9a99-d1be00a56b16 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:22.958624 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3d71fffd-9d93-4ca5-9a99-d1be00a56b16 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1264 microversion: 2.25 time: 0.490473 Jun 16 14:48:22.976561 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1103307895", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:22.977335 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1058/2076] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:22 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1264 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:23.041221 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bdfbe49a-b3d6-44bd-b74f-4315ed37bb1e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:23.044968 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bdfbe49a-b3d6-44bd-b74f-4315ed37bb1e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:23.070371 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bdfbe49a-b3d6-44bd-b74f-4315ed37bb1e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:23.071149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bdfbe49a-b3d6-44bd-b74f-4315ed37bb1e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:23.073214 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bdfbe49a-b3d6-44bd-b74f-4315ed37bb1e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:23.076999 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bdfbe49a-b3d6-44bd-b74f-4315ed37bb1e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:23.181455 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:48:23.280586 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bdfbe49a-b3d6-44bd-b74f-4315ed37bb1e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:23.299650 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bdfbe49a-b3d6-44bd-b74f-4315ed37bb1e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1265 microversion: 2.1 time: 0.272927 Jun 16 14:48:23.304034 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1059/2077] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:23 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:23.486460 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2f9ff666-e3e1-4c2b-92c3-d7af276565ad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:23.487389 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2f9ff666-e3e1-4c2b-92c3-d7af276565ad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:23.524865 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2f9ff666-e3e1-4c2b-92c3-d7af276565ad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:23.527831 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2f9ff666-e3e1-4c2b-92c3-d7af276565ad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:23.531161 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2f9ff666-e3e1-4c2b-92c3-d7af276565ad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:23.541588 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2f9ff666-e3e1-4c2b-92c3-d7af276565ad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:23.851620 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2f9ff666-e3e1-4c2b-92c3-d7af276565ad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:23.856979 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:48:23.857772 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:48:23.858839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:48:23.859601 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:48:23.862944 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:48:23.891493 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2f9ff666-e3e1-4c2b-92c3-d7af276565ad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1253 microversion: 2.1 time: 0.411265 Jun 16 14:48:23.892553 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1060/2078] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:23 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1253 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:23.898966 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:23.899778 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:23.901324 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:23.906430 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:23.972410 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:48:23.984668 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-18ff5b30-b73b-4faf-8c77-de89fa6f7b83 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:23.989311 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-18ff5b30-b73b-4faf-8c77-de89fa6f7b83 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:24.007069 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Getting quotas for user 70569cb340194ec0876d91d79cc6fa5f and project f00d93de6d784ffdbbfbfe050b70e4a8. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:48:24.020525 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18ff5b30-b73b-4faf-8c77-de89fa6f7b83 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:24.028147 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18ff5b30-b73b-4faf-8c77-de89fa6f7b83 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:24.030021 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18ff5b30-b73b-4faf-8c77-de89fa6f7b83 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:24.031205 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-18ff5b30-b73b-4faf-8c77-de89fa6f7b83 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:24.085181 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:48:24.091948 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:48:24.234363 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4232abd6-214f-462a-9a5e-4184aafd1c55 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.263534 Jun 16 14:48:24.240331 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1019/2079] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:48:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:48:24.263468 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-44799001-0e56-4352-bd44-ffc40703d68b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:24.267201 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-44799001-0e56-4352-bd44-ffc40703d68b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:24.317187 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-18ff5b30-b73b-4faf-8c77-de89fa6f7b83 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:24.346004 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-18ff5b30-b73b-4faf-8c77-de89fa6f7b83 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:24.360708 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-18ff5b30-b73b-4faf-8c77-de89fa6f7b83 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:24.363328 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-18ff5b30-b73b-4faf-8c77-de89fa6f7b83 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1264 microversion: 2.25 time: 0.386952 Jun 16 14:48:24.365225 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1061/2080] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:23 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1264 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:48:24.389777 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d1986f4b-8b68-405b-8827-7c7098079c02 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:24.390976 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d1986f4b-8b68-405b-8827-7c7098079c02 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:24.419788 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d1986f4b-8b68-405b-8827-7c7098079c02 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:24.421125 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d1986f4b-8b68-405b-8827-7c7098079c02 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:24.422686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d1986f4b-8b68-405b-8827-7c7098079c02 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:24.431744 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d1986f4b-8b68-405b-8827-7c7098079c02 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:24.548896 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-44799001-0e56-4352-bd44-ffc40703d68b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:24.603039 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-44799001-0e56-4352-bd44-ffc40703d68b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1217 microversion: 2.1 time: 0.351740 Jun 16 14:48:24.604268 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1020/2081] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:24 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1217 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:48:24.924925 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2c5cceaa-0c61-42cf-a734-fea90714c843 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:24.929437 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2c5cceaa-0c61-42cf-a734-fea90714c843 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:24.977898 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2c5cceaa-0c61-42cf-a734-fea90714c843 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:24.980898 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2c5cceaa-0c61-42cf-a734-fea90714c843 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:24.985964 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2c5cceaa-0c61-42cf-a734-fea90714c843 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:24.990674 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2c5cceaa-0c61-42cf-a734-fea90714c843 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:25.212229 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2c5cceaa-0c61-42cf-a734-fea90714c843 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:25.238008 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2c5cceaa-0c61-42cf-a734-fea90714c843 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1253 microversion: 2.1 time: 0.330037 Jun 16 14:48:25.239932 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1021/2082] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:24 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1253 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:25.266783 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d1986f4b-8b68-405b-8827-7c7098079c02 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:25.297064 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d1986f4b-8b68-405b-8827-7c7098079c02 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1307 microversion: 2.1 time: 0.928179 Jun 16 14:48:25.311979 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1062/2083] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:24 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1307 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:25.391506 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-076c507b-4939-439b-aa03-5c1cb191c731 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:25.392621 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-076c507b-4939-439b-aa03-5c1cb191c731 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:25.411311 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-076c507b-4939-439b-aa03-5c1cb191c731 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:25.413654 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-076c507b-4939-439b-aa03-5c1cb191c731 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:25.415811 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-076c507b-4939-439b-aa03-5c1cb191c731 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:25.419951 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-076c507b-4939-439b-aa03-5c1cb191c731 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:25.637700 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c59fcaea-412c-4c4f-bf78-c03955d9f156 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:25.638683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c59fcaea-412c-4c4f-bf78-c03955d9f156 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:25.654833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c59fcaea-412c-4c4f-bf78-c03955d9f156 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:25.655755 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c59fcaea-412c-4c4f-bf78-c03955d9f156 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:25.656964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c59fcaea-412c-4c4f-bf78-c03955d9f156 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:25.657967 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c59fcaea-412c-4c4f-bf78-c03955d9f156 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:25.835512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-076c507b-4939-439b-aa03-5c1cb191c731 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:25.866070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-076c507b-4939-439b-aa03-5c1cb191c731 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:25.871414 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-076c507b-4939-439b-aa03-5c1cb191c731 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:25.876859 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-076c507b-4939-439b-aa03-5c1cb191c731 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1264 microversion: 2.25 time: 0.487948 Jun 16 14:48:25.878077 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1022/2084] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:25 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1264 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:26.258717 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7ee7672d-8249-4f88-853a-6a2ddcd7da63 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:26.261139 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7ee7672d-8249-4f88-853a-6a2ddcd7da63 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:26.299235 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ee7672d-8249-4f88-853a-6a2ddcd7da63 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:26.300783 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ee7672d-8249-4f88-853a-6a2ddcd7da63 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:26.302078 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ee7672d-8249-4f88-853a-6a2ddcd7da63 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:26.302898 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ee7672d-8249-4f88-853a-6a2ddcd7da63 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:26.527046 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c59fcaea-412c-4c4f-bf78-c03955d9f156 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:26.542110 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c59fcaea-412c-4c4f-bf78-c03955d9f156 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1213 microversion: 2.1 time: 0.910908 Jun 16 14:48:26.546658 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1063/2085] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:25 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1213 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:48:26.582046 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9357111b-854f-4693-92b5-d8bc76dc0f6d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:26.592769 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9357111b-854f-4693-92b5-d8bc76dc0f6d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:26.612434 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9357111b-854f-4693-92b5-d8bc76dc0f6d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:26.616772 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7ee7672d-8249-4f88-853a-6a2ddcd7da63 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:26.622648 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9357111b-854f-4693-92b5-d8bc76dc0f6d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:26.624386 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9357111b-854f-4693-92b5-d8bc76dc0f6d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:26.625337 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9357111b-854f-4693-92b5-d8bc76dc0f6d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:26.632631 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7ee7672d-8249-4f88-853a-6a2ddcd7da63 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1253 microversion: 2.1 time: 0.378976 Jun 16 14:48:26.642182 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1023/2086] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:26 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1253 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:26.910579 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-86484f4c-63e2-4e5c-afa6-b8672a6e380f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:26.911588 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-86484f4c-63e2-4e5c-afa6-b8672a6e380f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:26.929020 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-86484f4c-63e2-4e5c-afa6-b8672a6e380f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:26.929804 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-86484f4c-63e2-4e5c-afa6-b8672a6e380f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:26.930958 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-86484f4c-63e2-4e5c-afa6-b8672a6e380f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:26.931680 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-86484f4c-63e2-4e5c-afa6-b8672a6e380f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:27.108805 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-86484f4c-63e2-4e5c-afa6-b8672a6e380f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:27.138542 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-86484f4c-63e2-4e5c-afa6-b8672a6e380f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:27.140886 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-86484f4c-63e2-4e5c-afa6-b8672a6e380f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:27.143567 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-86484f4c-63e2-4e5c-afa6-b8672a6e380f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 200 len: 1264 microversion: 2.25 time: 0.236770 Jun 16 14:48:27.144107 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1024/2087] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:26 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:48:27.315371 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9357111b-854f-4693-92b5-d8bc76dc0f6d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:27.329533 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9357111b-854f-4693-92b5-d8bc76dc0f6d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1307 microversion: 2.1 time: 0.764781 Jun 16 14:48:27.332345 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1064/2088] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:26 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1307 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:27.582463 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-40849e82-0e69-4529-8463-aa805535172f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:27.583318 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-40849e82-0e69-4529-8463-aa805535172f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:27.599370 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40849e82-0e69-4529-8463-aa805535172f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:27.602707 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40849e82-0e69-4529-8463-aa805535172f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:27.603687 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40849e82-0e69-4529-8463-aa805535172f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:27.604165 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40849e82-0e69-4529-8463-aa805535172f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:27.653844 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7b64905b-8ffc-4908-99cc-0ed69523466b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:27.654417 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7b64905b-8ffc-4908-99cc-0ed69523466b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:27.675710 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b64905b-8ffc-4908-99cc-0ed69523466b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:27.676184 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b64905b-8ffc-4908-99cc-0ed69523466b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:27.677028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b64905b-8ffc-4908-99cc-0ed69523466b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:27.680358 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b64905b-8ffc-4908-99cc-0ed69523466b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:28.053106 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7b64905b-8ffc-4908-99cc-0ed69523466b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:28.085782 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7b64905b-8ffc-4908-99cc-0ed69523466b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1253 microversion: 2.1 time: 0.436982 Jun 16 14:48:28.092760 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1065/2089] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:27 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1253 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:48:28.112808 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-40849e82-0e69-4529-8463-aa805535172f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:28.129331 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-40849e82-0e69-4529-8463-aa805535172f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1275 microversion: 2.1 time: 0.554675 Jun 16 14:48:28.130997 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1025/2090] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:27 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1275 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:28.188256 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-babf08b7-9f77-4853-a231-441054eaf71f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:28.195883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-babf08b7-9f77-4853-a231-441054eaf71f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 2c77529a-f41c-4253-b703-8ef094f934f2] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:28.227196 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-babf08b7-9f77-4853-a231-441054eaf71f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:28.228356 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-babf08b7-9f77-4853-a231-441054eaf71f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:28.230658 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-babf08b7-9f77-4853-a231-441054eaf71f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:28.231786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-babf08b7-9f77-4853-a231-441054eaf71f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:28.276068 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-babf08b7-9f77-4853-a231-441054eaf71f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] HTTP exception thrown: Instance 2c77529a-f41c-4253-b703-8ef094f934f2 could not be found. Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-babf08b7-9f77-4853-a231-441054eaf71f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Request method failure captured: Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 HTTP/1.1 Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0B-okSquj7GELrJS9sbKyWDvmtrmgWBNPvmmVc8YS2EMY5GO6BwHHqKgKslswttQRM-ofZOzOefvWdL-wuYwd_JFkXSTAPHrPLKMx86sspLrTCbbDUAFwj6hIH2GTU23RKnbPK7FBh07yhNRgoGUpI-6VhkqUuOv3_jRJjOPJzFox4 Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: X-Openstack-Nova-Api-Version: 2.25 Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: c04830ebf498422d9dddfbc009697728 Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-706483184 Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:48:28.286623 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:48:28.289974 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c04830ebf498422d9dddfbc009697728", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c04830ebf498422d9dddfbc009697728"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c04830ebf498422d9dddfbc009697728"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c04830ebf498422d9dddfbc009697728"}]}] Jun 16 14:48:28.289974 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-706483184 Jun 16 14:48:28.289974 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: c04830ebf498422d9dddfbc009697728 Jun 16 14:48:28.289974 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-706483184 Jun 16 14:48:28.289974 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-LiveAutoBlockMigrationV225Test-706483184-project Jun 16 14:48:28.289974 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:48:28.289974 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:48:28.289974 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: ab3aa4e887694a0e9a42bf6db6b01555 Jun 16 14:48:28.289974 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-706483184-project Jun 16 14:48:28.289974 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:48:28.289974 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 2c77529a-f41c-4253-b703-8ef094f934f2 could not be found. Jun 16 14:48:28.289974 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '2c77529a-f41c-4253-b703-8ef094f934f2'} Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c77529a-f41c-4253-b703-8ef094f934f2 could not be found. Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:28.291745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c77529a-f41c-4253-b703-8ef094f934f2 could not be found. Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c77529a-f41c-4253-b703-8ef094f934f2 could not be found. Jun 16 14:48:28.296895 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:28.307041 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-babf08b7-9f77-4853-a231-441054eaf71f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Returning 404 to user: Instance 2c77529a-f41c-4253-b703-8ef094f934f2 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:28.311564 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-babf08b7-9f77-4853-a231-441054eaf71f tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2" status: 404 len: 111 microversion: 2.25 time: 0.136215 Jun 16 14:48:28.321656 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1066/2091] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:28 2022] GET /compute/v2.1/servers/2c77529a-f41c-4253-b703-8ef094f934f2 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:48:28.370545 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-912dd6a8-c1af-4151-bdd7-2ced7a1efa2f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:28.375509 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-912dd6a8-c1af-4151-bdd7-2ced7a1efa2f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:28.416778 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-912dd6a8-c1af-4151-bdd7-2ced7a1efa2f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:28.421149 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-912dd6a8-c1af-4151-bdd7-2ced7a1efa2f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:28.423620 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-912dd6a8-c1af-4151-bdd7-2ced7a1efa2f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:28.426314 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-912dd6a8-c1af-4151-bdd7-2ced7a1efa2f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:28.610303 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-01424b20-2010-47ae-875b-541b73431104 req-70855888-9528-42a0-9394-f9929e91cb65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534d4bfc-9035-4a24-a3f1-4453fae05354", "tag": "e2145fcb-39df-44d5-9c1f-2f832c21ec45"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:28.656934 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-01424b20-2010-47ae-875b-541b73431104 req-70855888-9528-42a0-9394-f9929e91cb65 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:28.657716 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-01424b20-2010-47ae-875b-541b73431104 req-70855888-9528-42a0-9394-f9929e91cb65 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:28.736571 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-01424b20-2010-47ae-875b-541b73431104 req-70855888-9528-42a0-9394-f9929e91cb65 service nova] Creating event network-changed:e2145fcb-39df-44d5-9c1f-2f832c21ec45 for instance 534d4bfc-9035-4a24-a3f1-4453fae05354 on n-h2-836830-4 Jun 16 14:48:28.754706 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-01424b20-2010-47ae-875b-541b73431104 req-70855888-9528-42a0-9394-f9929e91cb65 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149519 Jun 16 14:48:28.756505 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1067/2092] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:29.124007 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a7383db9-babb-41e0-8fac-c492793849fa tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:29.124764 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a7383db9-babb-41e0-8fac-c492793849fa tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:29.145382 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a7383db9-babb-41e0-8fac-c492793849fa tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:29.145886 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a7383db9-babb-41e0-8fac-c492793849fa tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:29.156472 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a7383db9-babb-41e0-8fac-c492793849fa tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:29.158042 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a7383db9-babb-41e0-8fac-c492793849fa tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:29.551296 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-912dd6a8-c1af-4151-bdd7-2ced7a1efa2f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:29.573671 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-912dd6a8-c1af-4151-bdd7-2ced7a1efa2f tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1307 microversion: 2.1 time: 1.217969 Jun 16 14:48:29.587494 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1026/2093] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:28 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1307 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:29.597839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a193c43f-6e7d-422c-9370-a79ebc9e0bbd tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:29.608751 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a193c43f-6e7d-422c-9370-a79ebc9e0bbd tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:29.633399 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a193c43f-6e7d-422c-9370-a79ebc9e0bbd tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:29.634422 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a193c43f-6e7d-422c-9370-a79ebc9e0bbd tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:29.636051 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a193c43f-6e7d-422c-9370-a79ebc9e0bbd tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:29.645114 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a193c43f-6e7d-422c-9370-a79ebc9e0bbd tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:29.645426 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a7383db9-babb-41e0-8fac-c492793849fa tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:29.680392 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a7383db9-babb-41e0-8fac-c492793849fa tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1253 microversion: 2.1 time: 0.564688 Jun 16 14:48:29.705561 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1068/2094] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:29 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1253 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:30.624231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-008c9eb8-ca7d-4c21-9a73-fe6b5ffb5655 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:30.628507 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-008c9eb8-ca7d-4c21-9a73-fe6b5ffb5655 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:30.663927 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-008c9eb8-ca7d-4c21-9a73-fe6b5ffb5655 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:30.679236 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-008c9eb8-ca7d-4c21-9a73-fe6b5ffb5655 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:30.682062 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-008c9eb8-ca7d-4c21-9a73-fe6b5ffb5655 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:30.687215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-008c9eb8-ca7d-4c21-9a73-fe6b5ffb5655 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:30.728955 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:30.823750 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a193c43f-6e7d-422c-9370-a79ebc9e0bbd tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:30.865645 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a193c43f-6e7d-422c-9370-a79ebc9e0bbd tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1317 microversion: 2.1 time: 1.275905 Jun 16 14:48:30.888446 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1027/2095] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:29 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1317 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:30.910457 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9b4a35b9-ccfb-4e97-9805-af3e7b82670b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:30.925141 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9b4a35b9-ccfb-4e97-9805-af3e7b82670b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:30.961328 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9b4a35b9-ccfb-4e97-9805-af3e7b82670b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:30.965473 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9b4a35b9-ccfb-4e97-9805-af3e7b82670b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:30.975430 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9b4a35b9-ccfb-4e97-9805-af3e7b82670b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:30.976526 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9b4a35b9-ccfb-4e97-9805-af3e7b82670b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:31.131991 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:31.291502 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=10 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:31.422344 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=34 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:31.505321 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9b4a35b9-ccfb-4e97-9805-af3e7b82670b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:31.548141 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9b4a35b9-ccfb-4e97-9805-af3e7b82670b tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1253 microversion: 2.1 time: 0.655792 Jun 16 14:48:31.567962 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1028/2096] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:30 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1253 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:31.765315 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-008c9eb8-ca7d-4c21-9a73-fe6b5ffb5655 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:31.812639 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-008c9eb8-ca7d-4c21-9a73-fe6b5ffb5655 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1307 microversion: 2.1 time: 1.198651 Jun 16 14:48:31.817271 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1069/2097] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:30 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1307 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:48:31.896905 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a5fd2c44-5502-4a55-8481-fd3a4ca68b57 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:31.898565 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a5fd2c44-5502-4a55-8481-fd3a4ca68b57 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:31.912653 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5fd2c44-5502-4a55-8481-fd3a4ca68b57 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:31.927162 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5fd2c44-5502-4a55-8481-fd3a4ca68b57 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:31.928307 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5fd2c44-5502-4a55-8481-fd3a4ca68b57 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:31.929703 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5fd2c44-5502-4a55-8481-fd3a4ca68b57 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:32.576776 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dc9906da-5f98-4705-9e39-d470944a9629 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:32.577328 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-dc9906da-5f98-4705-9e39-d470944a9629 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:32.592981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dc9906da-5f98-4705-9e39-d470944a9629 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:32.593145 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dc9906da-5f98-4705-9e39-d470944a9629 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:32.593973 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dc9906da-5f98-4705-9e39-d470944a9629 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:32.594457 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dc9906da-5f98-4705-9e39-d470944a9629 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:32.801209 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-dc9906da-5f98-4705-9e39-d470944a9629 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:32.817232 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-dc9906da-5f98-4705-9e39-d470944a9629 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1253 microversion: 2.1 time: 0.241552 Jun 16 14:48:32.818550 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1070/2098] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:32 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1253 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:48:32.837151 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-359c9032-2a41-4dca-85de-6a2da2d6f75e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:32.838138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-359c9032-2a41-4dca-85de-6a2da2d6f75e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:32.854547 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-359c9032-2a41-4dca-85de-6a2da2d6f75e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:32.855701 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-359c9032-2a41-4dca-85de-6a2da2d6f75e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:32.857867 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-359c9032-2a41-4dca-85de-6a2da2d6f75e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:32.860467 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-359c9032-2a41-4dca-85de-6a2da2d6f75e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:32.874160 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a5fd2c44-5502-4a55-8481-fd3a4ca68b57 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:32.883792 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a5fd2c44-5502-4a55-8481-fd3a4ca68b57 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1317 microversion: 2.1 time: 0.991220 Jun 16 14:48:32.897810 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1029/2099] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:31 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1317 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:48:33.570113 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-359c9032-2a41-4dca-85de-6a2da2d6f75e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:33.608128 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-359c9032-2a41-4dca-85de-6a2da2d6f75e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1307 microversion: 2.1 time: 0.778389 Jun 16 14:48:33.623942 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1071/2100] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:32 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1307 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:33.841123 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4d81f321-2596-421a-a88d-2a52927be1a9 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:33.842364 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4d81f321-2596-421a-a88d-2a52927be1a9 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:33.878756 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d81f321-2596-421a-a88d-2a52927be1a9 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:33.879573 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d81f321-2596-421a-a88d-2a52927be1a9 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:33.881055 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d81f321-2596-421a-a88d-2a52927be1a9 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:33.888681 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d81f321-2596-421a-a88d-2a52927be1a9 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:33.927584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dbaec7cc-6254-40f8-93d5-1afae2e45509 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:33.929291 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-dbaec7cc-6254-40f8-93d5-1afae2e45509 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:33.942901 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dbaec7cc-6254-40f8-93d5-1afae2e45509 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:33.949919 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dbaec7cc-6254-40f8-93d5-1afae2e45509 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:33.956487 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dbaec7cc-6254-40f8-93d5-1afae2e45509 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:33.957488 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dbaec7cc-6254-40f8-93d5-1afae2e45509 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:33.961370 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=16 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:34.563249 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=56 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:35.133421 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-dbaec7cc-6254-40f8-93d5-1afae2e45509 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:35.163748 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-dbaec7cc-6254-40f8-93d5-1afae2e45509 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1317 microversion: 2.1 time: 1.221601 Jun 16 14:48:35.171324 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1072/2101] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:33 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1317 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:48:35.193134 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-673960f8-8470-4b49-9346-37ca6e5d1207 req-17d663fe-54c7-4203-8473-9ff47c4f1fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e471e81-e487-4b6b-a938-d55179b3f318", "tag": "6bf23910-77e2-4149-b29f-a2f944a91ab8"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:35.251831 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4d81f321-2596-421a-a88d-2a52927be1a9 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:35.271797 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-673960f8-8470-4b49-9346-37ca6e5d1207 req-17d663fe-54c7-4203-8473-9ff47c4f1fdd service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:35.277007 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-673960f8-8470-4b49-9346-37ca6e5d1207 req-17d663fe-54c7-4203-8473-9ff47c4f1fdd service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:35.294032 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4d81f321-2596-421a-a88d-2a52927be1a9 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1253 microversion: 2.1 time: 1.459203 Jun 16 14:48:35.300123 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1030/2102] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:33 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1253 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:35.321080 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f2411b1b-e81b-4997-8fbc-a4a10e7dc8e2 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:35.322235 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f2411b1b-e81b-4997-8fbc-a4a10e7dc8e2 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:35.323762 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-673960f8-8470-4b49-9346-37ca6e5d1207 req-17d663fe-54c7-4203-8473-9ff47c4f1fdd service nova] Creating event network-changed:6bf23910-77e2-4149-b29f-a2f944a91ab8 for instance 9e471e81-e487-4b6b-a938-d55179b3f318 on n-h2-836830-4 Jun 16 14:48:35.329975 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f2411b1b-e81b-4997-8fbc-a4a10e7dc8e2 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:35.330855 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f2411b1b-e81b-4997-8fbc-a4a10e7dc8e2 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:35.331876 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f2411b1b-e81b-4997-8fbc-a4a10e7dc8e2 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:35.332522 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f2411b1b-e81b-4997-8fbc-a4a10e7dc8e2 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:35.353164 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-673960f8-8470-4b49-9346-37ca6e5d1207 req-17d663fe-54c7-4203-8473-9ff47c4f1fdd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179474 Jun 16 14:48:35.356492 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1073/2103] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:35.792561 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f2411b1b-e81b-4997-8fbc-a4a10e7dc8e2 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:35.829406 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f2411b1b-e81b-4997-8fbc-a4a10e7dc8e2 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1307 microversion: 2.1 time: 0.528062 Jun 16 14:48:35.830028 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1031/2104] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:35 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1307 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:35.881197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-674030859", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:36.001584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] validate_networks() for None {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:48:36.193182 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-38a26093-7d34-4992-a4a0-107c4c275612 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Action: 'create', calling method: .version_select at 0x7fdf0c5784c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2030845869", "description": "tempest-description-519235759"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:36.775170 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:48:36.781772 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:48:36.784332 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:48:36.786285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:48:36.794752 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:48:36.831986 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:36.832478 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:36.833748 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:36.834206 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:36.905548 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-38a26093-7d34-4992-a4a0-107c4c275612 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.841767 Jun 16 14:48:36.907056 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1032/2105] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:48:36 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:48:36.922974 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ecebc415-ddd6-4c15-a828-5bf27d449a25 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:36.924648 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ecebc415-ddd6-4c15-a828-5bf27d449a25 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:36.928782 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Getting quotas for project ca9aab10bc6d453099e97f64e7349466. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:48:36.964541 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ecebc415-ddd6-4c15-a828-5bf27d449a25 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:36.965040 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ecebc415-ddd6-4c15-a828-5bf27d449a25 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:36.972527 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Getting quotas for user 6ab4e820c92c4510b9ad1d31046340f4 and project ca9aab10bc6d453099e97f64e7349466. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:48:36.974188 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ecebc415-ddd6-4c15-a828-5bf27d449a25 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:36.976556 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ecebc415-ddd6-4c15-a828-5bf27d449a25 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:37.028806 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:48:37.031818 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:48:37.151918 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c42df302-5767-4a43-b344-d7ce896c8d5c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.553990 Jun 16 14:48:37.159240 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1074/2106] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:48:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 14:48:37.189589 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e9ea49f6-87d9-456c-b23f-28ad023991e1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:37.190906 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e9ea49f6-87d9-456c-b23f-28ad023991e1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:37.231969 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e9ea49f6-87d9-456c-b23f-28ad023991e1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:37.233571 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e9ea49f6-87d9-456c-b23f-28ad023991e1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:37.236723 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e9ea49f6-87d9-456c-b23f-28ad023991e1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:37.238077 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e9ea49f6-87d9-456c-b23f-28ad023991e1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:37.440943 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ecebc415-ddd6-4c15-a828-5bf27d449a25 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:37.487381 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ecebc415-ddd6-4c15-a828-5bf27d449a25 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1317 microversion: 2.1 time: 0.575726 Jun 16 14:48:37.489066 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1033/2107] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:36 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:37.517113 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-323c7707-5deb-4286-9659-a2397c688153 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:37.521486 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-323c7707-5deb-4286-9659-a2397c688153 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:37.552178 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-323c7707-5deb-4286-9659-a2397c688153 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:37.556661 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-323c7707-5deb-4286-9659-a2397c688153 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:37.561812 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-323c7707-5deb-4286-9659-a2397c688153 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:37.563202 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-323c7707-5deb-4286-9659-a2397c688153 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:37.654952 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e9ea49f6-87d9-456c-b23f-28ad023991e1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:37.670240 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e9ea49f6-87d9-456c-b23f-28ad023991e1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1253 microversion: 2.1 time: 0.508377 Jun 16 14:48:37.681665 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1075/2108] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:37 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1253 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:37.690112 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4188d221-dee2-45ca-8587-4a93a2129be6 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Action: 'create', calling method: .version_select at 0x7fdeffa31160>, body: {"security_group_rule": {"parent_group_id": "3ff29d77-5a12-463a-b1b3-0ef1cbae50bc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:38.495133 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4188d221-dee2-45ca-8587-4a93a2129be6 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.810771 Jun 16 14:48:38.497900 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1076/2109] 10.222.0.57 () {60 vars in 1194 bytes} [Thu Jun 16 14:48:37 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:38.520689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cd98ab4f-9293-4871-8060-2c4dcc77efd8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:38.525933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cd98ab4f-9293-4871-8060-2c4dcc77efd8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:38.557165 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd98ab4f-9293-4871-8060-2c4dcc77efd8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:38.563743 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd98ab4f-9293-4871-8060-2c4dcc77efd8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:38.569596 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd98ab4f-9293-4871-8060-2c4dcc77efd8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:38.572655 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd98ab4f-9293-4871-8060-2c4dcc77efd8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:38.868785 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cd98ab4f-9293-4871-8060-2c4dcc77efd8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:38.958037 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cd98ab4f-9293-4871-8060-2c4dcc77efd8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1217 microversion: 2.1 time: 0.457053 Jun 16 14:48:38.972329 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1077/2110] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:38 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1217 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:39.012230 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4e593e8b-328d-4c6b-9c7b-481c3abc7982 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Action: 'create', calling method: .version_select at 0x7fdeffa37670>, body: {"security_group_rule": {"parent_group_id": "3ff29d77-5a12-463a-b1b3-0ef1cbae50bc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:39.249801 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-4e593e8b-328d-4c6b-9c7b-481c3abc7982 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] HTTP exception thrown: This rule already exists in group 3ff29d77-5a12-463a-b1b3-0ef1cbae50bc Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4e593e8b-328d-4c6b-9c7b-481c3abc7982 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Request method failure captured: Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 138 Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0LDVbOxPPhfvkHLYwPBE9Fv3ntIAfEaDRcCySxIX1WUughH0JXuUFv3jFCQZ-_P1CGyb7xGBQymtqXk3W5ByPWHvr9EOXTjG1SXJuOYLPBB-GBZ8PM5tw-1_TUsZ_H9aCiPqylbESpsrkRQnE3wuC40HbymiJ_fuq8_kY7RkUJlx54 Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:48:39.254103 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:48:39.257045 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d0ccbc3a17734f41b7e15d0cf266d633", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d0ccbc3a17734f41b7e15d0cf266d633"}]}] Jun 16 14:48:39.257045 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:39.257045 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:39.257045 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:39.257045 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:39.257045 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:48:39.257045 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:48:39.257045 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 079910ba1e2f409b840a2e4d5754f901 Jun 16 14:48:39.257045 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:39.257045 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:48:39.257045 n-d-836830-4 devstack@n-api.service[125862]: {"security_group_rule": {"parent_group_id": "3ff29d77-5a12-463a-b1b3-0ef1cbae50bc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 16 14:48:39.257045 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: exception: This rule already exists in group 3ff29d77-5a12-463a-b1b3-0ef1cbae50bc Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3ff29d77-5a12-463a-b1b3-0ef1cbae50bc', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 3ff29d77-5a12-463a-b1b3-0ef1cbae50bc Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:48:39.258767 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:39.262288 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:39.262288 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jun 16 14:48:39.262288 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 14:48:39.262288 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 3ff29d77-5a12-463a-b1b3-0ef1cbae50bc Jun 16 14:48:39.262288 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:39.262288 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:39.262288 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:39.262288 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:39.262288 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:39.262288 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:39.262288 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:39.262288 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:39.262288 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 3ff29d77-5a12-463a-b1b3-0ef1cbae50bc Jun 16 14:48:39.262288 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:39.262288 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4e593e8b-328d-4c6b-9c7b-481c3abc7982 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Returning 400 to user: This rule already exists in group 3ff29d77-5a12-463a-b1b3-0ef1cbae50bc {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:39.265794 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4e593e8b-328d-4c6b-9c7b-481c3abc7982 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.285254 Jun 16 14:48:39.265794 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1078/2111] 10.222.0.57 () {60 vars in 1194 bytes} [Thu Jun 16 14:48:38 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 290 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:48:39.281226 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-323c7707-5deb-4286-9659-a2397c688153 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:39.282313 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2230f25c-232f-4081-9036-37caf9700efb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:39.282313 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2230f25c-232f-4081-9036-37caf9700efb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:39.299824 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2230f25c-232f-4081-9036-37caf9700efb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:39.300287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2230f25c-232f-4081-9036-37caf9700efb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:39.305401 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2230f25c-232f-4081-9036-37caf9700efb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:39.307337 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2230f25c-232f-4081-9036-37caf9700efb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:39.360909 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-323c7707-5deb-4286-9659-a2397c688153 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1307 microversion: 2.1 time: 1.868974 Jun 16 14:48:39.369182 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1034/2112] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:37 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1307 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:39.409516 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8f7ea1d7-e33d-4062-9d9c-78c1309b35eb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:39.420492 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8f7ea1d7-e33d-4062-9d9c-78c1309b35eb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:39.504346 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8f7ea1d7-e33d-4062-9d9c-78c1309b35eb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:39.505900 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8f7ea1d7-e33d-4062-9d9c-78c1309b35eb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:39.513676 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8f7ea1d7-e33d-4062-9d9c-78c1309b35eb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:39.516004 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8f7ea1d7-e33d-4062-9d9c-78c1309b35eb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:39.615398 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8f7ea1d7-e33d-4062-9d9c-78c1309b35eb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:39.619667 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8f7ea1d7-e33d-4062-9d9c-78c1309b35eb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:39.621048 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-8f7ea1d7-e33d-4062-9d9c-78c1309b35eb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lazy-loading 'fault' on Instance uuid 10edf992-de67-491e-a852-b01b4d61f050 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:48:39.703846 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2230f25c-232f-4081-9036-37caf9700efb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:39.732993 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2230f25c-232f-4081-9036-37caf9700efb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1317 microversion: 2.1 time: 0.457364 Jun 16 14:48:39.734206 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1079/2113] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:39 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:39.744686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0eacbfc2-f058-4eb5-828d-264a6dc8024e tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Calling method '.version_select at 0x7fdeffa37af0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:39.827419 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8f7ea1d7-e33d-4062-9d9c-78c1309b35eb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb6234a28c1437d97f356504163406b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7683609ebb347cf82d4b2d7ed3198eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:39.869060 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8f7ea1d7-e33d-4062-9d9c-78c1309b35eb tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 200 len: 1212 microversion: 2.1 time: 0.496365 Jun 16 14:48:39.872214 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1035/2114] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:39 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 1212 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:39.908705 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-2aef2250-794d-48aa-8047-92a38786e73a req-658f9c87-a7b7-4cb4-8495-fbdfb50a7113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534d4bfc-9035-4a24-a3f1-4453fae05354", "name": "network-vif-plugged", "status": "completed", "tag": "e2145fcb-39df-44d5-9c1f-2f832c21ec45"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:39.973564 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-2aef2250-794d-48aa-8047-92a38786e73a req-658f9c87-a7b7-4cb4-8495-fbdfb50a7113 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:39.986318 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-2aef2250-794d-48aa-8047-92a38786e73a req-658f9c87-a7b7-4cb4-8495-fbdfb50a7113 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:40.059375 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-2aef2250-794d-48aa-8047-92a38786e73a req-658f9c87-a7b7-4cb4-8495-fbdfb50a7113 service nova] Creating event network-vif-plugged:e2145fcb-39df-44d5-9c1f-2f832c21ec45 for instance 534d4bfc-9035-4a24-a3f1-4453fae05354 on n-h2-836830-4 Jun 16 14:48:40.082777 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-2aef2250-794d-48aa-8047-92a38786e73a req-658f9c87-a7b7-4cb4-8495-fbdfb50a7113 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207830 Jun 16 14:48:40.091356 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1036/2115] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:40.097483 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b58bb10a-2e31-444f-a16c-2b4caec59869 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:40.098228 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b58bb10a-2e31-444f-a16c-2b4caec59869 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:40.160382 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b58bb10a-2e31-444f-a16c-2b4caec59869 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:40.162109 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b58bb10a-2e31-444f-a16c-2b4caec59869 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:40.164600 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b58bb10a-2e31-444f-a16c-2b4caec59869 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:40.165087 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b58bb10a-2e31-444f-a16c-2b4caec59869 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:40.204063 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0eacbfc2-f058-4eb5-828d-264a6dc8024e tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-group-rules/cc4ad141-72f0-476d-9061-c3a4a772f606" status: 202 len: 0 microversion: 2.1 time: 0.464227 Jun 16 14:48:40.218702 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1080/2116] 10.222.0.57 () {58 vars in 1286 bytes} [Thu Jun 16 14:48:39 2022] DELETE /compute/v2.1/os-security-group-rules/cc4ad141-72f0-476d-9061-c3a4a772f606 => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:48:40.237312 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7bd9f2f7-8003-4ac4-a4bb-9d245dde2831 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Action: 'create', calling method: .version_select at 0x7fdeffb5e670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1688588808", "description": "tempest-description-1192506012"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:40.314341 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b58bb10a-2e31-444f-a16c-2b4caec59869 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:40.325476 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b58bb10a-2e31-444f-a16c-2b4caec59869 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1265 microversion: 2.1 time: 0.232631 Jun 16 14:48:40.342509 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1037/2117] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:40 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:40.398708 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-85392f65-23ad-42ca-b71d-dfe1578b8fa7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:40.399361 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-85392f65-23ad-42ca-b71d-dfe1578b8fa7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:40.412537 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85392f65-23ad-42ca-b71d-dfe1578b8fa7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:40.420792 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85392f65-23ad-42ca-b71d-dfe1578b8fa7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:40.427704 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85392f65-23ad-42ca-b71d-dfe1578b8fa7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:40.428192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-85392f65-23ad-42ca-b71d-dfe1578b8fa7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:40.802590 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-85392f65-23ad-42ca-b71d-dfe1578b8fa7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:40.838941 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-85392f65-23ad-42ca-b71d-dfe1578b8fa7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1307 microversion: 2.1 time: 0.444271 Jun 16 14:48:40.852681 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7bd9f2f7-8003-4ac4-a4bb-9d245dde2831 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.624838 Jun 16 14:48:40.852681 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1081/2118] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:48:40 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:40.852681 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f0fa8898-2482-4f6f-92c1-4a0be16d5f1b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:40.853729 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f0fa8898-2482-4f6f-92c1-4a0be16d5f1b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:40.854571 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1038/2119] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:40 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1307 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:48:40.878235 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5e3eb222-5899-45b8-9a49-24bd1bb944a8 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Action: 'create', calling method: .version_select at 0x7fdf110979d0>, body: {"security_group_rule": {"parent_group_id": "bc34f81d-a499-41bd-8f53-55b04ba01013", "ip_protocol": "tcp", "from_port": 387668315, "to_port": 22}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:40.878641 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f0fa8898-2482-4f6f-92c1-4a0be16d5f1b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:40.879072 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f0fa8898-2482-4f6f-92c1-4a0be16d5f1b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:40.887665 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f0fa8898-2482-4f6f-92c1-4a0be16d5f1b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:40.888335 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f0fa8898-2482-4f6f-92c1-4a0be16d5f1b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:41.127695 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-5e3eb222-5899-45b8-9a49-24bd1bb944a8 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] HTTP exception thrown: Invalid port range 387668315:22. Former value cannot be greater than the later Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5e3eb222-5899-45b8-9a49-24bd1bb944a8 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Request method failure captured: Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 145 Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0LDVbOxPPhfvkHLYwPBE9Fv3ntIAfEaDRcCySxIX1WUughH0JXuUFv3jFCQZ-_P1CGyb7xGBQymtqXk3W5ByPWHvr9EOXTjG1SXJuOYLPBB-GBZ8PM5tw-1_TUsZ_H9aCiPqylbESpsrkRQnE3wuC40HbymiJ_fuq8_kY7RkUJlx54 Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:48:41.133807 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:48:41.135698 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d0ccbc3a17734f41b7e15d0cf266d633", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d0ccbc3a17734f41b7e15d0cf266d633"}]}] Jun 16 14:48:41.135698 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:41.135698 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:41.135698 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:41.135698 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:41.135698 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:48:41.135698 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:48:41.135698 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 079910ba1e2f409b840a2e4d5754f901 Jun 16 14:48:41.135698 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:41.135698 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:48:41.135698 n-d-836830-4 devstack@n-api.service[125863]: {"security_group_rule": {"parent_group_id": "bc34f81d-a499-41bd-8f53-55b04ba01013", "ip_protocol": "tcp", "from_port": 387668315, "to_port": 22}} Jun 16 14:48:41.135698 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: exception: Invalid port range 387668315:22. Former value cannot be greater than the later Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'bc34f81d-a499-41bd-8f53-55b04ba01013', 'ip_protocol': 'tcp', 'from_port': 387668315, 'to_port': 22}}} Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 387668315:22. Former value cannot be greater than the later Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:41.137235 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 387668315:22. Former value cannot be greater than the later Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 387668315:22. Former value cannot be greater than the later Jun 16 14:48:41.138690 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:41.140111 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5e3eb222-5899-45b8-9a49-24bd1bb944a8 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Returning 400 to user: Invalid port range 387668315:22. Former value cannot be greater than the later {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:41.140111 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5e3eb222-5899-45b8-9a49-24bd1bb944a8 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.280627 Jun 16 14:48:41.151103 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1039/2120] 10.222.0.57 () {60 vars in 1194 bytes} [Thu Jun 16 14:48:40 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 295 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:48:41.156616 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d63821f0-df14-4762-aad3-9a0d162cefad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:41.157457 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d63821f0-df14-4762-aad3-9a0d162cefad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] [instance: 10edf992-de67-491e-a852-b01b4d61f050] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:41.166466 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d63821f0-df14-4762-aad3-9a0d162cefad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:41.168080 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d63821f0-df14-4762-aad3-9a0d162cefad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:41.170429 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d63821f0-df14-4762-aad3-9a0d162cefad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:41.172294 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d63821f0-df14-4762-aad3-9a0d162cefad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:41.192131 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-d63821f0-df14-4762-aad3-9a0d162cefad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] HTTP exception thrown: Instance 10edf992-de67-491e-a852-b01b4d61f050 could not be found. Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d63821f0-df14-4762-aad3-9a0d162cefad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Request method failure captured: Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 HTTP/1.1 Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0H-ETtvpH62DsA0fNkvd6HO0jByhabovIujo7OxNGtuMC6avZ1aJ-qScZqj_mgJw8XCYSQ2x8647IJRfSPKXp2YkrM3SRsVC-aEXsnmXe234dFcu8ebdFpYa3b7IqqqEMnINHvvb2DUYsbHpCzy155bvPxZpUFX53bhfvhQTv4DSWQ Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: f7683609ebb347cf82d4b2d7ed3198eb Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersTestBootFromVolume-734579531 Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:48:41.194446 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:48:41.196589 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f7683609ebb347cf82d4b2d7ed3198eb", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f7683609ebb347cf82d4b2d7ed3198eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f7683609ebb347cf82d4b2d7ed3198eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f7683609ebb347cf82d4b2d7ed3198eb"}]}] Jun 16 14:48:41.196589 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersTestBootFromVolume-734579531 Jun 16 14:48:41.196589 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: f7683609ebb347cf82d4b2d7ed3198eb Jun 16 14:48:41.196589 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersTestBootFromVolume-734579531 Jun 16 14:48:41.196589 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersTestBootFromVolume-734579531-project Jun 16 14:48:41.196589 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:48:41.196589 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:48:41.196589 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 4fb6234a28c1437d97f356504163406b Jun 16 14:48:41.196589 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersTestBootFromVolume-734579531-project Jun 16 14:48:41.196589 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:48:41.196589 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 10edf992-de67-491e-a852-b01b4d61f050 could not be found. Jun 16 14:48:41.196589 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '10edf992-de67-491e-a852-b01b4d61f050'} Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10edf992-de67-491e-a852-b01b4d61f050 could not be found. Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:41.199556 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10edf992-de67-491e-a852-b01b4d61f050 could not be found. Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10edf992-de67-491e-a852-b01b4d61f050 could not be found. Jun 16 14:48:41.202357 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:41.207133 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d63821f0-df14-4762-aad3-9a0d162cefad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Returning 404 to user: Instance 10edf992-de67-491e-a852-b01b4d61f050 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:41.209372 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d63821f0-df14-4762-aad3-9a0d162cefad tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050" status: 404 len: 111 microversion: 2.1 time: 0.057020 Jun 16 14:48:41.210616 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1040/2121] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:41 2022] GET /compute/v2.1/servers/10edf992-de67-491e-a852-b01b4d61f050 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:48:41.221117 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d82cc7a9-b61b-465e-a96f-ce5103fced22 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Action: 'create', calling method: .version_select at 0x7fdf0c0415e0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1079163428", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:41.223866 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-d82cc7a9-b61b-465e-a96f-ce5103fced22 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] HTTP exception thrown: Security group id should be uuid Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d82cc7a9-b61b-465e-a96f-ce5103fced22 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Request method failure captured: Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 131 Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0LDVbOxPPhfvkHLYwPBE9Fv3ntIAfEaDRcCySxIX1WUughH0JXuUFv3jFCQZ-_P1CGyb7xGBQymtqXk3W5ByPWHvr9EOXTjG1SXJuOYLPBB-GBZ8PM5tw-1_TUsZ_H9aCiPqylbESpsrkRQnE3wuC40HbymiJ_fuq8_kY7RkUJlx54 Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:48:41.225806 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:48:41.227490 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d0ccbc3a17734f41b7e15d0cf266d633", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d0ccbc3a17734f41b7e15d0cf266d633"}]}] Jun 16 14:48:41.227490 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:41.227490 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:41.227490 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:41.227490 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:41.227490 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:48:41.227490 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:48:41.227490 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 079910ba1e2f409b840a2e4d5754f901 Jun 16 14:48:41.227490 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:41.227490 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:48:41.227490 n-d-836830-4 devstack@n-api.service[125863]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1079163428", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 16 14:48:41.227490 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:48:41.227490 n-d-836830-4 devstack@n-api.service[125863]: exception: Security group id should be uuid Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1079163428', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:41.228456 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:41.233991 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 16 14:48:41.233991 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 14:48:41.233991 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jun 16 14:48:41.233991 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:41.233991 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:41.233991 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:41.233991 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:41.233991 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:41.233991 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:41.233991 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:41.233991 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:41.233991 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jun 16 14:48:41.233991 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:41.237096 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d82cc7a9-b61b-465e-a96f-ce5103fced22 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Returning 400 to user: Security group id should be uuid {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:41.239027 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d82cc7a9-b61b-465e-a96f-ce5103fced22 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.026362 Jun 16 14:48:41.251714 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1041/2122] 10.222.0.57 () {60 vars in 1194 bytes} [Thu Jun 16 14:48:41 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:41.267360 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-66e468f7-0368-49aa-b5a8-681d660f9eb1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] Calling method '.version_select at 0x7fdf0c39b430>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:41.283432 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:41.303077 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-66e468f7-0368-49aa-b5a8-681d660f9eb1 tempest-ServersTestBootFromVolume-734579531 tempest-ServersTestBootFromVolume-734579531-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053520011" status: 202 len: 0 microversion: 2.1 time: 0.049520 Jun 16 14:48:41.304853 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1042/2123] 10.222.0.57 () {58 vars in 1220 bytes} [Thu Jun 16 14:48:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053520011 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:48:41.328254 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-56989976-57e7-4df5-9200-a7f78e378dcc tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Action: 'create', calling method: .version_select at 0x7fdeffdbd940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2010802162", "description": "tempest-description-253462148"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:41.585372 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f0fa8898-2482-4f6f-92c1-4a0be16d5f1b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:41.621412 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f0fa8898-2482-4f6f-92c1-4a0be16d5f1b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1317 microversion: 2.1 time: 0.771099 Jun 16 14:48:41.633388 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1082/2124] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:40 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1317 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:41.640470 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bd9d9f97-e041-41a3-8138-b9c1611e37b4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:41.643026 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bd9d9f97-e041-41a3-8138-b9c1611e37b4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:41.660988 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bd9d9f97-e041-41a3-8138-b9c1611e37b4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:41.663054 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bd9d9f97-e041-41a3-8138-b9c1611e37b4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:41.667654 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bd9d9f97-e041-41a3-8138-b9c1611e37b4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:41.669175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bd9d9f97-e041-41a3-8138-b9c1611e37b4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:41.967315 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-56989976-57e7-4df5-9200-a7f78e378dcc tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.646740 Jun 16 14:48:41.967315 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1043/2125] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:48:41 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:41.976129 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-650438ee-66db-46c1-a121-7ab6c86e34a6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:41.977367 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-650438ee-66db-46c1-a121-7ab6c86e34a6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:41.987654 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-650438ee-66db-46c1-a121-7ab6c86e34a6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:41.988455 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-650438ee-66db-46c1-a121-7ab6c86e34a6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:41.990934 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-650438ee-66db-46c1-a121-7ab6c86e34a6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:41.992120 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-650438ee-66db-46c1-a121-7ab6c86e34a6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:42.328496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-650438ee-66db-46c1-a121-7ab6c86e34a6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:42.360956 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-650438ee-66db-46c1-a121-7ab6c86e34a6 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1487 microversion: 2.1 time: 0.398085 Jun 16 14:48:42.363638 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1044/2126] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:41 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1487 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:42.375461 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1e447f1b-b67e-43bc-84b2-f999ef4e9a79 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Action: 'create', calling method: .version_select at 0x7fdf0c2dea60>, body: {"security_group_rule": {"parent_group_id": "2e377dff-3a94-46bc-9a66-1bb7d7060629", "ip_protocol": "tempest-999-2092478596", "from_port": 22, "to_port": 22}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:42.408691 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bd9d9f97-e041-41a3-8138-b9c1611e37b4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:42.442629 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bd9d9f97-e041-41a3-8138-b9c1611e37b4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1271 microversion: 2.1 time: 0.814543 Jun 16 14:48:42.450924 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1083/2127] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:41 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1271 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:42.497359 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-1e447f1b-b67e-43bc-84b2-f999ef4e9a79 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] HTTP exception thrown: Invalid IP protocol tempest-999-2092478596. Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1e447f1b-b67e-43bc-84b2-f999ef4e9a79 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Request method failure captured: Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 157 Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0LDVbOxPPhfvkHLYwPBE9Fv3ntIAfEaDRcCySxIX1WUughH0JXuUFv3jFCQZ-_P1CGyb7xGBQymtqXk3W5ByPWHvr9EOXTjG1SXJuOYLPBB-GBZ8PM5tw-1_TUsZ_H9aCiPqylbESpsrkRQnE3wuC40HbymiJ_fuq8_kY7RkUJlx54 Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:48:42.509131 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:48:42.512687 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d0ccbc3a17734f41b7e15d0cf266d633", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d0ccbc3a17734f41b7e15d0cf266d633"}]}] Jun 16 14:48:42.512687 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:42.512687 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:42.512687 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:42.512687 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:42.512687 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:48:42.512687 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:48:42.512687 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 079910ba1e2f409b840a2e4d5754f901 Jun 16 14:48:42.512687 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:42.512687 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:48:42.512687 n-d-836830-4 devstack@n-api.service[125863]: {"security_group_rule": {"parent_group_id": "2e377dff-3a94-46bc-9a66-1bb7d7060629", "ip_protocol": "tempest-999-2092478596", "from_port": 22, "to_port": 22}} Jun 16 14:48:42.512687 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: exception: Invalid IP protocol tempest-999-2092478596. Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2e377dff-3a94-46bc-9a66-1bb7d7060629', 'ip_protocol': 'tempest-999-2092478596', 'from_port': 22, 'to_port': 22}}} Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2092478596. Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:42.513892 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2092478596. Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2092478596. Jun 16 14:48:42.516135 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:42.520058 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1e447f1b-b67e-43bc-84b2-f999ef4e9a79 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Returning 400 to user: Invalid IP protocol tempest-999-2092478596. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:42.528189 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1e447f1b-b67e-43bc-84b2-f999ef4e9a79 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.153628 Jun 16 14:48:42.541409 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1045/2128] 10.222.0.57 () {60 vars in 1194 bytes} [Thu Jun 16 14:48:42 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:48:42.607534 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-51d82f01-bd5d-4d13-b7ac-761488b65fcb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-62375187"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:42.622711 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-51d82f01-bd5d-4d13-b7ac-761488b65fcb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:42.638727 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-51d82f01-bd5d-4d13-b7ac-761488b65fcb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:42.639353 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-51d82f01-bd5d-4d13-b7ac-761488b65fcb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:42.640209 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-51d82f01-bd5d-4d13-b7ac-761488b65fcb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:42.640661 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-51d82f01-bd5d-4d13-b7ac-761488b65fcb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:43.183957 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ed026f2e-245e-407e-a100-da39eebdd2cc tempest-AZV2TestJSON-37644058 tempest-AZV2TestJSON-37644058-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:43.194010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ed026f2e-245e-407e-a100-da39eebdd2cc tempest-AZV2TestJSON-37644058 tempest-AZV2TestJSON-37644058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:43.207124 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ed026f2e-245e-407e-a100-da39eebdd2cc tempest-AZV2TestJSON-37644058 tempest-AZV2TestJSON-37644058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:43.211721 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ed026f2e-245e-407e-a100-da39eebdd2cc tempest-AZV2TestJSON-37644058 tempest-AZV2TestJSON-37644058-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:43.221929 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ed026f2e-245e-407e-a100-da39eebdd2cc tempest-AZV2TestJSON-37644058 tempest-AZV2TestJSON-37644058-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:43.409918 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ed026f2e-245e-407e-a100-da39eebdd2cc tempest-AZV2TestJSON-37644058 tempest-AZV2TestJSON-37644058-project] 10.222.0.57 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.949293 Jun 16 14:48:43.414969 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1084/2129] 10.222.0.57 () {58 vars in 1163 bytes} [Thu Jun 16 14:48:42 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:48:43.433045 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-51f42128-13c5-4f09-88b5-b135ef61c09b tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Action: 'create', calling method: .version_select at 0x7fdeffa1ef70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1775641493", "description": "tempest-description-218698696"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:43.611746 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-51d82f01-bd5d-4d13-b7ac-761488b65fcb tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "POST /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354/action" status: 202 len: 0 microversion: 2.1 time: 1.068095 Jun 16 14:48:43.613836 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1046/2130] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:48:42 2022] POST /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354/action => generated 0 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 14:48:43.639935 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-112742fe-d4f9-434c-bdc5-20c40e11ba67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:43.641267 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-112742fe-d4f9-434c-bdc5-20c40e11ba67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:43.662204 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-112742fe-d4f9-434c-bdc5-20c40e11ba67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:43.685305 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-112742fe-d4f9-434c-bdc5-20c40e11ba67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:43.707773 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-112742fe-d4f9-434c-bdc5-20c40e11ba67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:43.709132 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-112742fe-d4f9-434c-bdc5-20c40e11ba67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:44.342246 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-112742fe-d4f9-434c-bdc5-20c40e11ba67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:44.369015 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-112742fe-d4f9-434c-bdc5-20c40e11ba67 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1317 microversion: 2.1 time: 0.747421 Jun 16 14:48:44.395204 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1047/2131] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:43 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1317 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:44.406201 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9233574f-7a74-423f-b1a1-b4cbdbe724ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:44.418849 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9233574f-7a74-423f-b1a1-b4cbdbe724ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:44.441584 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9233574f-7a74-423f-b1a1-b4cbdbe724ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:44.450481 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9233574f-7a74-423f-b1a1-b4cbdbe724ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:44.452522 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9233574f-7a74-423f-b1a1-b4cbdbe724ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:44.453647 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9233574f-7a74-423f-b1a1-b4cbdbe724ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:44.687649 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9233574f-7a74-423f-b1a1-b4cbdbe724ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:44.715883 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9233574f-7a74-423f-b1a1-b4cbdbe724ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1271 microversion: 2.1 time: 0.315583 Jun 16 14:48:44.718171 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1048/2132] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:44 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1271 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:44.740808 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4d69aa0e-ddd0-4452-b49f-b9d8f3f98fb4 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdf0c1578b0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:44.906504 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4d69aa0e-ddd0-4452-b49f-b9d8f3f98fb4 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/25ad57f1-b010-4e38-a3ee-e60ba2cd9e98" status: 200 len: 1412 microversion: 2.1 time: 0.180573 Jun 16 14:48:44.908597 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1049/2133] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:48:44 2022] GET /compute/v2.1/images/25ad57f1-b010-4e38-a3ee-e60ba2cd9e98 => generated 1412 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:44.941485 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e27d5865-81a3-4c05-a17a-43c23991c466 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeff522e50>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:45.012942 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-51f42128-13c5-4f09-88b5-b135ef61c09b tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.596185 Jun 16 14:48:45.014753 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1085/2134] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:48:43 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:45.031121 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e5e6c8b1-eba8-40e1-98ef-6cfb209166b7 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Action: 'create', calling method: .version_select at 0x7fdeffa6a820>, body: {"security_group_rule": {"parent_group_id": "4cd89f85-b3a4-4ea3-9ecb-88fa22891f64", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:45.116453 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e27d5865-81a3-4c05-a17a-43c23991c466 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/25ad57f1-b010-4e38-a3ee-e60ba2cd9e98" status: 200 len: 1412 microversion: 2.1 time: 0.199612 Jun 16 14:48:45.122651 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1050/2135] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:48:44 2022] GET /compute/v2.1/images/25ad57f1-b010-4e38-a3ee-e60ba2cd9e98 => generated 1412 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:45.138566 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ddd8629f-017b-4c06-a9de-eeb4dbb645f9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeff522ca0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:45.492718 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ddd8629f-017b-4c06-a9de-eeb4dbb645f9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/images/25ad57f1-b010-4e38-a3ee-e60ba2cd9e98" status: 204 len: 0 microversion: 2.1 time: 0.361745 Jun 16 14:48:45.493317 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1051/2136] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:45 2022] DELETE /compute/v2.1/images/25ad57f1-b010-4e38-a3ee-e60ba2cd9e98 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 14:48:45.498685 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-43b4932c-d16d-4032-95b9-357ec08de0d8 req-475a5d7c-aba9-4f87-83fb-a27f8ca382b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e471e81-e487-4b6b-a938-d55179b3f318", "name": "network-vif-plugged", "status": "completed", "tag": "6bf23910-77e2-4149-b29f-a2f944a91ab8"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:45.538910 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-43b4932c-d16d-4032-95b9-357ec08de0d8 req-475a5d7c-aba9-4f87-83fb-a27f8ca382b7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:45.539517 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-43b4932c-d16d-4032-95b9-357ec08de0d8 req-475a5d7c-aba9-4f87-83fb-a27f8ca382b7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:45.604657 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-43b4932c-d16d-4032-95b9-357ec08de0d8 req-475a5d7c-aba9-4f87-83fb-a27f8ca382b7 service nova] Creating event network-vif-plugged:6bf23910-77e2-4149-b29f-a2f944a91ab8 for instance 9e471e81-e487-4b6b-a938-d55179b3f318 on n-h2-836830-4 Jun 16 14:48:45.618965 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-43b4932c-d16d-4032-95b9-357ec08de0d8 req-475a5d7c-aba9-4f87-83fb-a27f8ca382b7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121627 Jun 16 14:48:45.627313 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1052/2137] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:45.643469 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cc905e8c-a8a2-4f3c-9ec6-487a0fdc0ecc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:45.646676 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cc905e8c-a8a2-4f3c-9ec6-487a0fdc0ecc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:45.691634 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cc905e8c-a8a2-4f3c-9ec6-487a0fdc0ecc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:45.696578 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cc905e8c-a8a2-4f3c-9ec6-487a0fdc0ecc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:45.699734 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cc905e8c-a8a2-4f3c-9ec6-487a0fdc0ecc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:45.701298 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cc905e8c-a8a2-4f3c-9ec6-487a0fdc0ecc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:46.257254 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-e5e6c8b1-eba8-40e1-98ef-6cfb209166b7 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e5e6c8b1-eba8-40e1-98ef-6cfb209166b7 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Request method failure captured: Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 138 Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0LDVbOxPPhfvkHLYwPBE9Fv3ntIAfEaDRcCySxIX1WUughH0JXuUFv3jFCQZ-_P1CGyb7xGBQymtqXk3W5ByPWHvr9EOXTjG1SXJuOYLPBB-GBZ8PM5tw-1_TUsZ_H9aCiPqylbESpsrkRQnE3wuC40HbymiJ_fuq8_kY7RkUJlx54 Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:48:46.261589 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:48:46.265216 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d0ccbc3a17734f41b7e15d0cf266d633", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d0ccbc3a17734f41b7e15d0cf266d633"}]}] Jun 16 14:48:46.265216 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:46.265216 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:46.265216 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:46.265216 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:46.265216 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:48:46.265216 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:48:46.265216 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 079910ba1e2f409b840a2e4d5754f901 Jun 16 14:48:46.265216 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:46.265216 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:48:46.265216 n-d-836830-4 devstack@n-api.service[125862]: {"security_group_rule": {"parent_group_id": "4cd89f85-b3a4-4ea3-9ecb-88fa22891f64", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jun 16 14:48:46.265216 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4cd89f85-b3a4-4ea3-9ecb-88fa22891f64', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:46.268636 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jun 16 14:48:46.271631 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:46.278418 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e5e6c8b1-eba8-40e1-98ef-6cfb209166b7 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:46.285747 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e5e6c8b1-eba8-40e1-98ef-6cfb209166b7 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 1.255882 Jun 16 14:48:46.287288 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1086/2138] 10.222.0.57 () {60 vars in 1194 bytes} [Thu Jun 16 14:48:45 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 1265 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 14:48:46.300374 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-19182d1f-944b-4e54-8997-fd4795e5c64a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffac89d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:46.362158 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-19182d1f-944b-4e54-8997-fd4795e5c64a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] HTTP exception thrown: Image not found. Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-19182d1f-944b-4e54-8997-fd4795e5c64a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Request method failure captured: Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/images/25ad57f1-b010-4e38-a3ee-e60ba2cd9e98 HTTP/1.1 Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0GXWER_qcQbzs1hlNo1uSwhCWxXAxWchb3BhDhK3YnQKpbaj6WIdgdHwudyOZUYPpV_QFWV-3-U8zgzws4nM0r9vaM-bklKcuJyQkQmrllzUDt67ONRUpvj6NQwf9PAx706GCikziLMpRB73GMspW6HuKRqeUlLrCwOL8FFL93uWq0 Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:48:46.370535 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:48:46.374452 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1ac65ee04fbf47608c18c173900ad8f7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1ac65ee04fbf47608c18c173900ad8f7"}]}] Jun 16 14:48:46.374452 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesTestJSON-1889241253 Jun 16 14:48:46.374452 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:48:46.374452 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:48:46.374452 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesTestJSON-1889241253-project Jun 16 14:48:46.374452 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:48:46.374452 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:48:46.374452 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: f91d14d5fb884048a0b12279c62e963d Jun 16 14:48:46.374452 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesTestJSON-1889241253-project Jun 16 14:48:46.374452 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:48:46.374452 n-d-836830-4 devstack@n-api.service[125862]: exception: Image not found. Jun 16 14:48:46.374452 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '25ad57f1-b010-4e38-a3ee-e60ba2cd9e98'} Jun 16 14:48:46.374452 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:46.374452 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 25ad57f1-b010-4e38-a3ee-e60ba2cd9e98 Jun 16 14:48:46.376705 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:48:46.379547 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 25ad57f1-b010-4e38-a3ee-e60ba2cd9e98 could not be found. Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:48:46.381463 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:48:46.383621 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:46.383621 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:46.383621 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 16 14:48:46.383621 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:48:46.383621 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:48:46.383621 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:46.383621 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:46.383621 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:46.383621 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:46.383621 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:46.383621 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:46.383621 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:46.383621 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:46.383621 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:48:46.383621 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:46.390466 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-19182d1f-944b-4e54-8997-fd4795e5c64a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Returning 404 to user: Image not found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:46.390466 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-19182d1f-944b-4e54-8997-fd4795e5c64a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/images/25ad57f1-b010-4e38-a3ee-e60ba2cd9e98" status: 404 len: 62 microversion: 2.1 time: 0.099396 Jun 16 14:48:46.390466 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1087/2139] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:48:46 2022] GET /compute/v2.1/images/25ad57f1-b010-4e38-a3ee-e60ba2cd9e98 => generated 62 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:48:46.413013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-99138219-cde3-450e-bde5-db6998e6315f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:46.419482 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-99138219-cde3-450e-bde5-db6998e6315f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:46.438266 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-99138219-cde3-450e-bde5-db6998e6315f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:46.439780 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-99138219-cde3-450e-bde5-db6998e6315f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:46.440886 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-99138219-cde3-450e-bde5-db6998e6315f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:46.442193 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-99138219-cde3-450e-bde5-db6998e6315f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:47.007409 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=6 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:47.326909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-99138219-cde3-450e-bde5-db6998e6315f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:47.329203 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-cc905e8c-a8a2-4f3c-9ec6-487a0fdc0ecc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:47.351138 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-99138219-cde3-450e-bde5-db6998e6315f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1313 microversion: 2.1 time: 0.953800 Jun 16 14:48:47.368426 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1088/2140] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:46 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1313 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:47.372661 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cc905e8c-a8a2-4f3c-9ec6-487a0fdc0ecc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1317 microversion: 2.1 time: 1.741071 Jun 16 14:48:47.379389 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1053/2141] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:45 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1317 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:47.386542 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-469e9fb7-8b06-42c6-bb31-791f6600de8f tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Action: 'create', calling method: .version_select at 0x7fdeffa1edc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1144672305", "description": "tempest-description-1658973275"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:47.415366 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8748a38c-26b0-4aac-99f2-b448822f2293 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:47.418694 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8748a38c-26b0-4aac-99f2-b448822f2293 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:47.448080 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8748a38c-26b0-4aac-99f2-b448822f2293 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:47.462241 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8748a38c-26b0-4aac-99f2-b448822f2293 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:47.487284 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8748a38c-26b0-4aac-99f2-b448822f2293 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:47.488275 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8748a38c-26b0-4aac-99f2-b448822f2293 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:47.620690 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:48.379866 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-469e9fb7-8b06-42c6-bb31-791f6600de8f tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.009125 Jun 16 14:48:48.389622 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1089/2142] 10.222.0.57 () {60 vars in 1179 bytes} [Thu Jun 16 14:48:47 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:48.399663 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-811b80ef-ae2d-457d-bc58-fdd880ec73a1 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:48.400849 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-811b80ef-ae2d-457d-bc58-fdd880ec73a1 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:48.437562 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-811b80ef-ae2d-457d-bc58-fdd880ec73a1 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:48.454732 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-811b80ef-ae2d-457d-bc58-fdd880ec73a1 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:48.456548 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-811b80ef-ae2d-457d-bc58-fdd880ec73a1 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:48.457432 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-811b80ef-ae2d-457d-bc58-fdd880ec73a1 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:48.723640 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8748a38c-26b0-4aac-99f2-b448822f2293 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:48.748991 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8748a38c-26b0-4aac-99f2-b448822f2293 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1500 microversion: 2.1 time: 1.359292 Jun 16 14:48:48.749978 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1054/2143] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:47 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1500 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:48.765740 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1b481376-e048-413f-a810-e4c42a53ad42 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Action: 'create', calling method: .version_select at 0x7fdf0c2deca0>, body: {"security_group_rule": {"parent_group_id": "d6a2f81c-9aaa-4dd3-aa78-c6d614d0af0f", "ip_protocol": "tcp", "from_port": 22, "to_port": 235360699}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:48.996931 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-1b481376-e048-413f-a810-e4c42a53ad42 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] HTTP exception thrown: Invalid port range 22:235360699. Valid TCP ports should be between 1-65535 Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1b481376-e048-413f-a810-e4c42a53ad42 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Request method failure captured: Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 145 Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0LDVbOxPPhfvkHLYwPBE9Fv3ntIAfEaDRcCySxIX1WUughH0JXuUFv3jFCQZ-_P1CGyb7xGBQymtqXk3W5ByPWHvr9EOXTjG1SXJuOYLPBB-GBZ8PM5tw-1_TUsZ_H9aCiPqylbESpsrkRQnE3wuC40HbymiJ_fuq8_kY7RkUJlx54 Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:48:49.001794 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:48:49.051223 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d0ccbc3a17734f41b7e15d0cf266d633", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d0ccbc3a17734f41b7e15d0cf266d633"}]}] Jun 16 14:48:49.051223 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:49.051223 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:49.051223 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:49.051223 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:49.051223 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:48:49.051223 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:48:49.051223 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 079910ba1e2f409b840a2e4d5754f901 Jun 16 14:48:49.051223 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:49.051223 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:48:49.051223 n-d-836830-4 devstack@n-api.service[125863]: {"security_group_rule": {"parent_group_id": "d6a2f81c-9aaa-4dd3-aa78-c6d614d0af0f", "ip_protocol": "tcp", "from_port": 22, "to_port": 235360699}} Jun 16 14:48:49.051223 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: exception: Invalid port range 22:235360699. Valid TCP ports should be between 1-65535 Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd6a2f81c-9aaa-4dd3-aa78-c6d614d0af0f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 235360699}}} Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:235360699. Valid TCP ports should be between 1-65535 Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:49.069292 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:235360699. Valid TCP ports should be between 1-65535 Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:235360699. Valid TCP ports should be between 1-65535 Jun 16 14:48:49.089232 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.091987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1b481376-e048-413f-a810-e4c42a53ad42 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Returning 400 to user: Invalid port range 22:235360699. Valid TCP ports should be between 1-65535 {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:49.091987 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1b481376-e048-413f-a810-e4c42a53ad42 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.254416 Jun 16 14:48:49.091987 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1055/2144] 10.222.0.57 () {60 vars in 1194 bytes} [Thu Jun 16 14:48:48 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 259 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:48:49.091987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ef471133-ece0-42ac-88d5-cd7e87807f30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:49.091987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ef471133-ece0-42ac-88d5-cd7e87807f30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:49.095592 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef471133-ece0-42ac-88d5-cd7e87807f30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:49.096071 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef471133-ece0-42ac-88d5-cd7e87807f30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:49.096908 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef471133-ece0-42ac-88d5-cd7e87807f30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:49.097363 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef471133-ece0-42ac-88d5-cd7e87807f30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:49.440303 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-811b80ef-ae2d-457d-bc58-fdd880ec73a1 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:49.458952 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-811b80ef-ae2d-457d-bc58-fdd880ec73a1 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1313 microversion: 2.1 time: 1.075875 Jun 16 14:48:49.473759 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1090/2145] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:48 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1313 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:49.489489 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6516ce0f-04e9-4047-bdcc-8a6d6e8459f3 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Action: 'create', calling method: .version_select at 0x7fdeffa37f70>, body: {"security_group_rule": {"parent_group_id": "0a4244ec-45a2-4cd9-8c82-290dc69e2619", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:49.639287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG neutronclient.v2_0.client [None req-6516ce0f-04e9-4047-bdcc-8a6d6e8459f3 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0a4244ec-45a2-4cd9-8c82-290dc69e2619 does not exist", "detail": ""}} {{(pid=125862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:48:49.640084 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.security_group_api [None req-6516ce0f-04e9-4047-bdcc-8a6d6e8459f3 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Neutron security group 0a4244ec-45a2-4cd9-8c82-290dc69e2619 not found {{(pid=125862) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 16 14:48:49.640778 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-6516ce0f-04e9-4047-bdcc-8a6d6e8459f3 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] HTTP exception thrown: Security group 0a4244ec-45a2-4cd9-8c82-290dc69e2619 does not exist Jun 16 14:48:49.640778 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-1dafd473-33b8-4538-95ec-01f4871c859d'] Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6516ce0f-04e9-4047-bdcc-8a6d6e8459f3 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Request method failure captured: Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 138 Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0LDVbOxPPhfvkHLYwPBE9Fv3ntIAfEaDRcCySxIX1WUughH0JXuUFv3jFCQZ-_P1CGyb7xGBQymtqXk3W5ByPWHvr9EOXTjG1SXJuOYLPBB-GBZ8PM5tw-1_TUsZ_H9aCiPqylbESpsrkRQnE3wuC40HbymiJ_fuq8_kY7RkUJlx54 Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:48:49.642955 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:48:49.644070 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d0ccbc3a17734f41b7e15d0cf266d633", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d0ccbc3a17734f41b7e15d0cf266d633"}]}] Jun 16 14:48:49.644070 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:49.644070 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:49.644070 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:49.644070 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:49.644070 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:48:49.644070 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:48:49.644070 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 079910ba1e2f409b840a2e4d5754f901 Jun 16 14:48:49.644070 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:49.644070 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:48:49.644070 n-d-836830-4 devstack@n-api.service[125862]: {"security_group_rule": {"parent_group_id": "0a4244ec-45a2-4cd9-8c82-290dc69e2619", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 16 14:48:49.644070 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: exception: Security group 0a4244ec-45a2-4cd9-8c82-290dc69e2619 does not exist Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-1dafd473-33b8-4538-95ec-01f4871c859d'] Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0a4244ec-45a2-4cd9-8c82-290dc69e2619', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:48:49.644725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0a4244ec-45a2-4cd9-8c82-290dc69e2619 does not exist Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dafd473-33b8-4538-95ec-01f4871c859d'] Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jun 16 14:48:49.645562 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0a4244ec-45a2-4cd9-8c82-290dc69e2619 does not exist Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dafd473-33b8-4538-95ec-01f4871c859d'] Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0a4244ec-45a2-4cd9-8c82-290dc69e2619 does not exist Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dafd473-33b8-4538-95ec-01f4871c859d'] Jun 16 14:48:49.646533 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.647408 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:49.647408 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.647408 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:49.647408 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:49.647408 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:49.647408 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:49.647408 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:49.647408 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0a4244ec-45a2-4cd9-8c82-290dc69e2619 does not exist Jun 16 14:48:49.647408 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dafd473-33b8-4538-95ec-01f4871c859d'] Jun 16 14:48:49.647408 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.648862 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6516ce0f-04e9-4047-bdcc-8a6d6e8459f3 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Returning 404 to user: Security group 0a4244ec-45a2-4cd9-8c82-290dc69e2619 does not exist Jun 16 14:48:49.648862 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-1dafd473-33b8-4538-95ec-01f4871c859d'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:49.649937 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6516ce0f-04e9-4047-bdcc-8a6d6e8459f3 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.171674 Jun 16 14:48:49.650721 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1091/2146] 10.222.0.57 () {60 vars in 1194 bytes} [Thu Jun 16 14:48:49 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:48:49.663802 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5c4f6e6c-c5b7-41a7-b089-b0044d1090d0 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Calling method '.version_select at 0x7fdeffa3d430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:49.755268 n-d-836830-4 devstack@n-api.service[125862]: DEBUG neutronclient.v2_0.client [None req-5c4f6e6c-c5b7-41a7-b089-b0044d1090d0 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule b9eb332e-390f-4577-8c8e-0edc01676779 does not exist", "detail": ""}} {{(pid=125862) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 16 14:48:49.756084 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.security_group_api [None req-5c4f6e6c-c5b7-41a7-b089-b0044d1090d0 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Neutron security group rule b9eb332e-390f-4577-8c8e-0edc01676779 not found {{(pid=125862) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jun 16 14:48:49.756767 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-5c4f6e6c-c5b7-41a7-b089-b0044d1090d0 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] HTTP exception thrown: Security group rule b9eb332e-390f-4577-8c8e-0edc01676779 does not exist Jun 16 14:48:49.756767 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-966ee29c-93d4-4c0c-803f-b7174ee54063'] Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5c4f6e6c-c5b7-41a7-b089-b0044d1090d0 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Request method failure captured: Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/os-security-group-rules/b9eb332e-390f-4577-8c8e-0edc01676779 HTTP/1.1 Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0LDVbOxPPhfvkHLYwPBE9Fv3ntIAfEaDRcCySxIX1WUughH0JXuUFv3jFCQZ-_P1CGyb7xGBQymtqXk3W5ByPWHvr9EOXTjG1SXJuOYLPBB-GBZ8PM5tw-1_TUsZ_H9aCiPqylbESpsrkRQnE3wuC40HbymiJ_fuq8_kY7RkUJlx54 Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:48:49.758896 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:48:49.759885 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d0ccbc3a17734f41b7e15d0cf266d633", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d0ccbc3a17734f41b7e15d0cf266d633"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d0ccbc3a17734f41b7e15d0cf266d633"}]}] Jun 16 14:48:49.759885 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:49.759885 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: d0ccbc3a17734f41b7e15d0cf266d633 Jun 16 14:48:49.759885 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692 Jun 16 14:48:49.759885 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:49.759885 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:48:49.759885 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:48:49.759885 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 079910ba1e2f409b840a2e4d5754f901 Jun 16 14:48:49.759885 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project Jun 16 14:48:49.759885 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:48:49.759885 n-d-836830-4 devstack@n-api.service[125862]: exception: Security group rule b9eb332e-390f-4577-8c8e-0edc01676779 does not exist Jun 16 14:48:49.759885 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-966ee29c-93d4-4c0c-803f-b7174ee54063'] Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'b9eb332e-390f-4577-8c8e-0edc01676779'} Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:48:49.760498 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule b9eb332e-390f-4577-8c8e-0edc01676779 does not exist Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-966ee29c-93d4-4c0c-803f-b7174ee54063'] Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jun 16 14:48:49.761358 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule b9eb332e-390f-4577-8c8e-0edc01676779 does not exist Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-966ee29c-93d4-4c0c-803f-b7174ee54063'] Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule b9eb332e-390f-4577-8c8e-0edc01676779 does not exist Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-966ee29c-93d4-4c0c-803f-b7174ee54063'] Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.762744 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:49.764230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.764230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:49.764230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:49.764230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:49.764230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:49.764230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:49.764230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule b9eb332e-390f-4577-8c8e-0edc01676779 does not exist Jun 16 14:48:49.764230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-966ee29c-93d4-4c0c-803f-b7174ee54063'] Jun 16 14:48:49.764230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:49.765858 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5c4f6e6c-c5b7-41a7-b089-b0044d1090d0 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Returning 404 to user: Security group rule b9eb332e-390f-4577-8c8e-0edc01676779 does not exist Jun 16 14:48:49.765858 n-d-836830-4 devstack@n-api.service[125862]: Neutron server returns request_ids: ['req-966ee29c-93d4-4c0c-803f-b7174ee54063'] {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:49.767047 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5c4f6e6c-c5b7-41a7-b089-b0044d1090d0 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-group-rules/b9eb332e-390f-4577-8c8e-0edc01676779" status: 404 len: 199 microversion: 2.1 time: 0.108320 Jun 16 14:48:49.767845 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1092/2147] 10.222.0.57 () {58 vars in 1286 bytes} [Thu Jun 16 14:48:49 2022] DELETE /compute/v2.1/os-security-group-rules/b9eb332e-390f-4577-8c8e-0edc01676779 => generated 199 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:48:49.780251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-68fd80f7-05c4-4b1a-a8ce-2ad1985ff86d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:49.785576 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-68fd80f7-05c4-4b1a-a8ce-2ad1985ff86d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:49.807699 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ef471133-ece0-42ac-88d5-cd7e87807f30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:49.816640 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=84 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:49.820484 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-68fd80f7-05c4-4b1a-a8ce-2ad1985ff86d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:49.826585 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-68fd80f7-05c4-4b1a-a8ce-2ad1985ff86d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:49.828086 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-68fd80f7-05c4-4b1a-a8ce-2ad1985ff86d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:49.828904 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-68fd80f7-05c4-4b1a-a8ce-2ad1985ff86d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:49.829089 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ef471133-ece0-42ac-88d5-cd7e87807f30 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1466 microversion: 2.1 time: 0.816646 Jun 16 14:48:49.831141 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1056/2148] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:49 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1466 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:49.876797 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0a8e2cda-4348-4738-abb9-466092b492ae tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Calling method '.version_select at 0x7fdeffb60160>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:50.831866 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-68fd80f7-05c4-4b1a-a8ce-2ad1985ff86d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:50.846802 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-68fd80f7-05c4-4b1a-a8ce-2ad1985ff86d tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1487 microversion: 2.1 time: 1.077667 Jun 16 14:48:50.847713 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1093/2149] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:49 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1487 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:50.862827 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-67a7eda5-4d95-4420-8513-3b85ab63d9e5 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:50.891372 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-67a7eda5-4d95-4420-8513-3b85ab63d9e5 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:50.906666 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-67a7eda5-4d95-4420-8513-3b85ab63d9e5 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:50.907499 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-67a7eda5-4d95-4420-8513-3b85ab63d9e5 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:50.908567 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-67a7eda5-4d95-4420-8513-3b85ab63d9e5 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:50.909250 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-67a7eda5-4d95-4420-8513-3b85ab63d9e5 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:51.250989 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0a8e2cda-4348-4738-abb9-466092b492ae tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/d6a2f81c-9aaa-4dd3-aa78-c6d614d0af0f" status: 202 len: 0 microversion: 2.1 time: 1.410895 Jun 16 14:48:51.254072 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1057/2150] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:48:49 2022] DELETE /compute/v2.1/os-security-groups/d6a2f81c-9aaa-4dd3-aa78-c6d614d0af0f => generated 0 bytes in 1422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:48:51.271567 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-52835c9e-527f-4ec0-bb88-ce1d647480ea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:51.273306 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-52835c9e-527f-4ec0-bb88-ce1d647480ea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:51.296593 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-52835c9e-527f-4ec0-bb88-ce1d647480ea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:51.299517 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-52835c9e-527f-4ec0-bb88-ce1d647480ea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:51.302073 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-52835c9e-527f-4ec0-bb88-ce1d647480ea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:51.303261 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-52835c9e-527f-4ec0-bb88-ce1d647480ea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:51.428889 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-52835c9e-527f-4ec0-bb88-ce1d647480ea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:48:51.606741 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-52835c9e-527f-4ec0-bb88-ce1d647480ea tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 204 len: 0 microversion: 2.25 time: 0.349819 Jun 16 14:48:51.609731 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1058/2151] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 16 14:48:51 2022] DELETE /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 14:48:51.628635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-1b0de4bd-4295-4b3e-a7c5-db09f13db072 req-03f09c0d-b85d-46c2-904f-92ffefc68343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1", "tag": "d49d4b45-a2e1-4583-b9a7-3443ad4e6c4b"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:51.648480 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-1b0de4bd-4295-4b3e-a7c5-db09f13db072 req-03f09c0d-b85d-46c2-904f-92ffefc68343 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:51.648933 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-1b0de4bd-4295-4b3e-a7c5-db09f13db072 req-03f09c0d-b85d-46c2-904f-92ffefc68343 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:51.673172 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-1b0de4bd-4295-4b3e-a7c5-db09f13db072 req-03f09c0d-b85d-46c2-904f-92ffefc68343 service nova] Creating event network-changed:d49d4b45-a2e1-4583-b9a7-3443ad4e6c4b for instance 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 on n-h1-836830-4 Jun 16 14:48:51.684974 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-1b0de4bd-4295-4b3e-a7c5-db09f13db072 req-03f09c0d-b85d-46c2-904f-92ffefc68343 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070311 Jun 16 14:48:51.694900 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1059/2152] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:51.701282 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-67a7eda5-4d95-4420-8513-3b85ab63d9e5 tempest-ServersOnMultiNodesTest-1702838622 tempest-ServersOnMultiNodesTest-1702838622-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1617 microversion: 2.1 time: 0.851804 Jun 16 14:48:51.702357 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-74c0f019-78fb-48ca-87ec-700b8df87200 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:51.703336 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-74c0f019-78fb-48ca-87ec-700b8df87200 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:51.706490 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1094/2153] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:50 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1617 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:51.718756 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cd4abdee-c225-4806-8f38-e68ce79c2e29 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:51.722466 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cd4abdee-c225-4806-8f38-e68ce79c2e29 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:51.741941 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-74c0f019-78fb-48ca-87ec-700b8df87200 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:51.742691 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-74c0f019-78fb-48ca-87ec-700b8df87200 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:51.744079 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-74c0f019-78fb-48ca-87ec-700b8df87200 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:51.744697 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-74c0f019-78fb-48ca-87ec-700b8df87200 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:51.757777 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd4abdee-c225-4806-8f38-e68ce79c2e29 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:51.759576 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd4abdee-c225-4806-8f38-e68ce79c2e29 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:51.763642 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd4abdee-c225-4806-8f38-e68ce79c2e29 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:51.765499 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd4abdee-c225-4806-8f38-e68ce79c2e29 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:51.850726 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cd4abdee-c225-4806-8f38-e68ce79c2e29 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:48:52.171702 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cd4abdee-c225-4806-8f38-e68ce79c2e29 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 204 len: 0 microversion: 2.1 time: 0.459002 Jun 16 14:48:52.172765 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1095/2154] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:48:51 2022] DELETE /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:48:52.198546 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1fc10423-7895-4078-aa4c-d6201a93df1f tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Calling method '.version_select at 0x7fdeffa364c0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:52.310424 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-74c0f019-78fb-48ca-87ec-700b8df87200 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:52.324864 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-74c0f019-78fb-48ca-87ec-700b8df87200 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1313 microversion: 2.1 time: 0.628149 Jun 16 14:48:52.328650 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1060/2155] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:51 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1313 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:52.343964 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-e33d6850-ae46-4c1e-9f78-0c21d80d54a9 req-0bb4fc6b-c7da-40cb-9e34-6cee9cf2a7b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534d4bfc-9035-4a24-a3f1-4453fae05354", "name": "network-vif-plugged", "status": "completed", "tag": "e2145fcb-39df-44d5-9c1f-2f832c21ec45"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:52.370720 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-e33d6850-ae46-4c1e-9f78-0c21d80d54a9 req-0bb4fc6b-c7da-40cb-9e34-6cee9cf2a7b1 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:52.373840 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-e33d6850-ae46-4c1e-9f78-0c21d80d54a9 req-0bb4fc6b-c7da-40cb-9e34-6cee9cf2a7b1 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:52.426867 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-e33d6850-ae46-4c1e-9f78-0c21d80d54a9 req-0bb4fc6b-c7da-40cb-9e34-6cee9cf2a7b1 service nova] Creating event network-vif-plugged:e2145fcb-39df-44d5-9c1f-2f832c21ec45 for instance 534d4bfc-9035-4a24-a3f1-4453fae05354 on n-h2-836830-4 Jun 16 14:48:52.436729 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-e33d6850-ae46-4c1e-9f78-0c21d80d54a9 req-0bb4fc6b-c7da-40cb-9e34-6cee9cf2a7b1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096629 Jun 16 14:48:52.439089 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1061/2156] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:52.457604 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c8421808-5531-44dd-839e-283a0ab5a97a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:52.459449 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c8421808-5531-44dd-839e-283a0ab5a97a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:52.475098 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c8421808-5531-44dd-839e-283a0ab5a97a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:52.476302 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c8421808-5531-44dd-839e-283a0ab5a97a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:52.478406 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c8421808-5531-44dd-839e-283a0ab5a97a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:52.479489 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c8421808-5531-44dd-839e-283a0ab5a97a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:52.763214 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c8421808-5531-44dd-839e-283a0ab5a97a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:52.786650 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c8421808-5531-44dd-839e-283a0ab5a97a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:52.790546 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c8421808-5531-44dd-839e-283a0ab5a97a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:52.802716 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c8421808-5531-44dd-839e-283a0ab5a97a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1612 microversion: 2.25 time: 0.346579 Jun 16 14:48:52.814476 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1062/2157] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:52 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1612 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:52.821925 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-77014d4f-3ef1-4617-878d-4d4fb4d293f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:52.822488 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-77014d4f-3ef1-4617-878d-4d4fb4d293f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:52.847982 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-77014d4f-3ef1-4617-878d-4d4fb4d293f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:52.848790 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-77014d4f-3ef1-4617-878d-4d4fb4d293f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:52.850247 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-77014d4f-3ef1-4617-878d-4d4fb4d293f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:52.851108 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-77014d4f-3ef1-4617-878d-4d4fb4d293f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:52.915433 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-77014d4f-3ef1-4617-878d-4d4fb4d293f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:48:53.075724 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1fc10423-7895-4078-aa4c-d6201a93df1f tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/4cd89f85-b3a4-4ea3-9ecb-88fa22891f64" status: 202 len: 0 microversion: 2.1 time: 0.890581 Jun 16 14:48:53.076986 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1096/2158] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:48:52 2022] DELETE /compute/v2.1/os-security-groups/4cd89f85-b3a4-4ea3-9ecb-88fa22891f64 => generated 0 bytes in 898 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:48:53.107233 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7287d45a-7ea2-4be3-b709-b3b5beb0f6d5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffb5e9d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:53.122727 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-77014d4f-3ef1-4617-878d-4d4fb4d293f1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 204 len: 0 microversion: 2.1 time: 0.316439 Jun 16 14:48:53.126432 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1063/2159] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:48:52 2022] DELETE /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:48:53.130258 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a63436ea-4532-4031-b2ac-d674fcf6c994 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Calling method '.version_select at 0x7fdeffb60940>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:53.184608 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-7287d45a-7ea2-4be3-b709-b3b5beb0f6d5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] HTTP exception thrown: Image not found. Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7287d45a-7ea2-4be3-b709-b3b5beb0f6d5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Request method failure captured: Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/images/25ad57f1-b010-4e38-a3ee-e60ba2cd9e98 HTTP/1.1 Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0GXWER_qcQbzs1hlNo1uSwhCWxXAxWchb3BhDhK3YnQKpbaj6WIdgdHwudyOZUYPpV_QFWV-3-U8zgzws4nM0r9vaM-bklKcuJyQkQmrllzUDt67ONRUpvj6NQwf9PAx706GCikziLMpRB73GMspW6HuKRqeUlLrCwOL8FFL93uWq0 Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:48:53.188591 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:48:53.189725 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1ac65ee04fbf47608c18c173900ad8f7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1ac65ee04fbf47608c18c173900ad8f7"}]}] Jun 16 14:48:53.189725 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesTestJSON-1889241253 Jun 16 14:48:53.189725 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:48:53.189725 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:48:53.189725 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesTestJSON-1889241253-project Jun 16 14:48:53.189725 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:48:53.189725 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:48:53.189725 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: f91d14d5fb884048a0b12279c62e963d Jun 16 14:48:53.189725 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesTestJSON-1889241253-project Jun 16 14:48:53.189725 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:48:53.189725 n-d-836830-4 devstack@n-api.service[125862]: exception: Image not found. Jun 16 14:48:53.189725 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '25ad57f1-b010-4e38-a3ee-e60ba2cd9e98'} Jun 16 14:48:53.189725 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:53.189725 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 25ad57f1-b010-4e38-a3ee-e60ba2cd9e98 to delete Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:53.190979 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 25ad57f1-b010-4e38-a3ee-e60ba2cd9e98 could not be found. Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:53.191891 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 14:48:53.192799 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:48:53.192799 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:48:53.192799 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:53.192799 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:53.192799 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:53.192799 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:53.192799 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:53.192799 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:53.192799 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:53.192799 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:53.192799 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:48:53.192799 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:53.192799 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7287d45a-7ea2-4be3-b709-b3b5beb0f6d5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Returning 404 to user: Image not found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:53.192799 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7287d45a-7ea2-4be3-b709-b3b5beb0f6d5 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/images/25ad57f1-b010-4e38-a3ee-e60ba2cd9e98" status: 404 len: 62 microversion: 2.1 time: 0.113640 Jun 16 14:48:53.206931 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1097/2160] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:53 2022] DELETE /compute/v2.1/images/25ad57f1-b010-4e38-a3ee-e60ba2cd9e98 => generated 62 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:48:53.216340 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-231b63f2-c535-4783-bc20-6c180e4542a1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:53.217735 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-231b63f2-c535-4783-bc20-6c180e4542a1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:53.239292 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-231b63f2-c535-4783-bc20-6c180e4542a1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:53.239766 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-231b63f2-c535-4783-bc20-6c180e4542a1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:53.240671 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-231b63f2-c535-4783-bc20-6c180e4542a1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:53.241137 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-231b63f2-c535-4783-bc20-6c180e4542a1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:53.247959 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:53.266610 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:54.306373 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-231b63f2-c535-4783-bc20-6c180e4542a1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:54.323087 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-231b63f2-c535-4783-bc20-6c180e4542a1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1472 microversion: 2.1 time: 1.111875 Jun 16 14:48:54.326880 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1098/2161] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:53 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1472 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:54.341254 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ba3dc52b-c880-4cd9-bcb6-acaec40c8951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:54.342172 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ba3dc52b-c880-4cd9-bcb6-acaec40c8951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:54.363504 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba3dc52b-c880-4cd9-bcb6-acaec40c8951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:54.367356 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba3dc52b-c880-4cd9-bcb6-acaec40c8951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:54.368872 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba3dc52b-c880-4cd9-bcb6-acaec40c8951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:54.372355 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba3dc52b-c880-4cd9-bcb6-acaec40c8951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:54.433200 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ba3dc52b-c880-4cd9-bcb6-acaec40c8951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:48:54.504296 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.compute.api [None req-ba3dc52b-c880-4cd9-bcb6-acaec40c8951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Instance is already in deleting state, ignoring this request Jun 16 14:48:54.505738 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ba3dc52b-c880-4cd9-bcb6-acaec40c8951 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 204 len: 0 microversion: 2.1 time: 0.175744 Jun 16 14:48:54.510291 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1099/2162] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:48:54 2022] DELETE /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:48:54.519438 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-55a0cd1a-5ee5-4603-ad80-d765eb378e12 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:54.520611 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-55a0cd1a-5ee5-4603-ad80-d765eb378e12 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:54.537156 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-55a0cd1a-5ee5-4603-ad80-d765eb378e12 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:54.537875 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-55a0cd1a-5ee5-4603-ad80-d765eb378e12 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:54.539622 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-55a0cd1a-5ee5-4603-ad80-d765eb378e12 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:54.540359 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-55a0cd1a-5ee5-4603-ad80-d765eb378e12 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:54.568518 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a63436ea-4532-4031-b2ac-d674fcf6c994 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/2e377dff-3a94-46bc-9a66-1bb7d7060629" status: 202 len: 0 microversion: 2.1 time: 1.443399 Jun 16 14:48:54.569774 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1064/2163] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:48:53 2022] DELETE /compute/v2.1/os-security-groups/2e377dff-3a94-46bc-9a66-1bb7d7060629 => generated 0 bytes in 1445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:48:54.580450 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8f6777fe-c007-4719-98e9-3987b9a12ce7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:54.581411 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8f6777fe-c007-4719-98e9-3987b9a12ce7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:54.602270 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8f6777fe-c007-4719-98e9-3987b9a12ce7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:54.608417 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8f6777fe-c007-4719-98e9-3987b9a12ce7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:54.609524 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8f6777fe-c007-4719-98e9-3987b9a12ce7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:54.611540 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8f6777fe-c007-4719-98e9-3987b9a12ce7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:54.946649 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-55a0cd1a-5ee5-4603-ad80-d765eb378e12 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:54.966679 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8f6777fe-c007-4719-98e9-3987b9a12ce7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:54.972207 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-55a0cd1a-5ee5-4603-ad80-d765eb378e12 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1313 microversion: 2.1 time: 0.446029 Jun 16 14:48:54.984759 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1100/2164] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:54 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:54.992186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8f6777fe-c007-4719-98e9-3987b9a12ce7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:55.017324 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d41d65a9-ca96-4064-a219-b66666175cf3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:55.024898 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8f6777fe-c007-4719-98e9-3987b9a12ce7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:55.042746 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d41d65a9-ca96-4064-a219-b66666175cf3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:55.048561 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8f6777fe-c007-4719-98e9-3987b9a12ce7 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1612 microversion: 2.25 time: 0.455834 Jun 16 14:48:55.050037 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1065/2165] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:54 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1612 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:55.058984 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6ed2dea9-4b57-4f6b-a4b0-f15d988b137a tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Calling method '.version_select at 0x7fdf11103a60>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:55.063112 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d41d65a9-ca96-4064-a219-b66666175cf3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:55.063723 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d41d65a9-ca96-4064-a219-b66666175cf3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:55.064544 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d41d65a9-ca96-4064-a219-b66666175cf3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:55.064995 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d41d65a9-ca96-4064-a219-b66666175cf3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:55.415672 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d41d65a9-ca96-4064-a219-b66666175cf3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:55.459999 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d41d65a9-ca96-4064-a219-b66666175cf3 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1493 microversion: 2.1 time: 0.473013 Jun 16 14:48:55.462222 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1101/2166] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:54 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1493 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:55.474058 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c559d331-432b-4d0f-80bc-17d2b1f88c32 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:55.477833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c559d331-432b-4d0f-80bc-17d2b1f88c32 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:55.495319 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c559d331-432b-4d0f-80bc-17d2b1f88c32 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:55.498741 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c559d331-432b-4d0f-80bc-17d2b1f88c32 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:55.502765 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c559d331-432b-4d0f-80bc-17d2b1f88c32 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:55.504335 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c559d331-432b-4d0f-80bc-17d2b1f88c32 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:56.446882 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c559d331-432b-4d0f-80bc-17d2b1f88c32 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:56.479447 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c559d331-432b-4d0f-80bc-17d2b1f88c32 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1472 microversion: 2.1 time: 1.014837 Jun 16 14:48:56.481124 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1102/2167] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:55 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1472 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:56.491631 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b91eaae0-3ffe-4edc-b85b-0db1276d1533 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:56.501426 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b91eaae0-3ffe-4edc-b85b-0db1276d1533 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:56.502909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b91eaae0-3ffe-4edc-b85b-0db1276d1533 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Searching by: {'deleted': False, 'project_id': 'fb4a315608594ee79027be384bc4613d'} {{(pid=125862) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:48:56.523228 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b91eaae0-3ffe-4edc-b85b-0db1276d1533 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:56.525082 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b91eaae0-3ffe-4edc-b85b-0db1276d1533 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:56.526924 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b91eaae0-3ffe-4edc-b85b-0db1276d1533 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:56.528713 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b91eaae0-3ffe-4edc-b85b-0db1276d1533 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:56.886674 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.multi_cell_list [None req-b91eaae0-3ffe-4edc-b85b-0db1276d1533 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:48:56.893640 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6ed2dea9-4b57-4f6b-a4b0-f15d988b137a tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/bc34f81d-a499-41bd-8f53-55b04ba01013" status: 202 len: 0 microversion: 2.1 time: 1.839074 Jun 16 14:48:56.895281 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1066/2168] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:48:55 2022] DELETE /compute/v2.1/os-security-groups/bc34f81d-a499-41bd-8f53-55b04ba01013 => generated 0 bytes in 1844 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:48:56.915680 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-25c41b1e-be59-4094-8ca9-afea1e6eb1f4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:56.917324 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-25c41b1e-be59-4094-8ca9-afea1e6eb1f4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:56.961941 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-25c41b1e-be59-4094-8ca9-afea1e6eb1f4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:56.963072 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-25c41b1e-be59-4094-8ca9-afea1e6eb1f4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:56.968154 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-25c41b1e-be59-4094-8ca9-afea1e6eb1f4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:56.971016 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-25c41b1e-be59-4094-8ca9-afea1e6eb1f4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:57.179711 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b91eaae0-3ffe-4edc-b85b-0db1276d1533 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.696277 Jun 16 14:48:57.180135 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1103/2169] 10.222.0.57 () {58 vars in 1124 bytes} [Thu Jun 16 14:48:56 2022] GET /compute/v2.1/servers => generated 333 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:57.192621 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e84275a2-8728-42f7-b41d-1501a474be94 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:57.199520 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e84275a2-8728-42f7-b41d-1501a474be94 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:57.212889 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e84275a2-8728-42f7-b41d-1501a474be94 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:57.219948 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e84275a2-8728-42f7-b41d-1501a474be94 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:57.221328 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e84275a2-8728-42f7-b41d-1501a474be94 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:57.223220 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e84275a2-8728-42f7-b41d-1501a474be94 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:57.341810 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-25c41b1e-be59-4094-8ca9-afea1e6eb1f4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:57.352345 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-25c41b1e-be59-4094-8ca9-afea1e6eb1f4 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1313 microversion: 2.1 time: 0.455438 Jun 16 14:48:57.359047 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1067/2170] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:56 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:57.371957 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-81b7e8ce-453c-487b-bd57-8f089f6d2c57 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:57.375800 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-81b7e8ce-453c-487b-bd57-8f089f6d2c57 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:57.396778 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81b7e8ce-453c-487b-bd57-8f089f6d2c57 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:57.397242 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81b7e8ce-453c-487b-bd57-8f089f6d2c57 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:57.398100 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81b7e8ce-453c-487b-bd57-8f089f6d2c57 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:57.398582 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-81b7e8ce-453c-487b-bd57-8f089f6d2c57 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:57.865290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e84275a2-8728-42f7-b41d-1501a474be94 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:57.895771 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e84275a2-8728-42f7-b41d-1501a474be94 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:57.904729 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e84275a2-8728-42f7-b41d-1501a474be94 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:57.909781 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e84275a2-8728-42f7-b41d-1501a474be94 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 200 len: 1544 microversion: 2.25 time: 0.727058 Jun 16 14:48:57.912094 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1104/2171] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:57 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 1544 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:48:57.939829 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-eedfc111-44a8-4cef-ade8-adf586fffe61 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] Calling method '.version_select at 0x7fdeffa37ee0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:58.242025 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-81b7e8ce-453c-487b-bd57-8f089f6d2c57 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f91d14d5fb884048a0b12279c62e963d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac65ee04fbf47608c18c173900ad8f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:58.251332 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-81b7e8ce-453c-487b-bd57-8f089f6d2c57 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 200 len: 1493 microversion: 2.1 time: 0.890902 Jun 16 14:48:58.255518 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1068/2172] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:57 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 1493 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:58.266933 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1c981fcc-f35d-47a8-a201-c9400ec32f0a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:58.279202 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1c981fcc-f35d-47a8-a201-c9400ec32f0a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:58.280419 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1c981fcc-f35d-47a8-a201-c9400ec32f0a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Searching by: {'deleted': False, 'project_id': 'fb4a315608594ee79027be384bc4613d'} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:48:58.329298 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1c981fcc-f35d-47a8-a201-c9400ec32f0a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:58.334720 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1c981fcc-f35d-47a8-a201-c9400ec32f0a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:58.343781 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1c981fcc-f35d-47a8-a201-c9400ec32f0a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:58.347980 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1c981fcc-f35d-47a8-a201-c9400ec32f0a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:58.450591 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.multi_cell_list [None req-1c981fcc-f35d-47a8-a201-c9400ec32f0a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:48:58.528001 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1c981fcc-f35d-47a8-a201-c9400ec32f0a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:58.549547 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1c981fcc-f35d-47a8-a201-c9400ec32f0a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:58.550003 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1c981fcc-f35d-47a8-a201-c9400ec32f0a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:58.698519 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-eedfc111-44a8-4cef-ade8-adf586fffe61 tempest-SecurityGroupRulesNegativeTestJSON-1581980692 tempest-SecurityGroupRulesNegativeTestJSON-1581980692-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/3ff29d77-5a12-463a-b1b3-0ef1cbae50bc" status: 202 len: 0 microversion: 2.1 time: 0.784087 Jun 16 14:48:58.700589 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1105/2173] 10.222.0.57 () {58 vars in 1271 bytes} [Thu Jun 16 14:48:57 2022] DELETE /compute/v2.1/os-security-groups/3ff29d77-5a12-463a-b1b3-0ef1cbae50bc => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:48:58.706289 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ac08af1d-a20a-4499-b404-09c978577fcc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:58.709412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ac08af1d-a20a-4499-b404-09c978577fcc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:58.725682 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac08af1d-a20a-4499-b404-09c978577fcc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:58.726471 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac08af1d-a20a-4499-b404-09c978577fcc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:58.729145 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac08af1d-a20a-4499-b404-09c978577fcc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:58.730924 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac08af1d-a20a-4499-b404-09c978577fcc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:58.839093 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac08af1d-a20a-4499-b404-09c978577fcc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:58.841594 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac08af1d-a20a-4499-b404-09c978577fcc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:58.843070 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-ac08af1d-a20a-4499-b404-09c978577fcc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lazy-loading 'fault' on Instance uuid 9e471e81-e487-4b6b-a938-d55179b3f318 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:48:59.256424 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1c981fcc-f35d-47a8-a201-c9400ec32f0a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.993993 Jun 16 14:48:59.258855 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1069/2174] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:48:58 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:59.288132 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-505243d5-2194-4b2d-8608-c5efd5fa8a25 req-55e35bb4-3ff1-4e03-9eba-2c7916abec8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e471e81-e487-4b6b-a938-d55179b3f318", "name": "network-vif-deleted", "tag": "6bf23910-77e2-4149-b29f-a2f944a91ab8"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:59.308051 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-505243d5-2194-4b2d-8608-c5efd5fa8a25 req-55e35bb4-3ff1-4e03-9eba-2c7916abec8e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:59.310993 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-505243d5-2194-4b2d-8608-c5efd5fa8a25 req-55e35bb4-3ff1-4e03-9eba-2c7916abec8e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:59.342544 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-505243d5-2194-4b2d-8608-c5efd5fa8a25 req-55e35bb4-3ff1-4e03-9eba-2c7916abec8e service nova] Creating event network-vif-deleted:6bf23910-77e2-4149-b29f-a2f944a91ab8 for instance 9e471e81-e487-4b6b-a938-d55179b3f318 on n-h2-836830-4 Jun 16 14:48:59.352677 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-505243d5-2194-4b2d-8608-c5efd5fa8a25 req-55e35bb4-3ff1-4e03-9eba-2c7916abec8e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091761 Jun 16 14:48:59.355827 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1070/2175] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:59.371889 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e45a339d-2e9b-442f-bf9b-45114dd610f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:59.373025 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e45a339d-2e9b-442f-bf9b-45114dd610f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:59.396320 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e45a339d-2e9b-442f-bf9b-45114dd610f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:59.396781 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e45a339d-2e9b-442f-bf9b-45114dd610f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:59.397874 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e45a339d-2e9b-442f-bf9b-45114dd610f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:59.398334 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e45a339d-2e9b-442f-bf9b-45114dd610f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:59.458453 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ac08af1d-a20a-4499-b404-09c978577fcc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:59.478302 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ac08af1d-a20a-4499-b404-09c978577fcc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 200 len: 1307 microversion: 2.1 time: 0.776191 Jun 16 14:48:59.496139 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1106/2176] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:58 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 1307 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:59.510540 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e0216000-0552-4d3a-891c-21c507329df1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:59.522878 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e0216000-0552-4d3a-891c-21c507329df1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: e4855363-724b-4eff-a76e-915e440af995] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:59.533199 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0216000-0552-4d3a-891c-21c507329df1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:59.533621 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0216000-0552-4d3a-891c-21c507329df1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:59.535414 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0216000-0552-4d3a-891c-21c507329df1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:59.559764 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0216000-0552-4d3a-891c-21c507329df1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:59.626750 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-e0216000-0552-4d3a-891c-21c507329df1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] HTTP exception thrown: Instance e4855363-724b-4eff-a76e-915e440af995 could not be found. Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e0216000-0552-4d3a-891c-21c507329df1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Request method failure captured: Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 HTTP/1.1 Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0B-okSquj7GELrJS9sbKyWDvmtrmgWBNPvmmVc8YS2EMY5GO6BwHHqKgKslswttQRM-ofZOzOefvWdL-wuYwd_JFkXSTAPHrPLKMx86sspLrTCbbDUAFwj6hIH2GTU23RKnbPK7FBh07yhNRgoGUpI-6VhkqUuOv3_jRJjOPJzFox4 Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: X-Openstack-Nova-Api-Version: 2.25 Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: c04830ebf498422d9dddfbc009697728 Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-706483184 Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:48:59.628519 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:48:59.629819 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c04830ebf498422d9dddfbc009697728", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c04830ebf498422d9dddfbc009697728"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c04830ebf498422d9dddfbc009697728"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c04830ebf498422d9dddfbc009697728"}]}] Jun 16 14:48:59.629819 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-706483184 Jun 16 14:48:59.629819 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: c04830ebf498422d9dddfbc009697728 Jun 16 14:48:59.629819 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-706483184 Jun 16 14:48:59.629819 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-LiveAutoBlockMigrationV225Test-706483184-project Jun 16 14:48:59.629819 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:48:59.629819 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:48:59.629819 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: ab3aa4e887694a0e9a42bf6db6b01555 Jun 16 14:48:59.629819 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-706483184-project Jun 16 14:48:59.629819 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:48:59.629819 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance e4855363-724b-4eff-a76e-915e440af995 could not be found. Jun 16 14:48:59.629819 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'e4855363-724b-4eff-a76e-915e440af995'} Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4855363-724b-4eff-a76e-915e440af995 could not be found. Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:59.630578 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4855363-724b-4eff-a76e-915e440af995 could not be found. Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4855363-724b-4eff-a76e-915e440af995 could not be found. Jun 16 14:48:59.631530 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:59.632481 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e0216000-0552-4d3a-891c-21c507329df1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Returning 404 to user: Instance e4855363-724b-4eff-a76e-915e440af995 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:59.632481 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e0216000-0552-4d3a-891c-21c507329df1 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995" status: 404 len: 111 microversion: 2.25 time: 0.131721 Jun 16 14:48:59.641158 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1107/2177] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:48:59 2022] GET /compute/v2.1/servers/e4855363-724b-4eff-a76e-915e440af995 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:48:59.670938 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b6aaa969-b5e2-44c9-988e-0a4a4a59c1df tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:59.689113 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b6aaa969-b5e2-44c9-988e-0a4a4a59c1df tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046661 Jun 16 14:48:59.702997 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1108/2178] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:48:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:59.708900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8f94888b-bbb5-417b-b7a2-433cdcf0feac tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:59.713824 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8f94888b-bbb5-417b-b7a2-433cdcf0feac tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 534d4bfc-9035-4a24-a3f1-4453fae05354] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:59.730538 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f94888b-bbb5-417b-b7a2-433cdcf0feac tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:59.741805 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f94888b-bbb5-417b-b7a2-433cdcf0feac tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:59.742727 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f94888b-bbb5-417b-b7a2-433cdcf0feac tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:59.743154 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f94888b-bbb5-417b-b7a2-433cdcf0feac tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:59.768688 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-8f94888b-bbb5-417b-b7a2-433cdcf0feac tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] HTTP exception thrown: Instance 534d4bfc-9035-4a24-a3f1-4453fae05354 could not be found. Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8f94888b-bbb5-417b-b7a2-433cdcf0feac tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Request method failure captured: Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 HTTP/1.1 Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0GXWER_qcQbzs1hlNo1uSwhCWxXAxWchb3BhDhK3YnQKpbaj6WIdgdHwudyOZUYPpV_QFWV-3-U8zgzws4nM0r9vaM-bklKcuJyQkQmrllzUDt67ONRUpvj6NQwf9PAx706GCikziLMpRB73GMspW6HuKRqeUlLrCwOL8FFL93uWq0 Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:48:59.778307 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:48:59.779456 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1ac65ee04fbf47608c18c173900ad8f7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1ac65ee04fbf47608c18c173900ad8f7"}]}] Jun 16 14:48:59.779456 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesTestJSON-1889241253 Jun 16 14:48:59.779456 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:48:59.779456 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:48:59.779456 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesTestJSON-1889241253-project Jun 16 14:48:59.779456 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:48:59.779456 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:48:59.779456 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: f91d14d5fb884048a0b12279c62e963d Jun 16 14:48:59.779456 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesTestJSON-1889241253-project Jun 16 14:48:59.779456 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:48:59.779456 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 534d4bfc-9035-4a24-a3f1-4453fae05354 could not be found. Jun 16 14:48:59.779456 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '534d4bfc-9035-4a24-a3f1-4453fae05354'} Jun 16 14:48:59.779456 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 534d4bfc-9035-4a24-a3f1-4453fae05354 could not be found. Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:48:59.780093 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 534d4bfc-9035-4a24-a3f1-4453fae05354 could not be found. Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 534d4bfc-9035-4a24-a3f1-4453fae05354 could not be found. Jun 16 14:48:59.781059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:48:59.783598 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8f94888b-bbb5-417b-b7a2-433cdcf0feac tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Returning 404 to user: Instance 534d4bfc-9035-4a24-a3f1-4453fae05354 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:48:59.784770 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8f94888b-bbb5-417b-b7a2-433cdcf0feac tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354" status: 404 len: 111 microversion: 2.1 time: 0.079850 Jun 16 14:48:59.803089 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1109/2179] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:59 2022] GET /compute/v2.1/servers/534d4bfc-9035-4a24-a3f1-4453fae05354 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:48:59.806593 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e45a339d-2e9b-442f-bf9b-45114dd610f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:48:59.820950 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d30efbb7-9bc7-4d98-84d5-23abfa35f3fe tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:59.821482 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d30efbb7-9bc7-4d98-84d5-23abfa35f3fe tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:48:59.825921 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e45a339d-2e9b-442f-bf9b-45114dd610f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1313 microversion: 2.1 time: 0.468226 Jun 16 14:48:59.835444 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1071/2180] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:59 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:59.840189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d30efbb7-9bc7-4d98-84d5-23abfa35f3fe tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:59.840672 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d30efbb7-9bc7-4d98-84d5-23abfa35f3fe tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:59.841693 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d30efbb7-9bc7-4d98-84d5-23abfa35f3fe tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:59.842154 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d30efbb7-9bc7-4d98-84d5-23abfa35f3fe tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:59.860734 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-42735fdc-0dd1-4b53-849e-d0836f0850e1 req-44554bc8-582c-4c69-8faa-1c38c06b44b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1", "name": "network-vif-plugged", "status": "completed", "tag": "d49d4b45-a2e1-4583-b9a7-3443ad4e6c4b"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:59.878100 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-42735fdc-0dd1-4b53-849e-d0836f0850e1 req-44554bc8-582c-4c69-8faa-1c38c06b44b6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:48:59.878893 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-42735fdc-0dd1-4b53-849e-d0836f0850e1 req-44554bc8-582c-4c69-8faa-1c38c06b44b6 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:48:59.898096 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d30efbb7-9bc7-4d98-84d5-23abfa35f3fe tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:48:59.912494 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-42735fdc-0dd1-4b53-849e-d0836f0850e1 req-44554bc8-582c-4c69-8faa-1c38c06b44b6 service nova] Creating event network-vif-plugged:d49d4b45-a2e1-4583-b9a7-3443ad4e6c4b for instance 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 on n-h1-836830-4 Jun 16 14:48:59.934294 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-42735fdc-0dd1-4b53-849e-d0836f0850e1 req-44554bc8-582c-4c69-8faa-1c38c06b44b6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087580 Jun 16 14:48:59.940766 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1072/2181] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:59.955999 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0192c243-30d7-4be5-9db4-2b0d874abf8e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffe71d30>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:59.999554 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-0192c243-30d7-4be5-9db4-2b0d874abf8e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] HTTP exception thrown: Image not found. Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0192c243-30d7-4be5-9db4-2b0d874abf8e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Request method failure captured: Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b HTTP/1.1 Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0GXWER_qcQbzs1hlNo1uSwhCWxXAxWchb3BhDhK3YnQKpbaj6WIdgdHwudyOZUYPpV_QFWV-3-U8zgzws4nM0r9vaM-bklKcuJyQkQmrllzUDt67ONRUpvj6NQwf9PAx706GCikziLMpRB73GMspW6HuKRqeUlLrCwOL8FFL93uWq0 Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:49:00.002890 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:49:00.004309 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1ac65ee04fbf47608c18c173900ad8f7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1ac65ee04fbf47608c18c173900ad8f7"}]}] Jun 16 14:49:00.004309 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:00.004309 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:00.004309 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:00.004309 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:00.004309 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:49:00.004309 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:49:00.004309 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: f91d14d5fb884048a0b12279c62e963d Jun 16 14:49:00.004309 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:00.004309 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:49:00.004309 n-d-836830-4 devstack@n-api.service[125863]: exception: Image not found. Jun 16 14:49:00.004309 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b'} Jun 16 14:49:00.004309 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:00.004309 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b to delete Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.005249 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b could not be found. Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:00.006724 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 14:49:00.010488 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:49:00.010488 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:49:00.010488 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.010488 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:00.010488 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.010488 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:00.010488 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:00.010488 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:00.010488 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:00.010488 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:00.010488 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:49:00.010488 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.012854 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0192c243-30d7-4be5-9db4-2b0d874abf8e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Returning 404 to user: Image not found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:00.014536 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0192c243-30d7-4be5-9db4-2b0d874abf8e tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b" status: 404 len: 62 microversion: 2.1 time: 0.072455 Jun 16 14:49:00.024650 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1073/2182] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:48:59 2022] DELETE /compute/v2.1/images/40a8fcb6-5a8d-4b86-a302-eea2ef4fc66b => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:49:00.059172 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-28345955-01b5-452f-a94c-0ac8b75ec024 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:00.061436 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-28345955-01b5-452f-a94c-0ac8b75ec024 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:00.073688 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28345955-01b5-452f-a94c-0ac8b75ec024 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:00.080172 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28345955-01b5-452f-a94c-0ac8b75ec024 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:00.082683 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28345955-01b5-452f-a94c-0ac8b75ec024 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:00.083830 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d30efbb7-9bc7-4d98-84d5-23abfa35f3fe tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 204 len: 0 microversion: 2.25 time: 0.277699 Jun 16 14:49:00.084520 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28345955-01b5-452f-a94c-0ac8b75ec024 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:00.084922 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1110/2183] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 16 14:48:59 2022] DELETE /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 14:49:00.092986 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f87840f5-1293-4696-ba8d-a481e350d5c9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:00.093597 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f87840f5-1293-4696-ba8d-a481e350d5c9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:00.102654 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f87840f5-1293-4696-ba8d-a481e350d5c9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:00.102654 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f87840f5-1293-4696-ba8d-a481e350d5c9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:00.103069 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f87840f5-1293-4696-ba8d-a481e350d5c9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:00.103464 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f87840f5-1293-4696-ba8d-a481e350d5c9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:00.133291 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-f87840f5-1293-4696-ba8d-a481e350d5c9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] HTTP exception thrown: Instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 could not be found. Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f87840f5-1293-4696-ba8d-a481e350d5c9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Request method failure captured: Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 HTTP/1.1 Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0GXWER_qcQbzs1hlNo1uSwhCWxXAxWchb3BhDhK3YnQKpbaj6WIdgdHwudyOZUYPpV_QFWV-3-U8zgzws4nM0r9vaM-bklKcuJyQkQmrllzUDt67ONRUpvj6NQwf9PAx706GCikziLMpRB73GMspW6HuKRqeUlLrCwOL8FFL93uWq0 Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:49:00.136840 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:49:00.139145 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1ac65ee04fbf47608c18c173900ad8f7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1ac65ee04fbf47608c18c173900ad8f7"}]}] Jun 16 14:49:00.139145 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:00.139145 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:00.139145 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:00.139145 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:00.139145 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:49:00.139145 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:49:00.139145 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: f91d14d5fb884048a0b12279c62e963d Jun 16 14:49:00.139145 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:00.139145 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:49:00.139145 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 could not be found. Jun 16 14:49:00.139145 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'b76875a5-11a5-4d7f-9db3-7a731c2589a1'} Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 could not be found. Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:00.140255 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 could not be found. Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 could not be found. Jun 16 14:49:00.142134 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.152912 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f87840f5-1293-4696-ba8d-a481e350d5c9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Returning 404 to user: Instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:00.152912 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f87840f5-1293-4696-ba8d-a481e350d5c9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1" status: 404 len: 111 microversion: 2.1 time: 0.053582 Jun 16 14:49:00.152912 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1111/2184] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:49:00 2022] DELETE /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:00.167483 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-81f3663c-a84b-460f-a5f2-713f0ae1452a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:00.167483 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-81f3663c-a84b-460f-a5f2-713f0ae1452a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:00.181869 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-81f3663c-a84b-460f-a5f2-713f0ae1452a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:00.182366 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-81f3663c-a84b-460f-a5f2-713f0ae1452a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:00.184237 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-81f3663c-a84b-460f-a5f2-713f0ae1452a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:00.184237 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-81f3663c-a84b-460f-a5f2-713f0ae1452a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:00.225291 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-28345955-01b5-452f-a94c-0ac8b75ec024 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:49:00.276965 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:00.544129 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-28345955-01b5-452f-a94c-0ac8b75ec024 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 204 len: 0 microversion: 2.1 time: 0.515645 Jun 16 14:49:00.548887 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1074/2185] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:49:00 2022] DELETE /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:49:00.569461 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b841c10c-3e5c-48a5-b285-2d8d8deffcd0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:00.571593 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b841c10c-3e5c-48a5-b285-2d8d8deffcd0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: b76875a5-11a5-4d7f-9db3-7a731c2589a1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:00.586669 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b841c10c-3e5c-48a5-b285-2d8d8deffcd0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:00.588042 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b841c10c-3e5c-48a5-b285-2d8d8deffcd0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:00.590615 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b841c10c-3e5c-48a5-b285-2d8d8deffcd0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:00.592069 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b841c10c-3e5c-48a5-b285-2d8d8deffcd0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:00.628419 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-b841c10c-3e5c-48a5-b285-2d8d8deffcd0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] HTTP exception thrown: Instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 could not be found. Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b841c10c-3e5c-48a5-b285-2d8d8deffcd0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Request method failure captured: Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 HTTP/1.1 Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0GXWER_qcQbzs1hlNo1uSwhCWxXAxWchb3BhDhK3YnQKpbaj6WIdgdHwudyOZUYPpV_QFWV-3-U8zgzws4nM0r9vaM-bklKcuJyQkQmrllzUDt67ONRUpvj6NQwf9PAx706GCikziLMpRB73GMspW6HuKRqeUlLrCwOL8FFL93uWq0 Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:49:00.632260 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:49:00.634747 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1ac65ee04fbf47608c18c173900ad8f7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1ac65ee04fbf47608c18c173900ad8f7"}]}] Jun 16 14:49:00.634747 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:00.634747 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:00.634747 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:00.634747 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:00.634747 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:49:00.634747 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:49:00.634747 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: f91d14d5fb884048a0b12279c62e963d Jun 16 14:49:00.634747 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:00.634747 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:49:00.634747 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 could not be found. Jun 16 14:49:00.634747 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'b76875a5-11a5-4d7f-9db3-7a731c2589a1'} Jun 16 14:49:00.634747 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 could not be found. Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:00.636024 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 could not be found. Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 could not be found. Jun 16 14:49:00.637959 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.642250 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b841c10c-3e5c-48a5-b285-2d8d8deffcd0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Returning 404 to user: Instance b76875a5-11a5-4d7f-9db3-7a731c2589a1 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:00.644305 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b841c10c-3e5c-48a5-b285-2d8d8deffcd0 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1" status: 404 len: 111 microversion: 2.1 time: 0.089526 Jun 16 14:49:00.645632 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1075/2186] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:00 2022] GET /compute/v2.1/servers/b76875a5-11a5-4d7f-9db3-7a731c2589a1 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:00.662248 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-847b7fa8-5013-4135-8d5b-8ad90363b13b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:00.664011 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-847b7fa8-5013-4135-8d5b-8ad90363b13b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 9e471e81-e487-4b6b-a938-d55179b3f318] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:00.677991 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-847b7fa8-5013-4135-8d5b-8ad90363b13b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:00.679444 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-847b7fa8-5013-4135-8d5b-8ad90363b13b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:00.681619 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-847b7fa8-5013-4135-8d5b-8ad90363b13b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:00.682989 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-847b7fa8-5013-4135-8d5b-8ad90363b13b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:00.718430 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-847b7fa8-5013-4135-8d5b-8ad90363b13b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] HTTP exception thrown: Instance 9e471e81-e487-4b6b-a938-d55179b3f318 could not be found. Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-847b7fa8-5013-4135-8d5b-8ad90363b13b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Request method failure captured: Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 HTTP/1.1 Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0HYDWK04k6vDj2W3DKvKiJ3grVSO6yw5Re07xNYsMLFGaw4PP0IsO014SYFozYYzMejGdOVwzaZAGhULCpC5BC_U8Zk-i7zmM_tR7aE8CHBq2lggTmOdHzG41N8cFL94bF10zdnGrevWMKipIdDv40OeFO1i2fgtLdfe8Q9RdAwHTI Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:49:00.724720 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:49:00.726878 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f00d93de6d784ffdbbfbfe050b70e4a8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f00d93de6d784ffdbbfbfe050b70e4a8"}]}] Jun 16 14:49:00.726878 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:00.726878 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:00.726878 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:00.726878 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:00.726878 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:49:00.726878 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:49:00.726878 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 70569cb340194ec0876d91d79cc6fa5f Jun 16 14:49:00.726878 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:00.726878 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:49:00.726878 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 9e471e81-e487-4b6b-a938-d55179b3f318 could not be found. Jun 16 14:49:00.726878 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '9e471e81-e487-4b6b-a938-d55179b3f318'} Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e471e81-e487-4b6b-a938-d55179b3f318 could not be found. Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:00.728064 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e471e81-e487-4b6b-a938-d55179b3f318 could not be found. Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e471e81-e487-4b6b-a938-d55179b3f318 could not be found. Jun 16 14:49:00.730040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:00.732316 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-847b7fa8-5013-4135-8d5b-8ad90363b13b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Returning 404 to user: Instance 9e471e81-e487-4b6b-a938-d55179b3f318 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:00.733576 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-847b7fa8-5013-4135-8d5b-8ad90363b13b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318" status: 404 len: 111 microversion: 2.1 time: 0.080378 Jun 16 14:49:00.741452 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1076/2187] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:00 2022] GET /compute/v2.1/servers/9e471e81-e487-4b6b-a938-d55179b3f318 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:00.757647 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-97722280-f0a8-496c-a06e-ecfdb83e50b7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:00.759024 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-97722280-f0a8-496c-a06e-ecfdb83e50b7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:00.770930 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97722280-f0a8-496c-a06e-ecfdb83e50b7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:00.772119 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97722280-f0a8-496c-a06e-ecfdb83e50b7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:00.773842 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97722280-f0a8-496c-a06e-ecfdb83e50b7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:00.775186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-97722280-f0a8-496c-a06e-ecfdb83e50b7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.023546 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-81f3663c-a84b-460f-a5f2-713f0ae1452a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:01.057472 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-81f3663c-a84b-460f-a5f2-713f0ae1452a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:01.082865 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-81f3663c-a84b-460f-a5f2-713f0ae1452a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:01.089140 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-81f3663c-a84b-460f-a5f2-713f0ae1452a tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1548 microversion: 2.25 time: 0.943886 Jun 16 14:49:01.097076 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1112/2188] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:49:00 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1548 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:49:01.117013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cbfc8be1-d25b-4cc6-9331-6c0e198d2d46 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffae5670>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:01.171528 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-97722280-f0a8-496c-a06e-ecfdb83e50b7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:01.172332 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-cbfc8be1-d25b-4cc6-9331-6c0e198d2d46 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] HTTP exception thrown: Image not found. Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cbfc8be1-d25b-4cc6-9331-6c0e198d2d46 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Request method failure captured: Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 HTTP/1.1 Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0GXWER_qcQbzs1hlNo1uSwhCWxXAxWchb3BhDhK3YnQKpbaj6WIdgdHwudyOZUYPpV_QFWV-3-U8zgzws4nM0r9vaM-bklKcuJyQkQmrllzUDt67ONRUpvj6NQwf9PAx706GCikziLMpRB73GMspW6HuKRqeUlLrCwOL8FFL93uWq0 Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:49:01.174646 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:49:01.175826 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1ac65ee04fbf47608c18c173900ad8f7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1ac65ee04fbf47608c18c173900ad8f7"}]}] Jun 16 14:49:01.175826 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.175826 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:01.175826 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.175826 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:01.175826 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:49:01.175826 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:49:01.175826 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: f91d14d5fb884048a0b12279c62e963d Jun 16 14:49:01.175826 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:01.175826 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:49:01.175826 n-d-836830-4 devstack@n-api.service[125862]: exception: Image not found. Jun 16 14:49:01.175826 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '522b3866-86d3-4f9e-a6f2-2d6ec1f2f257'} Jun 16 14:49:01.175826 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:01.175826 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 to delete Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.176640 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 could not be found. Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:01.177570 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 14:49:01.180133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:49:01.180133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:49:01.180133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.180133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:01.180133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.180133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.180133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:01.180133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:01.180133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:01.180133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:01.180133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:49:01.180133 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.184382 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cbfc8be1-d25b-4cc6-9331-6c0e198d2d46 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Returning 404 to user: Image not found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:01.185762 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cbfc8be1-d25b-4cc6-9331-6c0e198d2d46 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257" status: 404 len: 62 microversion: 2.1 time: 0.086435 Jun 16 14:49:01.188393 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1113/2189] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:01 2022] DELETE /compute/v2.1/images/522b3866-86d3-4f9e-a6f2-2d6ec1f2f257 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:49:01.194913 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6d8071b5-2484-45f6-9280-7c5bc6a078cc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:01.196147 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6d8071b5-2484-45f6-9280-7c5bc6a078cc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:01.198914 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-97722280-f0a8-496c-a06e-ecfdb83e50b7 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1698 microversion: 2.1 time: 0.454260 Jun 16 14:49:01.209806 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1077/2190] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:00 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1698 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:01.220552 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d8071b5-2484-45f6-9280-7c5bc6a078cc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:01.221614 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-27f1f3ce-6a89-41be-a8fd-1bd2136183f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:01.221898 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d8071b5-2484-45f6-9280-7c5bc6a078cc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.224264 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d8071b5-2484-45f6-9280-7c5bc6a078cc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:01.225147 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d8071b5-2484-45f6-9280-7c5bc6a078cc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.226994 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-27f1f3ce-6a89-41be-a8fd-1bd2136183f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:01.257073 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-27f1f3ce-6a89-41be-a8fd-1bd2136183f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:01.257944 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-27f1f3ce-6a89-41be-a8fd-1bd2136183f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.259361 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-27f1f3ce-6a89-41be-a8fd-1bd2136183f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:01.260103 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-27f1f3ce-6a89-41be-a8fd-1bd2136183f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.265970 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6d8071b5-2484-45f6-9280-7c5bc6a078cc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:49:01.349284 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:01.417650 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6d8071b5-2484-45f6-9280-7c5bc6a078cc tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 204 len: 0 microversion: 2.1 time: 0.227593 Jun 16 14:49:01.422659 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1114/2191] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:49:01 2022] DELETE /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:49:01.428494 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3533bf45-0c06-49ab-9bb7-c1d01e54f706 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:01.428803 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3533bf45-0c06-49ab-9bb7-c1d01e54f706 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:01.441218 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3533bf45-0c06-49ab-9bb7-c1d01e54f706 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:01.444630 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3533bf45-0c06-49ab-9bb7-c1d01e54f706 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.445714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3533bf45-0c06-49ab-9bb7-c1d01e54f706 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:01.454291 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3533bf45-0c06-49ab-9bb7-c1d01e54f706 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.544488 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-3533bf45-0c06-49ab-9bb7-c1d01e54f706 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] HTTP exception thrown: Instance 26234dd2-d806-4819-ac5a-651c8dd442ef could not be found. Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3533bf45-0c06-49ab-9bb7-c1d01e54f706 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Request method failure captured: Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef HTTP/1.1 Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0GXWER_qcQbzs1hlNo1uSwhCWxXAxWchb3BhDhK3YnQKpbaj6WIdgdHwudyOZUYPpV_QFWV-3-U8zgzws4nM0r9vaM-bklKcuJyQkQmrllzUDt67ONRUpvj6NQwf9PAx706GCikziLMpRB73GMspW6HuKRqeUlLrCwOL8FFL93uWq0 Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:49:01.552788 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:49:01.555409 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1ac65ee04fbf47608c18c173900ad8f7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1ac65ee04fbf47608c18c173900ad8f7"}]}] Jun 16 14:49:01.555409 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.555409 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:01.555409 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.555409 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:01.555409 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:49:01.555409 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:49:01.555409 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: f91d14d5fb884048a0b12279c62e963d Jun 16 14:49:01.555409 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:01.555409 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:49:01.555409 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 26234dd2-d806-4819-ac5a-651c8dd442ef could not be found. Jun 16 14:49:01.555409 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '26234dd2-d806-4819-ac5a-651c8dd442ef'} Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26234dd2-d806-4819-ac5a-651c8dd442ef could not be found. Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:01.558459 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26234dd2-d806-4819-ac5a-651c8dd442ef could not be found. Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26234dd2-d806-4819-ac5a-651c8dd442ef could not be found. Jun 16 14:49:01.560894 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.568615 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-27f1f3ce-6a89-41be-a8fd-1bd2136183f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:01.569584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3533bf45-0c06-49ab-9bb7-c1d01e54f706 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Returning 404 to user: Instance 26234dd2-d806-4819-ac5a-651c8dd442ef could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:01.572358 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3533bf45-0c06-49ab-9bb7-c1d01e54f706 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 404 len: 111 microversion: 2.1 time: 0.147294 Jun 16 14:49:01.576231 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1115/2192] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:49:01 2022] DELETE /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:01.587131 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-27f1f3ce-6a89-41be-a8fd-1bd2136183f8 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1313 microversion: 2.1 time: 0.384350 Jun 16 14:49:01.588276 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1078/2193] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:01 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:01.590465 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-c79d905a-0ce2-44ef-855c-da2f58641873 req-18a7a87e-82a2-45bd-b539-4dc52023aa93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4855363-724b-4eff-a76e-915e440af995", "name": "network-vif-deleted", "tag": "f4722aca-79de-427f-b18d-882b6697a114"}, {"server_uuid": "534d4bfc-9035-4a24-a3f1-4453fae05354", "name": "network-vif-deleted", "tag": "e2145fcb-39df-44d5-9c1f-2f832c21ec45"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:01.595125 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8123fe21-f421-4e4b-82d0-4b77d72c6d9f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:01.596094 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8123fe21-f421-4e4b-82d0-4b77d72c6d9f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:01.616268 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-c79d905a-0ce2-44ef-855c-da2f58641873 req-18a7a87e-82a2-45bd-b539-4dc52023aa93 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:01.618943 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-c79d905a-0ce2-44ef-855c-da2f58641873 req-18a7a87e-82a2-45bd-b539-4dc52023aa93 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.626919 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8123fe21-f421-4e4b-82d0-4b77d72c6d9f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:01.627617 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8123fe21-f421-4e4b-82d0-4b77d72c6d9f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.628953 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8123fe21-f421-4e4b-82d0-4b77d72c6d9f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:01.629900 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8123fe21-f421-4e4b-82d0-4b77d72c6d9f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.661606 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-c79d905a-0ce2-44ef-855c-da2f58641873 req-18a7a87e-82a2-45bd-b539-4dc52023aa93 service nova] Creating event network-vif-deleted:f4722aca-79de-427f-b18d-882b6697a114 for instance e4855363-724b-4eff-a76e-915e440af995 on n-h1-836830-4 Jun 16 14:49:01.663136 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-c79d905a-0ce2-44ef-855c-da2f58641873 req-18a7a87e-82a2-45bd-b539-4dc52023aa93 service nova] Creating event network-vif-deleted:e2145fcb-39df-44d5-9c1f-2f832c21ec45 for instance 534d4bfc-9035-4a24-a3f1-4453fae05354 on n-h2-836830-4 Jun 16 14:49:01.693620 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-c79d905a-0ce2-44ef-855c-da2f58641873 req-18a7a87e-82a2-45bd-b539-4dc52023aa93 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114213 Jun 16 14:49:01.695052 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1116/2194] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:01.712152 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ea6870ff-abbb-43f3-a89d-17dcf06076f7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:01.713228 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ea6870ff-abbb-43f3-a89d-17dcf06076f7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 26234dd2-d806-4819-ac5a-651c8dd442ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:01.727667 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ea6870ff-abbb-43f3-a89d-17dcf06076f7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:01.728883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ea6870ff-abbb-43f3-a89d-17dcf06076f7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.729939 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ea6870ff-abbb-43f3-a89d-17dcf06076f7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:01.731544 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ea6870ff-abbb-43f3-a89d-17dcf06076f7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.756561 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-ea6870ff-abbb-43f3-a89d-17dcf06076f7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] HTTP exception thrown: Instance 26234dd2-d806-4819-ac5a-651c8dd442ef could not be found. Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ea6870ff-abbb-43f3-a89d-17dcf06076f7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Request method failure captured: Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef HTTP/1.1 Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0GXWER_qcQbzs1hlNo1uSwhCWxXAxWchb3BhDhK3YnQKpbaj6WIdgdHwudyOZUYPpV_QFWV-3-U8zgzws4nM0r9vaM-bklKcuJyQkQmrllzUDt67ONRUpvj6NQwf9PAx706GCikziLMpRB73GMspW6HuKRqeUlLrCwOL8FFL93uWq0 Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:49:01.758362 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:49:01.760877 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1ac65ee04fbf47608c18c173900ad8f7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1ac65ee04fbf47608c18c173900ad8f7"}]}] Jun 16 14:49:01.760877 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.760877 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:01.760877 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.760877 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:01.760877 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:49:01.760877 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:49:01.760877 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: f91d14d5fb884048a0b12279c62e963d Jun 16 14:49:01.760877 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:01.760877 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:49:01.760877 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 26234dd2-d806-4819-ac5a-651c8dd442ef could not be found. Jun 16 14:49:01.760877 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '26234dd2-d806-4819-ac5a-651c8dd442ef'} Jun 16 14:49:01.760877 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26234dd2-d806-4819-ac5a-651c8dd442ef could not be found. Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:01.764568 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26234dd2-d806-4819-ac5a-651c8dd442ef could not be found. Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26234dd2-d806-4819-ac5a-651c8dd442ef could not be found. Jun 16 14:49:01.768277 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.773287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ea6870ff-abbb-43f3-a89d-17dcf06076f7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Returning 404 to user: Instance 26234dd2-d806-4819-ac5a-651c8dd442ef could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:01.773287 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ea6870ff-abbb-43f3-a89d-17dcf06076f7 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef" status: 404 len: 111 microversion: 2.1 time: 0.063484 Jun 16 14:49:01.773287 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1117/2195] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:01 2022] GET /compute/v2.1/servers/26234dd2-d806-4819-ac5a-651c8dd442ef => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:01.776013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-015cf7a3-0064-4980-8c82-acc50b885652 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '.version_select at 0x7fdeffa09e50>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:01.812612 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-015cf7a3-0064-4980-8c82-acc50b885652 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] HTTP exception thrown: Image not found. Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-015cf7a3-0064-4980-8c82-acc50b885652 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Request method failure captured: Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 HTTP/1.1 Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0GXWER_qcQbzs1hlNo1uSwhCWxXAxWchb3BhDhK3YnQKpbaj6WIdgdHwudyOZUYPpV_QFWV-3-U8zgzws4nM0r9vaM-bklKcuJyQkQmrllzUDt67ONRUpvj6NQwf9PAx706GCikziLMpRB73GMspW6HuKRqeUlLrCwOL8FFL93uWq0 Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:49:01.816584 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:49:01.818272 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1ac65ee04fbf47608c18c173900ad8f7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1ac65ee04fbf47608c18c173900ad8f7"}]}] Jun 16 14:49:01.818272 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.818272 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:01.818272 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.818272 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:01.818272 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:49:01.818272 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:49:01.818272 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: f91d14d5fb884048a0b12279c62e963d Jun 16 14:49:01.818272 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:01.818272 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:49:01.818272 n-d-836830-4 devstack@n-api.service[125862]: exception: Image not found. Jun 16 14:49:01.818272 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '6b1a41dc-8998-4c33-96e4-973f23f95b16'} Jun 16 14:49:01.818272 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:01.818272 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6b1a41dc-8998-4c33-96e4-973f23f95b16 to delete Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.819226 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6b1a41dc-8998-4c33-96e4-973f23f95b16 could not be found. Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:01.820239 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 14:49:01.822208 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:49:01.822208 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:49:01.822208 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.822208 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:01.822208 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.822208 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.822208 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:01.822208 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:01.822208 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:01.822208 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:01.822208 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:49:01.822208 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.824516 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-015cf7a3-0064-4980-8c82-acc50b885652 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Returning 404 to user: Image not found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:01.826078 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-015cf7a3-0064-4980-8c82-acc50b885652 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16" status: 404 len: 62 microversion: 2.1 time: 0.056711 Jun 16 14:49:01.836861 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1118/2196] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:01 2022] DELETE /compute/v2.1/images/6b1a41dc-8998-4c33-96e4-973f23f95b16 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:49:01.851779 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-07540d2c-5785-4c49-928d-ab82488db9a9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:01.853188 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-07540d2c-5785-4c49-928d-ab82488db9a9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 044b8b3a-db26-450b-b770-6134060ded1c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:01.874134 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07540d2c-5785-4c49-928d-ab82488db9a9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:01.874638 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07540d2c-5785-4c49-928d-ab82488db9a9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.877721 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07540d2c-5785-4c49-928d-ab82488db9a9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:01.878217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07540d2c-5785-4c49-928d-ab82488db9a9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.911147 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-07540d2c-5785-4c49-928d-ab82488db9a9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] HTTP exception thrown: Instance 044b8b3a-db26-450b-b770-6134060ded1c could not be found. Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-07540d2c-5785-4c49-928d-ab82488db9a9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Request method failure captured: Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c HTTP/1.1 Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0GXWER_qcQbzs1hlNo1uSwhCWxXAxWchb3BhDhK3YnQKpbaj6WIdgdHwudyOZUYPpV_QFWV-3-U8zgzws4nM0r9vaM-bklKcuJyQkQmrllzUDt67ONRUpvj6NQwf9PAx706GCikziLMpRB73GMspW6HuKRqeUlLrCwOL8FFL93uWq0 Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:49:01.912762 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:49:01.915200 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1ac65ee04fbf47608c18c173900ad8f7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1ac65ee04fbf47608c18c173900ad8f7"}]}] Jun 16 14:49:01.915200 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.915200 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:01.915200 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.915200 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:01.915200 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:49:01.915200 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:49:01.915200 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: f91d14d5fb884048a0b12279c62e963d Jun 16 14:49:01.915200 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:01.915200 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:49:01.915200 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 044b8b3a-db26-450b-b770-6134060ded1c could not be found. Jun 16 14:49:01.915200 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '044b8b3a-db26-450b-b770-6134060ded1c'} Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 044b8b3a-db26-450b-b770-6134060ded1c could not be found. Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:01.916579 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 044b8b3a-db26-450b-b770-6134060ded1c could not be found. Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 044b8b3a-db26-450b-b770-6134060ded1c could not be found. Jun 16 14:49:01.919394 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:01.921863 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-07540d2c-5785-4c49-928d-ab82488db9a9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Returning 404 to user: Instance 044b8b3a-db26-450b-b770-6134060ded1c could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:01.921863 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-07540d2c-5785-4c49-928d-ab82488db9a9 tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "DELETE /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c" status: 404 len: 111 microversion: 2.1 time: 0.075914 Jun 16 14:49:01.921863 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1119/2197] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:49:01 2022] DELETE /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:01.936668 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fd4cf397-328c-4033-a78a-403a7190d37a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:01.937512 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fd4cf397-328c-4033-a78a-403a7190d37a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] [instance: 044b8b3a-db26-450b-b770-6134060ded1c] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:01.953246 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd4cf397-328c-4033-a78a-403a7190d37a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:01.953246 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd4cf397-328c-4033-a78a-403a7190d37a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.953622 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd4cf397-328c-4033-a78a-403a7190d37a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:01.953818 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd4cf397-328c-4033-a78a-403a7190d37a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:01.961404 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8123fe21-f421-4e4b-82d0-4b77d72c6d9f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:01.970025 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8123fe21-f421-4e4b-82d0-4b77d72c6d9f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1473 microversion: 2.1 time: 0.380014 Jun 16 14:49:01.981060 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1079/2198] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:01 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1473 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:01.995093 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-fd4cf397-328c-4033-a78a-403a7190d37a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] HTTP exception thrown: Instance 044b8b3a-db26-450b-b770-6134060ded1c could not be found. Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fd4cf397-328c-4033-a78a-403a7190d37a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Request method failure captured: Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c HTTP/1.1 Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0GXWER_qcQbzs1hlNo1uSwhCWxXAxWchb3BhDhK3YnQKpbaj6WIdgdHwudyOZUYPpV_QFWV-3-U8zgzws4nM0r9vaM-bklKcuJyQkQmrllzUDt67ONRUpvj6NQwf9PAx706GCikziLMpRB73GMspW6HuKRqeUlLrCwOL8FFL93uWq0 Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:49:01.998550 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:49:01.999700 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1ac65ee04fbf47608c18c173900ad8f7", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1ac65ee04fbf47608c18c173900ad8f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1ac65ee04fbf47608c18c173900ad8f7"}]}] Jun 16 14:49:01.999700 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.999700 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 1ac65ee04fbf47608c18c173900ad8f7 Jun 16 14:49:01.999700 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesTestJSON-1889241253 Jun 16 14:49:01.999700 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:01.999700 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:49:01.999700 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:49:01.999700 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: f91d14d5fb884048a0b12279c62e963d Jun 16 14:49:01.999700 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesTestJSON-1889241253-project Jun 16 14:49:01.999700 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:49:01.999700 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 044b8b3a-db26-450b-b770-6134060ded1c could not be found. Jun 16 14:49:01.999700 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '044b8b3a-db26-450b-b770-6134060ded1c'} Jun 16 14:49:01.999700 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 044b8b3a-db26-450b-b770-6134060ded1c could not be found. Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:02.000390 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 044b8b3a-db26-450b-b770-6134060ded1c could not be found. Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 044b8b3a-db26-450b-b770-6134060ded1c could not be found. Jun 16 14:49:02.001341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:02.004071 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fd4cf397-328c-4033-a78a-403a7190d37a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] Returning 404 to user: Instance 044b8b3a-db26-450b-b770-6134060ded1c could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:02.005168 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fd4cf397-328c-4033-a78a-403a7190d37a tempest-ImagesTestJSON-1889241253 tempest-ImagesTestJSON-1889241253-project] 10.222.0.57 "GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c" status: 404 len: 111 microversion: 2.1 time: 0.082446 Jun 16 14:49:02.010814 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1120/2199] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:01 2022] GET /compute/v2.1/servers/044b8b3a-db26-450b-b770-6134060ded1c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:02.131180 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-13902a1f-6559-488c-97ea-3e10de737d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:02.132878 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-13902a1f-6559-488c-97ea-3e10de737d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:02.145515 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13902a1f-6559-488c-97ea-3e10de737d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:02.146878 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13902a1f-6559-488c-97ea-3e10de737d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:02.148588 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13902a1f-6559-488c-97ea-3e10de737d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:02.150101 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-13902a1f-6559-488c-97ea-3e10de737d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:02.232510 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-21ddc450-afdb-4227-8489-8d72a6e9c94e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:02.239852 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-21ddc450-afdb-4227-8489-8d72a6e9c94e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:02.256424 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-21ddc450-afdb-4227-8489-8d72a6e9c94e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:02.257213 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-21ddc450-afdb-4227-8489-8d72a6e9c94e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:02.258302 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-21ddc450-afdb-4227-8489-8d72a6e9c94e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:02.259072 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-21ddc450-afdb-4227-8489-8d72a6e9c94e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:02.695609 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-13902a1f-6559-488c-97ea-3e10de737d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:02.722458 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-13902a1f-6559-488c-97ea-3e10de737d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:02.724788 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-13902a1f-6559-488c-97ea-3e10de737d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:02.743942 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-13902a1f-6559-488c-97ea-3e10de737d8e tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1548 microversion: 2.25 time: 0.619941 Jun 16 14:49:02.760679 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1080/2200] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:49:02 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1548 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:49:02.770947 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-14600881-d42e-40d4-b321-c6f381e608ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:02.774642 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-14600881-d42e-40d4-b321-c6f381e608ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:02.790714 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14600881-d42e-40d4-b321-c6f381e608ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:02.791176 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14600881-d42e-40d4-b321-c6f381e608ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:02.791987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14600881-d42e-40d4-b321-c6f381e608ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:02.792461 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14600881-d42e-40d4-b321-c6f381e608ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:02.999502 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-21ddc450-afdb-4227-8489-8d72a6e9c94e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:03.019371 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-21ddc450-afdb-4227-8489-8d72a6e9c94e tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1698 microversion: 2.1 time: 0.797006 Jun 16 14:49:03.020709 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1121/2201] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:02 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1698 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:03.028055 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-22cc6154-f7e8-4b48-93fb-dba32779766b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:03.029385 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-22cc6154-f7e8-4b48-93fb-dba32779766b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:03.040548 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-22cc6154-f7e8-4b48-93fb-dba32779766b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:03.042260 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-22cc6154-f7e8-4b48-93fb-dba32779766b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:03.044195 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-22cc6154-f7e8-4b48-93fb-dba32779766b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:03.044998 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-22cc6154-f7e8-4b48-93fb-dba32779766b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:03.714913 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-14600881-d42e-40d4-b321-c6f381e608ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:03.725666 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-14600881-d42e-40d4-b321-c6f381e608ae tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1313 microversion: 2.1 time: 0.960195 Jun 16 14:49:03.726842 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1081/2202] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:02 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1313 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:03.766650 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a5fb71ef-ba52-4b84-8aeb-a1d44099043d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:03.767333 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a5fb71ef-ba52-4b84-8aeb-a1d44099043d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:03.776738 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5fb71ef-ba52-4b84-8aeb-a1d44099043d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:03.777629 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5fb71ef-ba52-4b84-8aeb-a1d44099043d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:03.778927 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5fb71ef-ba52-4b84-8aeb-a1d44099043d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:03.779568 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5fb71ef-ba52-4b84-8aeb-a1d44099043d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:04.157769 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-22cc6154-f7e8-4b48-93fb-dba32779766b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:04.164061 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a5fb71ef-ba52-4b84-8aeb-a1d44099043d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:04.193214 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a5fb71ef-ba52-4b84-8aeb-a1d44099043d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:04.204026 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a5fb71ef-ba52-4b84-8aeb-a1d44099043d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:04.209827 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a5fb71ef-ba52-4b84-8aeb-a1d44099043d tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1548 microversion: 2.25 time: 0.447957 Jun 16 14:49:04.211077 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1082/2203] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:49:03 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1548 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:49:04.220219 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-98a8800b-2687-4540-b666-6f73caab8cba tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:04.221684 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-98a8800b-2687-4540-b666-6f73caab8cba tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:04.224147 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-22cc6154-f7e8-4b48-93fb-dba32779766b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1473 microversion: 2.1 time: 1.200063 Jun 16 14:49:04.228742 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1122/2204] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:03 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1473 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:04.241146 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-98a8800b-2687-4540-b666-6f73caab8cba tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:04.241843 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-98a8800b-2687-4540-b666-6f73caab8cba tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:04.243249 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-98a8800b-2687-4540-b666-6f73caab8cba tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:04.244023 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-98a8800b-2687-4540-b666-6f73caab8cba tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:04.613078 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-98a8800b-2687-4540-b666-6f73caab8cba tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:04.623354 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-98a8800b-2687-4540-b666-6f73caab8cba tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1698 microversion: 2.1 time: 0.410135 Jun 16 14:49:04.624773 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1083/2205] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:04 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1698 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:04.756687 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5d8f7e85-cd54-4da8-bb69-635bb10acb1f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:04.757887 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5d8f7e85-cd54-4da8-bb69-635bb10acb1f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:04.789195 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d8f7e85-cd54-4da8-bb69-635bb10acb1f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:04.798110 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d8f7e85-cd54-4da8-bb69-635bb10acb1f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:04.804552 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d8f7e85-cd54-4da8-bb69-635bb10acb1f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:04.805242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5d8f7e85-cd54-4da8-bb69-635bb10acb1f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:05.242230 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a52df292-b398-4e14-935b-ff37f65c7015 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:05.243117 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a52df292-b398-4e14-935b-ff37f65c7015 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:05.253287 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a52df292-b398-4e14-935b-ff37f65c7015 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:05.254036 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a52df292-b398-4e14-935b-ff37f65c7015 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:05.255886 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a52df292-b398-4e14-935b-ff37f65c7015 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:05.256685 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a52df292-b398-4e14-935b-ff37f65c7015 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:05.486538 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a52df292-b398-4e14-935b-ff37f65c7015 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:05.504157 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a52df292-b398-4e14-935b-ff37f65c7015 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:05.506166 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a52df292-b398-4e14-935b-ff37f65c7015 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:05.512615 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a52df292-b398-4e14-935b-ff37f65c7015 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 200 len: 1506 microversion: 2.25 time: 0.286199 Jun 16 14:49:05.514776 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1084/2206] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:49:05 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:49:05.526129 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0191e132-37ca-4e24-88a2-7700410f99b0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:05.534956 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0191e132-37ca-4e24-88a2-7700410f99b0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:05.550344 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0191e132-37ca-4e24-88a2-7700410f99b0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:05.553331 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0191e132-37ca-4e24-88a2-7700410f99b0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:05.560278 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0191e132-37ca-4e24-88a2-7700410f99b0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:05.560918 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0191e132-37ca-4e24-88a2-7700410f99b0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:06.184494 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0191e132-37ca-4e24-88a2-7700410f99b0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:06.204494 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0191e132-37ca-4e24-88a2-7700410f99b0 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1473 microversion: 2.1 time: 0.685239 Jun 16 14:49:06.220022 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1085/2207] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:05 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1473 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:06.247254 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5d8f7e85-cd54-4da8-bb69-635bb10acb1f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:06.254330 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-eff5398c-22a1-41ca-bae5-fd6755db248d tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:06.256798 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-eff5398c-22a1-41ca-bae5-fd6755db248d tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:06.299886 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eff5398c-22a1-41ca-bae5-fd6755db248d tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:06.300416 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eff5398c-22a1-41ca-bae5-fd6755db248d tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:06.301287 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eff5398c-22a1-41ca-bae5-fd6755db248d tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:06.301735 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eff5398c-22a1-41ca-bae5-fd6755db248d tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:06.304842 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5d8f7e85-cd54-4da8-bb69-635bb10acb1f tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1463 microversion: 2.1 time: 1.555068 Jun 16 14:49:06.307921 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1123/2208] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:04 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1463 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:06.329031 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-a1d6b4c5-83a4-4124-9650-e4e557fb26fa req-0f86f914-4ef8-4ba3-9a69-27b5b75c0984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7db7635-8f84-4337-b9ba-d84b8c36e787", "name": "network-vif-deleted", "tag": "b7334014-51f5-4bc4-84ad-f055776c3b7e"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:06.375333 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-a1d6b4c5-83a4-4124-9650-e4e557fb26fa req-0f86f914-4ef8-4ba3-9a69-27b5b75c0984 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:06.377171 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-a1d6b4c5-83a4-4124-9650-e4e557fb26fa req-0f86f914-4ef8-4ba3-9a69-27b5b75c0984 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:06.422615 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-a1d6b4c5-83a4-4124-9650-e4e557fb26fa req-0f86f914-4ef8-4ba3-9a69-27b5b75c0984 service nova] Creating event network-vif-deleted:b7334014-51f5-4bc4-84ad-f055776c3b7e for instance b7db7635-8f84-4337-b9ba-d84b8c36e787 on n-h1-836830-4 Jun 16 14:49:06.448262 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-a1d6b4c5-83a4-4124-9650-e4e557fb26fa req-0f86f914-4ef8-4ba3-9a69-27b5b75c0984 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133332 Jun 16 14:49:06.460857 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1124/2209] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:06.674137 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:06.675449 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-eff5398c-22a1-41ca-bae5-fd6755db248d tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:06.718220 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-eff5398c-22a1-41ca-bae5-fd6755db248d tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1698 microversion: 2.1 time: 0.478343 Jun 16 14:49:06.723020 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1086/2210] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:06 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1698 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:06.756830 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d09c6eaf-80ce-45ba-ad39-385197e58ff6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:06.759786 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d09c6eaf-80ce-45ba-ad39-385197e58ff6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: b7db7635-8f84-4337-b9ba-d84b8c36e787] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:06.767731 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d09c6eaf-80ce-45ba-ad39-385197e58ff6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:06.768336 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d09c6eaf-80ce-45ba-ad39-385197e58ff6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:06.769228 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d09c6eaf-80ce-45ba-ad39-385197e58ff6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:06.769772 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d09c6eaf-80ce-45ba-ad39-385197e58ff6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:06.791399 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-d09c6eaf-80ce-45ba-ad39-385197e58ff6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] HTTP exception thrown: Instance b7db7635-8f84-4337-b9ba-d84b8c36e787 could not be found. Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d09c6eaf-80ce-45ba-ad39-385197e58ff6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Request method failure captured: Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 HTTP/1.1 Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0B-okSquj7GELrJS9sbKyWDvmtrmgWBNPvmmVc8YS2EMY5GO6BwHHqKgKslswttQRM-ofZOzOefvWdL-wuYwd_JFkXSTAPHrPLKMx86sspLrTCbbDUAFwj6hIH2GTU23RKnbPK7FBh07yhNRgoGUpI-6VhkqUuOv3_jRJjOPJzFox4 Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: X-Openstack-Nova-Api-Version: 2.25 Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: c04830ebf498422d9dddfbc009697728 Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-706483184 Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:49:06.794206 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:49:06.795558 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c04830ebf498422d9dddfbc009697728", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c04830ebf498422d9dddfbc009697728"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c04830ebf498422d9dddfbc009697728"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c04830ebf498422d9dddfbc009697728"}]}] Jun 16 14:49:06.795558 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-706483184 Jun 16 14:49:06.795558 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: c04830ebf498422d9dddfbc009697728 Jun 16 14:49:06.795558 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-706483184 Jun 16 14:49:06.795558 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-LiveAutoBlockMigrationV225Test-706483184-project Jun 16 14:49:06.795558 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:49:06.795558 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:49:06.795558 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: ab3aa4e887694a0e9a42bf6db6b01555 Jun 16 14:49:06.795558 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-706483184-project Jun 16 14:49:06.795558 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:49:06.795558 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance b7db7635-8f84-4337-b9ba-d84b8c36e787 could not be found. Jun 16 14:49:06.795558 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'b7db7635-8f84-4337-b9ba-d84b8c36e787'} Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7db7635-8f84-4337-b9ba-d84b8c36e787 could not be found. Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:06.796161 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7db7635-8f84-4337-b9ba-d84b8c36e787 could not be found. Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7db7635-8f84-4337-b9ba-d84b8c36e787 could not be found. Jun 16 14:49:06.797129 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:06.801119 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d09c6eaf-80ce-45ba-ad39-385197e58ff6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Returning 404 to user: Instance b7db7635-8f84-4337-b9ba-d84b8c36e787 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:06.803098 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d09c6eaf-80ce-45ba-ad39-385197e58ff6 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787" status: 404 len: 111 microversion: 2.25 time: 0.078430 Jun 16 14:49:06.804932 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1087/2211] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:49:06 2022] GET /compute/v2.1/servers/b7db7635-8f84-4337-b9ba-d84b8c36e787 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:49:06.817919 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6fd03b77-ec7c-4d20-88ee-468922ae6609 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:06.818884 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6fd03b77-ec7c-4d20-88ee-468922ae6609 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:06.828201 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6fd03b77-ec7c-4d20-88ee-468922ae6609 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:06.829031 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6fd03b77-ec7c-4d20-88ee-468922ae6609 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:06.830067 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6fd03b77-ec7c-4d20-88ee-468922ae6609 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:06.830893 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6fd03b77-ec7c-4d20-88ee-468922ae6609 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:06.864927 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6fd03b77-ec7c-4d20-88ee-468922ae6609 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:49:06.949666 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-28a34700-0ebc-4286-a557-8a8ef00a93b0 tempest-TenantUsagesTestJSON-917765599 tempest-TenantUsagesTestJSON-917765599-project-admin] Calling method '.version_select at 0x7fdf0c0f7af0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:06.963110 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-28a34700-0ebc-4286-a557-8a8ef00a93b0 tempest-TenantUsagesTestJSON-917765599 tempest-TenantUsagesTestJSON-917765599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:06.963970 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-28a34700-0ebc-4286-a557-8a8ef00a93b0 tempest-TenantUsagesTestJSON-917765599 tempest-TenantUsagesTestJSON-917765599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:06.989101 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-28a34700-0ebc-4286-a557-8a8ef00a93b0 tempest-TenantUsagesTestJSON-917765599 tempest-TenantUsagesTestJSON-917765599-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:06.989932 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-28a34700-0ebc-4286-a557-8a8ef00a93b0 tempest-TenantUsagesTestJSON-917765599 tempest-TenantUsagesTestJSON-917765599-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:07.055288 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-28a34700-0ebc-4286-a557-8a8ef00a93b0 tempest-TenantUsagesTestJSON-917765599 tempest-TenantUsagesTestJSON-917765599-project-admin] 10.222.0.57 "GET /compute/v2.1/os-simple-tenant-usage/ca9aab10bc6d453099e97f64e7349466?start=2022-06-15T14%3A49%3A06.328846&end=2022-06-17T14%3A49%3A06.328846" status: 200 len: 694 microversion: 2.1 time: 0.588033 Jun 16 14:49:07.056346 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1125/2212] 10.222.0.57 () {58 vars in 1411 bytes} [Thu Jun 16 14:49:06 2022] GET /compute/v2.1/os-simple-tenant-usage/ca9aab10bc6d453099e97f64e7349466?start=2022-06-15T14%3A49%3A06.328846&end=2022-06-17T14%3A49%3A06.328846 => generated 694 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:07.064047 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-f2f6c2b7-65f6-4cfe-b908-1cf6969f90b1 req-7fad9b0a-6d26-49f9-9411-6b66ca253fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de", "name": "network-vif-deleted", "tag": "4f2964ee-bda2-45df-955e-ebf34a3e9f77"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:07.093734 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-f2f6c2b7-65f6-4cfe-b908-1cf6969f90b1 req-7fad9b0a-6d26-49f9-9411-6b66ca253fb7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:07.094757 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-f2f6c2b7-65f6-4cfe-b908-1cf6969f90b1 req-7fad9b0a-6d26-49f9-9411-6b66ca253fb7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:07.114894 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-f2f6c2b7-65f6-4cfe-b908-1cf6969f90b1 req-7fad9b0a-6d26-49f9-9411-6b66ca253fb7 service nova] Creating event network-vif-deleted:4f2964ee-bda2-45df-955e-ebf34a3e9f77 for instance 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de on n-h1-836830-4 Jun 16 14:49:07.122576 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-f2f6c2b7-65f6-4cfe-b908-1cf6969f90b1 req-7fad9b0a-6d26-49f9-9411-6b66ca253fb7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064537 Jun 16 14:49:07.123551 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1126/2213] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:07.130812 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fa1d9c39-ad31-4250-8c7f-fe02696c7d6c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '.version_select at 0x7fdeffafb670>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:07.165511 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fa1d9c39-ad31-4250-8c7f-fe02696c7d6c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:07.166416 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fa1d9c39-ad31-4250-8c7f-fe02696c7d6c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:07.168715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=4 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:07.177215 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6fd03b77-ec7c-4d20-88ee-468922ae6609 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 204 len: 0 microversion: 2.25 time: 0.366162 Jun 16 14:49:07.181185 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1088/2214] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 16 14:49:06 2022] DELETE /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 14:49:07.181733 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fa1d9c39-ad31-4250-8c7f-fe02696c7d6c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:07.182599 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fa1d9c39-ad31-4250-8c7f-fe02696c7d6c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:07.187836 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2b967a9e-4735-4659-8778-61dfc8dbe66c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:07.188673 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2b967a9e-4735-4659-8778-61dfc8dbe66c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:07.208464 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2b967a9e-4735-4659-8778-61dfc8dbe66c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:07.209132 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2b967a9e-4735-4659-8778-61dfc8dbe66c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:07.209957 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2b967a9e-4735-4659-8778-61dfc8dbe66c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:07.210413 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2b967a9e-4735-4659-8778-61dfc8dbe66c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:07.228411 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fa1d9c39-ad31-4250-8c7f-fe02696c7d6c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/os-simple-tenant-usage/ca9aab10bc6d453099e97f64e7349466?start=2022-06-15T14%3A49%3A06.328846&end=2022-06-17T14%3A49%3A06.328846" status: 200 len: 694 microversion: 2.1 time: 0.103352 Jun 16 14:49:07.232824 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1127/2215] 10.222.0.57 () {58 vars in 1411 bytes} [Thu Jun 16 14:49:07 2022] GET /compute/v2.1/os-simple-tenant-usage/ca9aab10bc6d453099e97f64e7349466?start=2022-06-15T14%3A49%3A06.328846&end=2022-06-17T14%3A49%3A06.328846 => generated 694 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:07.250711 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e07a340e-3cfe-459c-a90c-e5160c0346f7 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:07.252045 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e07a340e-3cfe-459c-a90c-e5160c0346f7 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:07.281533 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e07a340e-3cfe-459c-a90c-e5160c0346f7 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:07.290681 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e07a340e-3cfe-459c-a90c-e5160c0346f7 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:07.292452 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e07a340e-3cfe-459c-a90c-e5160c0346f7 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:07.294782 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e07a340e-3cfe-459c-a90c-e5160c0346f7 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:07.759620 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e07a340e-3cfe-459c-a90c-e5160c0346f7 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:07.787816 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e07a340e-3cfe-459c-a90c-e5160c0346f7 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 200 len: 1302 microversion: 2.1 time: 0.552212 Jun 16 14:49:07.799005 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1128/2216] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:07 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 1302 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:07.812048 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-05327e68-546b-47cc-bb95-dfe9b8dbc0e9 tempest-TenantUsagesTestJSON-917765599 tempest-TenantUsagesTestJSON-917765599-project-admin] Calling method '.version_select at 0x7fdeffb0f4c0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:07.853771 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-05327e68-546b-47cc-bb95-dfe9b8dbc0e9 tempest-TenantUsagesTestJSON-917765599 tempest-TenantUsagesTestJSON-917765599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:07.854566 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-05327e68-546b-47cc-bb95-dfe9b8dbc0e9 tempest-TenantUsagesTestJSON-917765599 tempest-TenantUsagesTestJSON-917765599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:07.932180 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-05327e68-546b-47cc-bb95-dfe9b8dbc0e9 tempest-TenantUsagesTestJSON-917765599 tempest-TenantUsagesTestJSON-917765599-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:07.934038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-05327e68-546b-47cc-bb95-dfe9b8dbc0e9 tempest-TenantUsagesTestJSON-917765599 tempest-TenantUsagesTestJSON-917765599-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:08.383380 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:08.429964 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-05327e68-546b-47cc-bb95-dfe9b8dbc0e9 tempest-TenantUsagesTestJSON-917765599 tempest-TenantUsagesTestJSON-917765599-project-admin] 10.222.0.57 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-15T14%3A49%3A06.328846&end=2022-06-17T14%3A49%3A06.328846&detailed=1" status: 200 len: 25030 microversion: 2.1 time: 0.629323 Jun 16 14:49:08.442497 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1129/2217] 10.222.0.57 () {58 vars in 1334 bytes} [Thu Jun 16 14:49:07 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-15T14%3A49%3A06.328846&end=2022-06-17T14%3A49%3A06.328846&detailed=1 => generated 25030 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:49:08.458544 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-77838399-a4f8-4329-8bd3-be82091360b3 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:08.463283 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-77838399-a4f8-4329-8bd3-be82091360b3 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:08.493057 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-77838399-a4f8-4329-8bd3-be82091360b3 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:08.494213 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-77838399-a4f8-4329-8bd3-be82091360b3 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:08.495647 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-77838399-a4f8-4329-8bd3-be82091360b3 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:08.496634 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-77838399-a4f8-4329-8bd3-be82091360b3 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:08.517827 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:08.725159 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-77838399-a4f8-4329-8bd3-be82091360b3 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:08.747746 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-77838399-a4f8-4329-8bd3-be82091360b3 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1632 microversion: 2.1 time: 0.296886 Jun 16 14:49:08.765777 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1130/2218] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:08 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1632 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:08.780412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-be11a640-5066-4a0d-8292-5296b7ce8a80 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:08.781101 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-be11a640-5066-4a0d-8292-5296b7ce8a80 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:08.806280 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be11a640-5066-4a0d-8292-5296b7ce8a80 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:08.812542 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be11a640-5066-4a0d-8292-5296b7ce8a80 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:08.815630 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be11a640-5066-4a0d-8292-5296b7ce8a80 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:08.820037 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be11a640-5066-4a0d-8292-5296b7ce8a80 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:08.890436 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-be11a640-5066-4a0d-8292-5296b7ce8a80 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:49:09.151870 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-be11a640-5066-4a0d-8292-5296b7ce8a80 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "DELETE /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 204 len: 0 microversion: 2.1 time: 0.381120 Jun 16 14:49:09.179530 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1131/2219] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:49:08 2022] DELETE /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:49:09.196216 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-02322f4d-95dc-495d-8270-793cec2775b5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:09.198686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-02322f4d-95dc-495d-8270-793cec2775b5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:09.213880 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02322f4d-95dc-495d-8270-793cec2775b5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:09.215040 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02322f4d-95dc-495d-8270-793cec2775b5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:09.216618 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02322f4d-95dc-495d-8270-793cec2775b5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:09.217702 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-02322f4d-95dc-495d-8270-793cec2775b5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:09.256898 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-02322f4d-95dc-495d-8270-793cec2775b5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] HTTP exception thrown: Instance 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de could not be found. Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-02322f4d-95dc-495d-8270-793cec2775b5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Request method failure captured: Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de HTTP/1.1 Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0HYDWK04k6vDj2W3DKvKiJ3grVSO6yw5Re07xNYsMLFGaw4PP0IsO014SYFozYYzMejGdOVwzaZAGhULCpC5BC_U8Zk-i7zmM_tR7aE8CHBq2lggTmOdHzG41N8cFL94bF10zdnGrevWMKipIdDv40OeFO1i2fgtLdfe8Q9RdAwHTI Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:49:09.274556 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:49:09.276982 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f00d93de6d784ffdbbfbfe050b70e4a8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f00d93de6d784ffdbbfbfe050b70e4a8"}]}] Jun 16 14:49:09.276982 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:09.276982 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:09.276982 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:09.276982 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:09.276982 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:49:09.276982 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:49:09.276982 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 70569cb340194ec0876d91d79cc6fa5f Jun 16 14:49:09.276982 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:09.276982 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:49:09.276982 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de could not be found. Jun 16 14:49:09.276982 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de'} Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de could not be found. Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:09.278786 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de could not be found. Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de could not be found. Jun 16 14:49:09.285701 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:09.291075 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-02322f4d-95dc-495d-8270-793cec2775b5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Returning 404 to user: Instance 1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:09.291849 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-02322f4d-95dc-495d-8270-793cec2775b5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de" status: 404 len: 111 microversion: 2.1 time: 0.110168 Jun 16 14:49:09.292717 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1132/2220] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:09 2022] GET /compute/v2.1/servers/1d1fa2c9-a73d-4b15-ab5c-20b8bc3586de => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:09.294846 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2b967a9e-4735-4659-8778-61dfc8dbe66c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:09.301378 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b711cdab-d686-475d-bf25-98d9b97a6c1d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:09.307962 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b711cdab-d686-475d-bf25-98d9b97a6c1d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:09.327975 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2b967a9e-4735-4659-8778-61dfc8dbe66c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:09.328366 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b711cdab-d686-475d-bf25-98d9b97a6c1d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:09.328532 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b711cdab-d686-475d-bf25-98d9b97a6c1d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:09.329577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b711cdab-d686-475d-bf25-98d9b97a6c1d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:09.330292 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b711cdab-d686-475d-bf25-98d9b97a6c1d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:09.338971 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2b967a9e-4735-4659-8778-61dfc8dbe66c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:09.344276 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2b967a9e-4735-4659-8778-61dfc8dbe66c tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1562 microversion: 2.25 time: 2.161297 Jun 16 14:49:09.370107 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1089/2221] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:49:07 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1562 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:49:09.384622 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9b656537-f40a-42d9-b89c-3a7860fa1845 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:09.387417 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9b656537-f40a-42d9-b89c-3a7860fa1845 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:09.398775 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9b656537-f40a-42d9-b89c-3a7860fa1845 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:09.399499 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9b656537-f40a-42d9-b89c-3a7860fa1845 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:09.400945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9b656537-f40a-42d9-b89c-3a7860fa1845 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:09.401587 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9b656537-f40a-42d9-b89c-3a7860fa1845 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:09.435039 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:09.441921 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9b656537-f40a-42d9-b89c-3a7860fa1845 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:49:09.603505 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9b656537-f40a-42d9-b89c-3a7860fa1845 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 204 len: 0 microversion: 2.1 time: 0.229629 Jun 16 14:49:09.605256 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1090/2222] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:49:09 2022] DELETE /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:49:09.627402 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-391f239b-bdd4-4df5-b9b2-33583beb7693 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:09.629802 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-391f239b-bdd4-4df5-b9b2-33583beb7693 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:09.655345 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-391f239b-bdd4-4df5-b9b2-33583beb7693 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:09.656121 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-391f239b-bdd4-4df5-b9b2-33583beb7693 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:09.661263 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-391f239b-bdd4-4df5-b9b2-33583beb7693 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:09.662115 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-391f239b-bdd4-4df5-b9b2-33583beb7693 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:10.504512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-391f239b-bdd4-4df5-b9b2-33583beb7693 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:10.523657 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-391f239b-bdd4-4df5-b9b2-33583beb7693 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1472 microversion: 2.1 time: 0.911551 Jun 16 14:49:10.524950 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1091/2223] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:09 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1472 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:10.531946 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1d1c32b0-cf4d-4434-ac20-7abe9ef7d90b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:10.536463 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1d1c32b0-cf4d-4434-ac20-7abe9ef7d90b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:10.554632 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1d1c32b0-cf4d-4434-ac20-7abe9ef7d90b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:10.555400 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1d1c32b0-cf4d-4434-ac20-7abe9ef7d90b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:10.556403 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1d1c32b0-cf4d-4434-ac20-7abe9ef7d90b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:10.557044 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1d1c32b0-cf4d-4434-ac20-7abe9ef7d90b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:10.697568 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1d1c32b0-cf4d-4434-ac20-7abe9ef7d90b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:10.712175 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1d1c32b0-cf4d-4434-ac20-7abe9ef7d90b tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1632 microversion: 2.1 time: 0.185706 Jun 16 14:49:10.713534 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1092/2224] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:10 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1632 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:10.717771 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b711cdab-d686-475d-bf25-98d9b97a6c1d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:10.727510 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ba90c733-a1e6-4922-b0de-2337e6aa9469 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:10.728218 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ba90c733-a1e6-4922-b0de-2337e6aa9469 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:10.729792 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b711cdab-d686-475d-bf25-98d9b97a6c1d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1469 microversion: 2.1 time: 1.432345 Jun 16 14:49:10.735942 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1133/2225] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:09 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1469 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:10.758142 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ba90c733-a1e6-4922-b0de-2337e6aa9469 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:10.764486 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ba90c733-a1e6-4922-b0de-2337e6aa9469 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:10.765914 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ba90c733-a1e6-4922-b0de-2337e6aa9469 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:10.766791 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ba90c733-a1e6-4922-b0de-2337e6aa9469 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:10.846117 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-790688568", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "63cc44ba-8560-4c05-a818-c3b2c9e1ceda"}]}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:10.862292 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ba90c733-a1e6-4922-b0de-2337e6aa9469 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:10.862803 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ba90c733-a1e6-4922-b0de-2337e6aa9469 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:10.863268 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-ba90c733-a1e6-4922-b0de-2337e6aa9469 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lazy-loading 'fault' on Instance uuid 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:49:10.988346 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] validate_networks() for [('63cc44ba-8560-4c05-a818-c3b2c9e1ceda', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:49:11.051648 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ba90c733-a1e6-4922-b0de-2337e6aa9469 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:11.091386 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ba90c733-a1e6-4922-b0de-2337e6aa9469 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:11.096462 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ba90c733-a1e6-4922-b0de-2337e6aa9469 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab3aa4e887694a0e9a42bf6db6b01555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04830ebf498422d9dddfbc009697728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:11.097857 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ba90c733-a1e6-4922-b0de-2337e6aa9469 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 200 len: 1351 microversion: 2.25 time: 0.383283 Jun 16 14:49:11.102961 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1093/2226] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:49:10 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 1351 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:49:11.118270 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-14c2673d-c8d0-4510-a692-9d122c16e25d req-fee02e74-4463-4cae-818b-be5ebff1d0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0480cd1-9dd6-492d-ae9f-aa52b4702e05", "name": "network-vif-deleted", "tag": "65ad3aa6-d064-42ed-9694-845ef2625d96"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:11.136374 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-14c2673d-c8d0-4510-a692-9d122c16e25d req-fee02e74-4463-4cae-818b-be5ebff1d0a5 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:11.139966 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-14c2673d-c8d0-4510-a692-9d122c16e25d req-fee02e74-4463-4cae-818b-be5ebff1d0a5 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:11.171330 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-14c2673d-c8d0-4510-a692-9d122c16e25d req-fee02e74-4463-4cae-818b-be5ebff1d0a5 service nova] Creating event network-vif-deleted:65ad3aa6-d064-42ed-9694-845ef2625d96 for instance d0480cd1-9dd6-492d-ae9f-aa52b4702e05 on n-h1-836830-4 Jun 16 14:49:11.181737 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-14c2673d-c8d0-4510-a692-9d122c16e25d req-fee02e74-4463-4cae-818b-be5ebff1d0a5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077107 Jun 16 14:49:11.191545 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1094/2227] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:11.548364 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c30ecb37-a708-4892-b4e1-bb4d16771e96 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:11.550335 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c30ecb37-a708-4892-b4e1-bb4d16771e96 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:11.561767 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c30ecb37-a708-4892-b4e1-bb4d16771e96 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:11.564101 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c30ecb37-a708-4892-b4e1-bb4d16771e96 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:11.566689 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c30ecb37-a708-4892-b4e1-bb4d16771e96 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:11.567347 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c30ecb37-a708-4892-b4e1-bb4d16771e96 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:11.856448 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c30ecb37-a708-4892-b4e1-bb4d16771e96 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:11.866358 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c30ecb37-a708-4892-b4e1-bb4d16771e96 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1472 microversion: 2.1 time: 0.328181 Jun 16 14:49:11.867347 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1095/2228] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:11 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1472 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:11.872849 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-978f57be-c653-4245-ab3d-d01fcef5e55a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:11.874848 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-978f57be-c653-4245-ab3d-d01fcef5e55a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:11.885027 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-978f57be-c653-4245-ab3d-d01fcef5e55a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:11.885745 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-978f57be-c653-4245-ab3d-d01fcef5e55a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:11.887673 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-978f57be-c653-4245-ab3d-d01fcef5e55a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:11.888324 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-978f57be-c653-4245-ab3d-d01fcef5e55a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:12.013654 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-978f57be-c653-4245-ab3d-d01fcef5e55a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d712575a0c24127b182c920a6222ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb4a315608594ee79027be384bc4613d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:12.030566 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-978f57be-c653-4245-ab3d-d01fcef5e55a tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 200 len: 1353 microversion: 2.1 time: 0.161938 Jun 16 14:49:12.031187 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1096/2229] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:11 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 1353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:12.041731 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f53c4b49-a96c-48be-bdfa-3cbe779a9f3c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:12.042371 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f53c4b49-a96c-48be-bdfa-3cbe779a9f3c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:12.062759 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f53c4b49-a96c-48be-bdfa-3cbe779a9f3c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:12.063205 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f53c4b49-a96c-48be-bdfa-3cbe779a9f3c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:12.064034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f53c4b49-a96c-48be-bdfa-3cbe779a9f3c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:12.064494 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f53c4b49-a96c-48be-bdfa-3cbe779a9f3c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:12.788264 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f53c4b49-a96c-48be-bdfa-3cbe779a9f3c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:12.830980 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f53c4b49-a96c-48be-bdfa-3cbe779a9f3c tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1469 microversion: 2.1 time: 0.788834 Jun 16 14:49:12.832037 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1097/2230] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:12 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1469 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:12.880538 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a5a4a96b-7474-47dc-bb97-c8f9c8118743 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:12.884242 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a5a4a96b-7474-47dc-bb97-c8f9c8118743 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] [instance: 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:12.917065 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5a4a96b-7474-47dc-bb97-c8f9c8118743 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:12.921676 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5a4a96b-7474-47dc-bb97-c8f9c8118743 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:12.928154 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5a4a96b-7474-47dc-bb97-c8f9c8118743 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:12.930788 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a5a4a96b-7474-47dc-bb97-c8f9c8118743 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:13.012994 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-a5a4a96b-7474-47dc-bb97-c8f9c8118743 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] HTTP exception thrown: Instance 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 could not be found. Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a5a4a96b-7474-47dc-bb97-c8f9c8118743 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Request method failure captured: Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 HTTP/1.1 Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0B-okSquj7GELrJS9sbKyWDvmtrmgWBNPvmmVc8YS2EMY5GO6BwHHqKgKslswttQRM-ofZOzOefvWdL-wuYwd_JFkXSTAPHrPLKMx86sspLrTCbbDUAFwj6hIH2GTU23RKnbPK7FBh07yhNRgoGUpI-6VhkqUuOv3_jRJjOPJzFox4 Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: X-Openstack-Nova-Api-Version: 2.25 Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: c04830ebf498422d9dddfbc009697728 Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-706483184 Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:49:13.022296 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:49:13.024795 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c04830ebf498422d9dddfbc009697728", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c04830ebf498422d9dddfbc009697728"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c04830ebf498422d9dddfbc009697728"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c04830ebf498422d9dddfbc009697728"}]}] Jun 16 14:49:13.024795 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-706483184 Jun 16 14:49:13.024795 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: c04830ebf498422d9dddfbc009697728 Jun 16 14:49:13.024795 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-706483184 Jun 16 14:49:13.024795 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-LiveAutoBlockMigrationV225Test-706483184-project Jun 16 14:49:13.024795 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:49:13.024795 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:49:13.024795 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: ab3aa4e887694a0e9a42bf6db6b01555 Jun 16 14:49:13.024795 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-706483184-project Jun 16 14:49:13.024795 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:49:13.024795 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 could not be found. Jun 16 14:49:13.024795 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '1e048775-afa2-4ec5-91fd-f5d06c1fe6d3'} Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 could not be found. Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:13.026655 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 could not be found. Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 could not be found. Jun 16 14:49:13.029007 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:13.033261 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a5a4a96b-7474-47dc-bb97-c8f9c8118743 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] Returning 404 to user: Instance 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:13.036161 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a5a4a96b-7474-47dc-bb97-c8f9c8118743 tempest-LiveAutoBlockMigrationV225Test-706483184 tempest-LiveAutoBlockMigrationV225Test-706483184-project] 10.222.0.57 "GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3" status: 404 len: 111 microversion: 2.25 time: 0.188561 Jun 16 14:49:13.042415 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1098/2231] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:49:12 2022] GET /compute/v2.1/servers/1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:49:13.062649 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a1f9efd9-c346-4913-9b26-de19dcec4cbb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:13.064235 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a1f9efd9-c346-4913-9b26-de19dcec4cbb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:13.084877 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a1f9efd9-c346-4913-9b26-de19dcec4cbb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:13.085779 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a1f9efd9-c346-4913-9b26-de19dcec4cbb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:13.087099 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a1f9efd9-c346-4913-9b26-de19dcec4cbb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:13.087867 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a1f9efd9-c346-4913-9b26-de19dcec4cbb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:13.665228 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:49:13.666407 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:49:13.667149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:49:13.671400 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:49:13.672122 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:49:13.691233 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:13.728835 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:13.729558 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:13.731653 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:13.734023 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:13.843364 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Getting quotas for project c4268b504d13415f9d0e23844936bf25. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:49:13.854132 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Getting quotas for user be1e4996a4ab47be9bafdd07293277d0 and project c4268b504d13415f9d0e23844936bf25. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:49:13.891460 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Going to run 2 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:49:13.895229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 9c12ef1f-2dc9-41e9-b5dc-c677801c691f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:49:14.002656 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=9c12ef1f-2dc9-41e9-b5dc-c677801c691f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:49:14.116824 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5c645400-a12c-4713-8f5e-158e3658c788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.378222 Jun 16 14:49:14.127652 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1134/2232] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:49:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:49:14.133136 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b93ee7a5-8c7e-4be1-b3cc-f009ae3aaca8 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:14.134471 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b93ee7a5-8c7e-4be1-b3cc-f009ae3aaca8 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] [instance: d0480cd1-9dd6-492d-ae9f-aa52b4702e05] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:14.150176 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b93ee7a5-8c7e-4be1-b3cc-f009ae3aaca8 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:14.150176 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b93ee7a5-8c7e-4be1-b3cc-f009ae3aaca8 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:14.150176 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b93ee7a5-8c7e-4be1-b3cc-f009ae3aaca8 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:14.150727 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b93ee7a5-8c7e-4be1-b3cc-f009ae3aaca8 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:14.174328 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-b93ee7a5-8c7e-4be1-b3cc-f009ae3aaca8 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] HTTP exception thrown: Instance d0480cd1-9dd6-492d-ae9f-aa52b4702e05 could not be found. Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b93ee7a5-8c7e-4be1-b3cc-f009ae3aaca8 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Request method failure captured: Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 HTTP/1.1 Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0JZiMgkvuxO41T-nUjpJYD8_ZbIivmFdJZ0siD4oANj7MjrEwC5mhM8aQGW01X1MMxzKknbPojUoRR-4BNS7qoef9OUpinnvJusY5ixRBJiwYy8ZJc533Ej-23tZkMJ-NayiWjkBMAoqm1FD1jKtFNy6lT5fK3W7NcHEFs4l1rGh2w Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: fb4a315608594ee79027be384bc4613d Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ServersTestJSON-913517186 Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:49:14.176870 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:49:14.179328 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fb4a315608594ee79027be384bc4613d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb4a315608594ee79027be384bc4613d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb4a315608594ee79027be384bc4613d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fb4a315608594ee79027be384bc4613d"}]}] Jun 16 14:49:14.179328 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ServersTestJSON-913517186 Jun 16 14:49:14.179328 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: fb4a315608594ee79027be384bc4613d Jun 16 14:49:14.179328 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ServersTestJSON-913517186 Jun 16 14:49:14.179328 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ServersTestJSON-913517186-project Jun 16 14:49:14.179328 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:49:14.179328 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:49:14.179328 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 2d712575a0c24127b182c920a6222ccd Jun 16 14:49:14.179328 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ServersTestJSON-913517186-project Jun 16 14:49:14.179328 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:49:14.179328 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance d0480cd1-9dd6-492d-ae9f-aa52b4702e05 could not be found. Jun 16 14:49:14.179328 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'd0480cd1-9dd6-492d-ae9f-aa52b4702e05'} Jun 16 14:49:14.179328 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0480cd1-9dd6-492d-ae9f-aa52b4702e05 could not be found. Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:14.181147 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0480cd1-9dd6-492d-ae9f-aa52b4702e05 could not be found. Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0480cd1-9dd6-492d-ae9f-aa52b4702e05 could not be found. Jun 16 14:49:14.183395 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:14.188386 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b93ee7a5-8c7e-4be1-b3cc-f009ae3aaca8 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Returning 404 to user: Instance d0480cd1-9dd6-492d-ae9f-aa52b4702e05 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:14.188386 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b93ee7a5-8c7e-4be1-b3cc-f009ae3aaca8 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05" status: 404 len: 111 microversion: 2.1 time: 0.054481 Jun 16 14:49:14.191476 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1135/2233] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:14 2022] GET /compute/v2.1/servers/d0480cd1-9dd6-492d-ae9f-aa52b4702e05 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:14.197834 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-3104d459-7ba8-449e-a2ec-398eaadbdab7 req-54f2b18f-de85-41fa-a400-483fd43ee00c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e048775-afa2-4ec5-91fd-f5d06c1fe6d3", "name": "network-vif-deleted", "tag": "f802939c-946a-4ee0-9525-cc56a9c04b53"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:14.210751 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3104d459-7ba8-449e-a2ec-398eaadbdab7 req-54f2b18f-de85-41fa-a400-483fd43ee00c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:14.211492 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3104d459-7ba8-449e-a2ec-398eaadbdab7 req-54f2b18f-de85-41fa-a400-483fd43ee00c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:14.225469 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-3104d459-7ba8-449e-a2ec-398eaadbdab7 req-54f2b18f-de85-41fa-a400-483fd43ee00c service nova] Creating event network-vif-deleted:f802939c-946a-4ee0-9525-cc56a9c04b53 for instance 1e048775-afa2-4ec5-91fd-f5d06c1fe6d3 on n-h2-836830-4 Jun 16 14:49:14.233916 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-3104d459-7ba8-449e-a2ec-398eaadbdab7 req-54f2b18f-de85-41fa-a400-483fd43ee00c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041106 Jun 16 14:49:14.235001 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1136/2234] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:14.241473 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-08b51240-7c96-43e4-9702-ba1b4acc851d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:14.242027 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-08b51240-7c96-43e4-9702-ba1b4acc851d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:14.251219 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-08b51240-7c96-43e4-9702-ba1b4acc851d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:14.251926 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-08b51240-7c96-43e4-9702-ba1b4acc851d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:14.252858 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-08b51240-7c96-43e4-9702-ba1b4acc851d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:14.253493 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-08b51240-7c96-43e4-9702-ba1b4acc851d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:14.385610 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a1f9efd9-c346-4913-9b26-de19dcec4cbb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:14.422317 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a1f9efd9-c346-4913-9b26-de19dcec4cbb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1472 microversion: 2.1 time: 1.377041 Jun 16 14:49:14.425176 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1099/2235] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:13 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1472 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:14.441530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-47aff88b-e62e-4ca9-afef-95f57c7fd2c1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:14.447947 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-47aff88b-e62e-4ca9-afef-95f57c7fd2c1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:14.450256 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-47aff88b-e62e-4ca9-afef-95f57c7fd2c1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Searching by: {'deleted': False, 'project_id': 'c4268b504d13415f9d0e23844936bf25'} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:49:14.468588 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-47aff88b-e62e-4ca9-afef-95f57c7fd2c1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:14.469452 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-47aff88b-e62e-4ca9-afef-95f57c7fd2c1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:14.470871 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-47aff88b-e62e-4ca9-afef-95f57c7fd2c1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:14.471509 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-47aff88b-e62e-4ca9-afef-95f57c7fd2c1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:14.502338 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-47aff88b-e62e-4ca9-afef-95f57c7fd2c1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.075407 Jun 16 14:49:14.502989 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1100/2236] 10.222.0.57 () {58 vars in 1124 bytes} [Thu Jun 16 14:49:14 2022] GET /compute/v2.1/servers => generated 675 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:14.508318 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-da4d0c76-03c1-47f3-b61c-65a57861c4b6 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] Calling method '.version_select at 0x7fdf0c2d2430>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:14.545742 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-da4d0c76-03c1-47f3-b61c-65a57861c4b6 tempest-ServersTestJSON-913517186 tempest-ServersTestJSON-913517186-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-351441770" status: 202 len: 0 microversion: 2.1 time: 0.041268 Jun 16 14:49:14.546803 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1101/2237] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jun 16 14:49:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-351441770 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:49:14.567035 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-edda7a68-6e4d-4113-9e82-c43b29c600b9 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:14.568156 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-edda7a68-6e4d-4113-9e82-c43b29c600b9 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:15.070191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-08b51240-7c96-43e4-9702-ba1b4acc851d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:15.078713 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-edda7a68-6e4d-4113-9e82-c43b29c600b9 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:15.119624 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-edda7a68-6e4d-4113-9e82-c43b29c600b9 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1219 microversion: 2.1 time: 0.570792 Jun 16 14:49:15.120587 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1102/2238] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:14 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1219 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:15.134666 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-08b51240-7c96-43e4-9702-ba1b4acc851d tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1469 microversion: 2.1 time: 0.881264 Jun 16 14:49:15.146733 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1137/2239] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:14 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1469 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:15.446229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cc8246ca-7d9c-4c0c-a068-5ddbf096bd83 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:15.449854 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cc8246ca-7d9c-4c0c-a068-5ddbf096bd83 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:15.478567 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cc8246ca-7d9c-4c0c-a068-5ddbf096bd83 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:15.489950 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cc8246ca-7d9c-4c0c-a068-5ddbf096bd83 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:15.491882 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cc8246ca-7d9c-4c0c-a068-5ddbf096bd83 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:15.494669 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cc8246ca-7d9c-4c0c-a068-5ddbf096bd83 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:16.148005 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-923dceda-30fe-41f8-b43f-dc6d4a63f541 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:16.149193 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-923dceda-30fe-41f8-b43f-dc6d4a63f541 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:16.188264 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-923dceda-30fe-41f8-b43f-dc6d4a63f541 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:16.188638 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-923dceda-30fe-41f8-b43f-dc6d4a63f541 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:16.189843 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-923dceda-30fe-41f8-b43f-dc6d4a63f541 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:16.192531 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-923dceda-30fe-41f8-b43f-dc6d4a63f541 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:16.683300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-923dceda-30fe-41f8-b43f-dc6d4a63f541 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:16.716589 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-923dceda-30fe-41f8-b43f-dc6d4a63f541 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1215 microversion: 2.1 time: 0.570433 Jun 16 14:49:16.717429 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1103/2240] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:16 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1215 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:16.742574 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-65c41543-5a35-4da7-9fdf-1e1c47bdc902 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:16.743110 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-65c41543-5a35-4da7-9fdf-1e1c47bdc902 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:16.760221 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65c41543-5a35-4da7-9fdf-1e1c47bdc902 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:16.760688 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65c41543-5a35-4da7-9fdf-1e1c47bdc902 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:16.762065 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65c41543-5a35-4da7-9fdf-1e1c47bdc902 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:16.762796 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-65c41543-5a35-4da7-9fdf-1e1c47bdc902 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:17.042454 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-65c41543-5a35-4da7-9fdf-1e1c47bdc902 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:17.092666 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-65c41543-5a35-4da7-9fdf-1e1c47bdc902 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1427 microversion: 2.1 time: 0.361552 Jun 16 14:49:17.095876 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1104/2241] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:16 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1427 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:17.131192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-d1751a17-2e1f-4f7d-a64f-a92db57f5c54 req-fe957971-4fb5-4cad-8d99-98558d889458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1", "name": "network-vif-deleted", "tag": "d49d4b45-a2e1-4583-b9a7-3443ad4e6c4b"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:17.191723 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-d1751a17-2e1f-4f7d-a64f-a92db57f5c54 req-fe957971-4fb5-4cad-8d99-98558d889458 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:17.195821 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-d1751a17-2e1f-4f7d-a64f-a92db57f5c54 req-fe957971-4fb5-4cad-8d99-98558d889458 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:17.252723 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cc8246ca-7d9c-4c0c-a068-5ddbf096bd83 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:17.272986 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cc8246ca-7d9c-4c0c-a068-5ddbf096bd83 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 200 len: 1472 microversion: 2.1 time: 1.834522 Jun 16 14:49:17.276181 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-d1751a17-2e1f-4f7d-a64f-a92db57f5c54 req-fe957971-4fb5-4cad-8d99-98558d889458 service nova] Creating event network-vif-deleted:d49d4b45-a2e1-4583-b9a7-3443ad4e6c4b for instance 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 on n-h1-836830-4 Jun 16 14:49:17.285437 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1138/2242] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:15 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 1472 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:17.320025 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-d1751a17-2e1f-4f7d-a64f-a92db57f5c54 req-fe957971-4fb5-4cad-8d99-98558d889458 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213714 Jun 16 14:49:17.325677 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1105/2243] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:17.750958 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7af9f18c-d91f-459e-ba27-88dafeb35493 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:17.751607 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7af9f18c-d91f-459e-ba27-88dafeb35493 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:17.769102 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7af9f18c-d91f-459e-ba27-88dafeb35493 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:17.769914 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7af9f18c-d91f-459e-ba27-88dafeb35493 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:17.771003 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7af9f18c-d91f-459e-ba27-88dafeb35493 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:17.780737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7af9f18c-d91f-459e-ba27-88dafeb35493 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:18.088104 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7af9f18c-d91f-459e-ba27-88dafeb35493 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:18.092730 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:18.107546 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7af9f18c-d91f-459e-ba27-88dafeb35493 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1279 microversion: 2.1 time: 0.358813 Jun 16 14:49:18.108593 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1139/2244] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:17 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1279 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:18.147422 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-74579e6e-ae3d-4128-a984-810ce0dfd24a tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:18.149071 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-74579e6e-ae3d-4128-a984-810ce0dfd24a tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:18.161448 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-74579e6e-ae3d-4128-a984-810ce0dfd24a tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:18.165233 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-74579e6e-ae3d-4128-a984-810ce0dfd24a tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:18.167445 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-74579e6e-ae3d-4128-a984-810ce0dfd24a tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:18.169394 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-74579e6e-ae3d-4128-a984-810ce0dfd24a tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:18.302455 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-990c33cb-5141-45e6-a19d-956f6b7c9f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:18.303155 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-990c33cb-5141-45e6-a19d-956f6b7c9f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 7a730c56-4854-4563-a704-941d98df51a3] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:18.328043 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-990c33cb-5141-45e6-a19d-956f6b7c9f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:18.329018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-990c33cb-5141-45e6-a19d-956f6b7c9f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:18.330928 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-990c33cb-5141-45e6-a19d-956f6b7c9f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:18.333133 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-990c33cb-5141-45e6-a19d-956f6b7c9f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:18.333430 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-74579e6e-ae3d-4128-a984-810ce0dfd24a tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:18.334235 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-74579e6e-ae3d-4128-a984-810ce0dfd24a tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:18.335185 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-74579e6e-ae3d-4128-a984-810ce0dfd24a tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lazy-loading 'fault' on Instance uuid 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:49:18.387247 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-990c33cb-5141-45e6-a19d-956f6b7c9f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] HTTP exception thrown: Instance 7a730c56-4854-4563-a704-941d98df51a3 could not be found. Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-990c33cb-5141-45e6-a19d-956f6b7c9f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Request method failure captured: Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 HTTP/1.1 Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0HYDWK04k6vDj2W3DKvKiJ3grVSO6yw5Re07xNYsMLFGaw4PP0IsO014SYFozYYzMejGdOVwzaZAGhULCpC5BC_U8Zk-i7zmM_tR7aE8CHBq2lggTmOdHzG41N8cFL94bF10zdnGrevWMKipIdDv40OeFO1i2fgtLdfe8Q9RdAwHTI Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:49:18.391083 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:49:18.392414 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f00d93de6d784ffdbbfbfe050b70e4a8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f00d93de6d784ffdbbfbfe050b70e4a8"}]}] Jun 16 14:49:18.392414 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:18.392414 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:18.392414 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:18.392414 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:18.392414 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:49:18.392414 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:49:18.392414 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 70569cb340194ec0876d91d79cc6fa5f Jun 16 14:49:18.392414 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:18.392414 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:49:18.392414 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 7a730c56-4854-4563-a704-941d98df51a3 could not be found. Jun 16 14:49:18.392414 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '7a730c56-4854-4563-a704-941d98df51a3'} Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a730c56-4854-4563-a704-941d98df51a3 could not be found. Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:18.393059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a730c56-4854-4563-a704-941d98df51a3 could not be found. Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a730c56-4854-4563-a704-941d98df51a3 could not be found. Jun 16 14:49:18.394081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:18.400353 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-990c33cb-5141-45e6-a19d-956f6b7c9f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Returning 404 to user: Instance 7a730c56-4854-4563-a704-941d98df51a3 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:18.401890 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-990c33cb-5141-45e6-a19d-956f6b7c9f4f tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3" status: 404 len: 111 microversion: 2.1 time: 0.104139 Jun 16 14:49:18.407122 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1140/2245] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:18 2022] GET /compute/v2.1/servers/7a730c56-4854-4563-a704-941d98df51a3 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:18.413745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6f50062f-0415-4179-8252-4bb9e54020a6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:18.414735 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6f50062f-0415-4179-8252-4bb9e54020a6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: e8129f55-69cc-43f8-b70a-c04f23d336c5] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:18.426092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f50062f-0415-4179-8252-4bb9e54020a6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:18.427100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f50062f-0415-4179-8252-4bb9e54020a6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:18.428206 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f50062f-0415-4179-8252-4bb9e54020a6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:18.429355 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f50062f-0415-4179-8252-4bb9e54020a6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:18.478595 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6f50062f-0415-4179-8252-4bb9e54020a6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: e8129f55-69cc-43f8-b70a-c04f23d336c5] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:49:18.697961 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6f50062f-0415-4179-8252-4bb9e54020a6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e8129f55-69cc-43f8-b70a-c04f23d336c5" status: 204 len: 0 microversion: 2.1 time: 0.287905 Jun 16 14:49:18.703838 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1141/2246] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:49:18 2022] DELETE /compute/v2.1/servers/e8129f55-69cc-43f8-b70a-c04f23d336c5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:49:18.717799 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ab741ae2-2ef2-4e4a-adb0-0a92950c1ea5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:18.719347 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ab741ae2-2ef2-4e4a-adb0-0a92950c1ea5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:18.734197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ab741ae2-2ef2-4e4a-adb0-0a92950c1ea5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:18.735140 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ab741ae2-2ef2-4e4a-adb0-0a92950c1ea5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:18.737345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ab741ae2-2ef2-4e4a-adb0-0a92950c1ea5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:18.738254 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ab741ae2-2ef2-4e4a-adb0-0a92950c1ea5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:18.814882 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-74579e6e-ae3d-4128-a984-810ce0dfd24a tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab4e820c92c4510b9ad1d31046340f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca9aab10bc6d453099e97f64e7349466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:18.847962 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-74579e6e-ae3d-4128-a984-810ce0dfd24a tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 200 len: 1303 microversion: 2.1 time: 0.709333 Jun 16 14:49:18.869317 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1106/2247] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:18 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 1303 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:18.874568 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ab741ae2-2ef2-4e4a-adb0-0a92950c1ea5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:49:19.130323 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ab741ae2-2ef2-4e4a-adb0-0a92950c1ea5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "DELETE /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 204 len: 0 microversion: 2.1 time: 0.419355 Jun 16 14:49:19.178566 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1142/2248] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:49:18 2022] DELETE /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:49:19.187665 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bd4c5e6c-f632-4141-8e2f-ded78ee01f52 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:19.196650 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bd4c5e6c-f632-4141-8e2f-ded78ee01f52 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:19.239828 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-108fe344-9a49-4a4f-8588-42cf3449511b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:19.245129 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-108fe344-9a49-4a4f-8588-42cf3449511b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: e8129f55-69cc-43f8-b70a-c04f23d336c5] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:19.269557 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bd4c5e6c-f632-4141-8e2f-ded78ee01f52 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:19.270921 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bd4c5e6c-f632-4141-8e2f-ded78ee01f52 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:19.280747 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bd4c5e6c-f632-4141-8e2f-ded78ee01f52 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:19.282940 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bd4c5e6c-f632-4141-8e2f-ded78ee01f52 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:19.291177 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-108fe344-9a49-4a4f-8588-42cf3449511b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:19.293412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-108fe344-9a49-4a4f-8588-42cf3449511b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:19.296909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-108fe344-9a49-4a4f-8588-42cf3449511b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:19.298823 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-108fe344-9a49-4a4f-8588-42cf3449511b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:19.478417 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bd4c5e6c-f632-4141-8e2f-ded78ee01f52 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:19.525556 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bd4c5e6c-f632-4141-8e2f-ded78ee01f52 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1277 microversion: 2.1 time: 0.380780 Jun 16 14:49:19.534466 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1107/2249] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:19 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1277 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:19.555977 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-fd66f196-32c0-4b32-8f66-d8d652a81b11 req-6a0bd9ef-ccde-448b-9f5b-93d1f5612fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a730c56-4854-4563-a704-941d98df51a3", "name": "network-vif-deleted", "tag": "90a27c77-c44d-42f6-8959-801e8c63a89d"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:19.593220 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-fd66f196-32c0-4b32-8f66-d8d652a81b11 req-6a0bd9ef-ccde-448b-9f5b-93d1f5612fa1 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:19.595806 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-fd66f196-32c0-4b32-8f66-d8d652a81b11 req-6a0bd9ef-ccde-448b-9f5b-93d1f5612fa1 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:19.644977 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-fd66f196-32c0-4b32-8f66-d8d652a81b11 req-6a0bd9ef-ccde-448b-9f5b-93d1f5612fa1 service nova] Creating event network-vif-deleted:90a27c77-c44d-42f6-8959-801e8c63a89d for instance 7a730c56-4854-4563-a704-941d98df51a3 on n-h1-836830-4 Jun 16 14:49:19.654463 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-fd66f196-32c0-4b32-8f66-d8d652a81b11 req-6a0bd9ef-ccde-448b-9f5b-93d1f5612fa1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117184 Jun 16 14:49:19.655403 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1108/2250] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:19.894743 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-40b9458f-d673-41f8-914f-55933e029e51 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:19.895590 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-40b9458f-d673-41f8-914f-55933e029e51 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] [instance: 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:19.914820 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40b9458f-d673-41f8-914f-55933e029e51 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:19.915427 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40b9458f-d673-41f8-914f-55933e029e51 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:19.916477 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40b9458f-d673-41f8-914f-55933e029e51 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:19.917011 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40b9458f-d673-41f8-914f-55933e029e51 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:19.981311 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-40b9458f-d673-41f8-914f-55933e029e51 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] HTTP exception thrown: Instance 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 could not be found. Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-40b9458f-d673-41f8-914f-55933e029e51 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Request method failure captured: Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 HTTP/1.1 Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0LBaEGjf6ewMs4MenQFQSIwWiUdoPJ2JSHxsyTOAIwf1Op3N-D8ifslI4BWjbM0bF-akM1o_KZpzTCxi0xh1N4PaeC8lDRCVAOO_pqwk7nMJ9xJgLaH_ZlRmTtR913sya7l_3AfWP78PyTxvW-5TM9R3NItga2SGNr91RVRjedFudE Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: ca9aab10bc6d453099e97f64e7349466 Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-TenantUsagesTestJSON-566081864 Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:49:19.988663 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:49:19.990074 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ca9aab10bc6d453099e97f64e7349466", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ca9aab10bc6d453099e97f64e7349466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ca9aab10bc6d453099e97f64e7349466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ca9aab10bc6d453099e97f64e7349466"}]}] Jun 16 14:49:19.990074 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-TenantUsagesTestJSON-566081864 Jun 16 14:49:19.990074 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: ca9aab10bc6d453099e97f64e7349466 Jun 16 14:49:19.990074 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-TenantUsagesTestJSON-566081864 Jun 16 14:49:19.990074 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-TenantUsagesTestJSON-566081864-project Jun 16 14:49:19.990074 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:49:19.990074 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:49:19.990074 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 6ab4e820c92c4510b9ad1d31046340f4 Jun 16 14:49:19.990074 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-TenantUsagesTestJSON-566081864-project Jun 16 14:49:19.990074 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:49:19.990074 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 could not be found. Jun 16 14:49:19.990074 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1'} Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 could not be found. Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:19.991040 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 could not be found. Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 could not be found. Jun 16 14:49:19.992127 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:19.993070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-40b9458f-d673-41f8-914f-55933e029e51 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] Returning 404 to user: Instance 57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:19.995822 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-40b9458f-d673-41f8-914f-55933e029e51 tempest-TenantUsagesTestJSON-566081864 tempest-TenantUsagesTestJSON-566081864-project] 10.222.0.57 "GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1" status: 404 len: 111 microversion: 2.1 time: 0.107085 Jun 16 14:49:20.001152 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1109/2251] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:19 2022] GET /compute/v2.1/servers/57e73e9e-a7e0-4178-aa37-7ef7e9cfd8b1 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:49:20.569593 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ff6bc8be-2060-4359-8636-dbaf290b2ed1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:20.571170 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ff6bc8be-2060-4359-8636-dbaf290b2ed1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:20.583177 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ff6bc8be-2060-4359-8636-dbaf290b2ed1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:20.585022 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ff6bc8be-2060-4359-8636-dbaf290b2ed1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:20.588675 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ff6bc8be-2060-4359-8636-dbaf290b2ed1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:20.591121 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ff6bc8be-2060-4359-8636-dbaf290b2ed1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:20.618874 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:20.906726 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-108fe344-9a49-4a4f-8588-42cf3449511b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:20.928953 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-108fe344-9a49-4a4f-8588-42cf3449511b tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/e8129f55-69cc-43f8-b70a-c04f23d336c5" status: 200 len: 1473 microversion: 2.1 time: 1.733007 Jun 16 14:49:20.930177 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1143/2252] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:19 2022] GET /compute/v2.1/servers/e8129f55-69cc-43f8-b70a-c04f23d336c5 => generated 1473 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:21.189177 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ff6bc8be-2060-4359-8636-dbaf290b2ed1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:21.217614 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ff6bc8be-2060-4359-8636-dbaf290b2ed1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1277 microversion: 2.1 time: 0.651625 Jun 16 14:49:21.219816 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1110/2253] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:20 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1277 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:21.951238 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e95ea7df-f0f4-41c6-940e-4fe65dcd9e6d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:21.951971 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e95ea7df-f0f4-41c6-940e-4fe65dcd9e6d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: e8129f55-69cc-43f8-b70a-c04f23d336c5] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:21.961990 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e95ea7df-f0f4-41c6-940e-4fe65dcd9e6d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:21.962881 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e95ea7df-f0f4-41c6-940e-4fe65dcd9e6d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:21.963970 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e95ea7df-f0f4-41c6-940e-4fe65dcd9e6d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:21.964714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e95ea7df-f0f4-41c6-940e-4fe65dcd9e6d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:22.249526 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f69de3ea-6546-43b6-b5da-08ac31c99e95 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:22.251916 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f69de3ea-6546-43b6-b5da-08ac31c99e95 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:22.273154 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f69de3ea-6546-43b6-b5da-08ac31c99e95 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:22.278934 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f69de3ea-6546-43b6-b5da-08ac31c99e95 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:22.283157 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f69de3ea-6546-43b6-b5da-08ac31c99e95 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:22.283943 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f69de3ea-6546-43b6-b5da-08ac31c99e95 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:22.810859 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f69de3ea-6546-43b6-b5da-08ac31c99e95 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:22.828805 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f69de3ea-6546-43b6-b5da-08ac31c99e95 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1277 microversion: 2.1 time: 0.586926 Jun 16 14:49:22.830534 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1111/2254] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:22 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1277 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:22.857075 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e95ea7df-f0f4-41c6-940e-4fe65dcd9e6d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:22.875035 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e95ea7df-f0f4-41c6-940e-4fe65dcd9e6d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/e8129f55-69cc-43f8-b70a-c04f23d336c5" status: 200 len: 1473 microversion: 2.1 time: 0.928189 Jun 16 14:49:22.891293 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1144/2255] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:21 2022] GET /compute/v2.1/servers/e8129f55-69cc-43f8-b70a-c04f23d336c5 => generated 1473 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:23.858882 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a4509c0b-748a-417a-a1c6-865ea5fb6c66 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:23.869156 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a4509c0b-748a-417a-a1c6-865ea5fb6c66 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:23.905301 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a4509c0b-748a-417a-a1c6-865ea5fb6c66 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:23.905753 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bdaf9584-0e88-4cda-86fa-ff4216684a74 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:23.911014 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bdaf9584-0e88-4cda-86fa-ff4216684a74 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: e8129f55-69cc-43f8-b70a-c04f23d336c5] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:23.911268 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a4509c0b-748a-417a-a1c6-865ea5fb6c66 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:23.915867 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a4509c0b-748a-417a-a1c6-865ea5fb6c66 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:23.917719 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a4509c0b-748a-417a-a1c6-865ea5fb6c66 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:23.944159 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=8 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:23.948408 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=6 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:23.956177 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bdaf9584-0e88-4cda-86fa-ff4216684a74 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:23.959684 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bdaf9584-0e88-4cda-86fa-ff4216684a74 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:23.965625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bdaf9584-0e88-4cda-86fa-ff4216684a74 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:23.966815 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bdaf9584-0e88-4cda-86fa-ff4216684a74 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:24.283078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bdaf9584-0e88-4cda-86fa-ff4216684a74 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:24.335387 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bdaf9584-0e88-4cda-86fa-ff4216684a74 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/e8129f55-69cc-43f8-b70a-c04f23d336c5" status: 200 len: 1431 microversion: 2.1 time: 0.440593 Jun 16 14:49:24.343458 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1145/2256] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:23 2022] GET /compute/v2.1/servers/e8129f55-69cc-43f8-b70a-c04f23d336c5 => generated 1431 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:24.362865 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-91c5d559-bbc2-4450-b6cb-2c30f63e9fd3 req-93fb9c9b-5f31-4556-9040-60c9448479e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8129f55-69cc-43f8-b70a-c04f23d336c5", "name": "network-vif-deleted", "tag": "9d6b56a9-437f-474b-8cba-dee373187456"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:24.415498 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-91c5d559-bbc2-4450-b6cb-2c30f63e9fd3 req-93fb9c9b-5f31-4556-9040-60c9448479e7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:24.416342 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-91c5d559-bbc2-4450-b6cb-2c30f63e9fd3 req-93fb9c9b-5f31-4556-9040-60c9448479e7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:24.469891 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-91c5d559-bbc2-4450-b6cb-2c30f63e9fd3 req-93fb9c9b-5f31-4556-9040-60c9448479e7 service nova] Creating event network-vif-deleted:9d6b56a9-437f-474b-8cba-dee373187456 for instance e8129f55-69cc-43f8-b70a-c04f23d336c5 on n-h2-836830-4 Jun 16 14:49:24.478797 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:24.532458 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-91c5d559-bbc2-4450-b6cb-2c30f63e9fd3 req-93fb9c9b-5f31-4556-9040-60c9448479e7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178622 Jun 16 14:49:24.539865 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1146/2257] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:24.677048 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a4509c0b-748a-417a-a1c6-865ea5fb6c66 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:24.724378 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a4509c0b-748a-417a-a1c6-865ea5fb6c66 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1277 microversion: 2.1 time: 0.876690 Jun 16 14:49:24.727172 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1112/2258] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:23 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1277 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:25.384283 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-97fc6913-b2ad-4846-b425-768c2000f017 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:25.389683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-97fc6913-b2ad-4846-b425-768c2000f017 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: e8129f55-69cc-43f8-b70a-c04f23d336c5] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:25.438206 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97fc6913-b2ad-4846-b425-768c2000f017 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:25.438861 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97fc6913-b2ad-4846-b425-768c2000f017 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:25.439820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97fc6913-b2ad-4846-b425-768c2000f017 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:25.440308 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-97fc6913-b2ad-4846-b425-768c2000f017 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:25.467795 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-97fc6913-b2ad-4846-b425-768c2000f017 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] HTTP exception thrown: Instance e8129f55-69cc-43f8-b70a-c04f23d336c5 could not be found. Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-97fc6913-b2ad-4846-b425-768c2000f017 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Request method failure captured: Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/e8129f55-69cc-43f8-b70a-c04f23d336c5 HTTP/1.1 Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0HYDWK04k6vDj2W3DKvKiJ3grVSO6yw5Re07xNYsMLFGaw4PP0IsO014SYFozYYzMejGdOVwzaZAGhULCpC5BC_U8Zk-i7zmM_tR7aE8CHBq2lggTmOdHzG41N8cFL94bF10zdnGrevWMKipIdDv40OeFO1i2fgtLdfe8Q9RdAwHTI Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:49:25.484628 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:49:25.487336 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f00d93de6d784ffdbbfbfe050b70e4a8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f00d93de6d784ffdbbfbfe050b70e4a8"}]}] Jun 16 14:49:25.487336 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:25.487336 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:25.487336 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:25.487336 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:25.487336 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:49:25.487336 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:49:25.487336 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 70569cb340194ec0876d91d79cc6fa5f Jun 16 14:49:25.487336 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:25.487336 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:49:25.487336 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance e8129f55-69cc-43f8-b70a-c04f23d336c5 could not be found. Jun 16 14:49:25.487336 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'e8129f55-69cc-43f8-b70a-c04f23d336c5'} Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8129f55-69cc-43f8-b70a-c04f23d336c5 could not be found. Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:25.488612 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8129f55-69cc-43f8-b70a-c04f23d336c5 could not be found. Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8129f55-69cc-43f8-b70a-c04f23d336c5 could not be found. Jun 16 14:49:25.490949 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:25.492963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-97fc6913-b2ad-4846-b425-768c2000f017 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Returning 404 to user: Instance e8129f55-69cc-43f8-b70a-c04f23d336c5 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:25.492963 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-97fc6913-b2ad-4846-b425-768c2000f017 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/e8129f55-69cc-43f8-b70a-c04f23d336c5" status: 404 len: 111 microversion: 2.1 time: 0.123193 Jun 16 14:49:25.492963 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1147/2259] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:25 2022] GET /compute/v2.1/servers/e8129f55-69cc-43f8-b70a-c04f23d336c5 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:25.496445 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8ff07aa1-7f80-4ee4-bd25-63f9e71ce8cb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:25.497299 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8ff07aa1-7f80-4ee4-bd25-63f9e71ce8cb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:25.510683 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:25.514881 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8ff07aa1-7f80-4ee4-bd25-63f9e71ce8cb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:25.515364 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8ff07aa1-7f80-4ee4-bd25-63f9e71ce8cb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:25.516214 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8ff07aa1-7f80-4ee4-bd25-63f9e71ce8cb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:25.519753 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8ff07aa1-7f80-4ee4-bd25-63f9e71ce8cb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:25.763899 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-39435869-1a6d-4f7e-9367-dbbfeb47a2af tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:25.766068 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-39435869-1a6d-4f7e-9367-dbbfeb47a2af tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:25.790331 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39435869-1a6d-4f7e-9367-dbbfeb47a2af tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:25.790933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39435869-1a6d-4f7e-9367-dbbfeb47a2af tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:25.791816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39435869-1a6d-4f7e-9367-dbbfeb47a2af tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:25.792331 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39435869-1a6d-4f7e-9367-dbbfeb47a2af tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:26.576883 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8ff07aa1-7f80-4ee4-bd25-63f9e71ce8cb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:26.607497 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8ff07aa1-7f80-4ee4-bd25-63f9e71ce8cb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1431 microversion: 2.1 time: 1.111200 Jun 16 14:49:26.613652 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1113/2260] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:25 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1431 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:26.673825 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-7c594923-baf4-4433-a9aa-530b89aff1e4 req-52c95ff7-ebb2-4610-be0e-70c716fec472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88cd3633-0f20-4fd2-94c5-c8803c13836a", "name": "network-vif-deleted", "tag": "d41b3ebf-35ad-4121-a488-e3458270da18"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:26.716042 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-7c594923-baf4-4433-a9aa-530b89aff1e4 req-52c95ff7-ebb2-4610-be0e-70c716fec472 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:26.721591 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-7c594923-baf4-4433-a9aa-530b89aff1e4 req-52c95ff7-ebb2-4610-be0e-70c716fec472 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:26.781675 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-7c594923-baf4-4433-a9aa-530b89aff1e4 req-52c95ff7-ebb2-4610-be0e-70c716fec472 service nova] Creating event network-vif-deleted:d41b3ebf-35ad-4121-a488-e3458270da18 for instance 88cd3633-0f20-4fd2-94c5-c8803c13836a on n-h1-836830-4 Jun 16 14:49:26.823867 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-7c594923-baf4-4433-a9aa-530b89aff1e4 req-52c95ff7-ebb2-4610-be0e-70c716fec472 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148332 Jun 16 14:49:26.827374 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1114/2261] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:49:27.173051 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-39435869-1a6d-4f7e-9367-dbbfeb47a2af tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:27.188940 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-39435869-1a6d-4f7e-9367-dbbfeb47a2af tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1319 microversion: 2.1 time: 1.438205 Jun 16 14:49:27.189916 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1148/2262] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:25 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1319 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:27.649183 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5c89c90c-7933-4557-83dd-9f9f8cf90a66 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:27.649848 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5c89c90c-7933-4557-83dd-9f9f8cf90a66 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:27.663645 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5c89c90c-7933-4557-83dd-9f9f8cf90a66 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:27.668035 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5c89c90c-7933-4557-83dd-9f9f8cf90a66 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:27.669767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5c89c90c-7933-4557-83dd-9f9f8cf90a66 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:27.675205 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5c89c90c-7933-4557-83dd-9f9f8cf90a66 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:27.828771 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5c89c90c-7933-4557-83dd-9f9f8cf90a66 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:27.828771 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5c89c90c-7933-4557-83dd-9f9f8cf90a66 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:27.828771 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-5c89c90c-7933-4557-83dd-9f9f8cf90a66 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lazy-loading 'fault' on Instance uuid 88cd3633-0f20-4fd2-94c5-c8803c13836a {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:49:27.867954 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1265565152", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:28.020278 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5c89c90c-7933-4557-83dd-9f9f8cf90a66 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:28.038454 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5c89c90c-7933-4557-83dd-9f9f8cf90a66 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 200 len: 1308 microversion: 2.1 time: 0.393205 Jun 16 14:49:28.048277 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1149/2263] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:27 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 1308 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:28.082984 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:49:28.211247 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a2799286-0f2c-4b9a-915f-07cbfd7a0623 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:28.213623 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a2799286-0f2c-4b9a-915f-07cbfd7a0623 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:28.226328 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a2799286-0f2c-4b9a-915f-07cbfd7a0623 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:28.227963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a2799286-0f2c-4b9a-915f-07cbfd7a0623 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:28.230036 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a2799286-0f2c-4b9a-915f-07cbfd7a0623 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:28.231908 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a2799286-0f2c-4b9a-915f-07cbfd7a0623 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:29.299049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a2799286-0f2c-4b9a-915f-07cbfd7a0623 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:29.374322 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a2799286-0f2c-4b9a-915f-07cbfd7a0623 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1319 microversion: 2.1 time: 1.163227 Jun 16 14:49:29.381001 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1150/2264] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:28 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1319 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:29.412664 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7b5dbc4d-27d0-4011-a5fa-beec0dd7f135 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:29.413780 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7b5dbc4d-27d0-4011-a5fa-beec0dd7f135 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 88cd3633-0f20-4fd2-94c5-c8803c13836a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:29.457321 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b5dbc4d-27d0-4011-a5fa-beec0dd7f135 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:29.458323 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b5dbc4d-27d0-4011-a5fa-beec0dd7f135 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:29.459900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b5dbc4d-27d0-4011-a5fa-beec0dd7f135 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:29.460499 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b5dbc4d-27d0-4011-a5fa-beec0dd7f135 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:29.520499 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-7b5dbc4d-27d0-4011-a5fa-beec0dd7f135 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] HTTP exception thrown: Instance 88cd3633-0f20-4fd2-94c5-c8803c13836a could not be found. Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7b5dbc4d-27d0-4011-a5fa-beec0dd7f135 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Request method failure captured: Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a HTTP/1.1 Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0HYDWK04k6vDj2W3DKvKiJ3grVSO6yw5Re07xNYsMLFGaw4PP0IsO014SYFozYYzMejGdOVwzaZAGhULCpC5BC_U8Zk-i7zmM_tR7aE8CHBq2lggTmOdHzG41N8cFL94bF10zdnGrevWMKipIdDv40OeFO1i2fgtLdfe8Q9RdAwHTI Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:49:29.523915 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:49:29.526004 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f00d93de6d784ffdbbfbfe050b70e4a8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f00d93de6d784ffdbbfbfe050b70e4a8"}]}] Jun 16 14:49:29.526004 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:29.526004 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:29.526004 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:29.526004 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:29.526004 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:49:29.526004 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:49:29.526004 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 70569cb340194ec0876d91d79cc6fa5f Jun 16 14:49:29.526004 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:29.526004 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:49:29.526004 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 88cd3633-0f20-4fd2-94c5-c8803c13836a could not be found. Jun 16 14:49:29.526004 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '88cd3633-0f20-4fd2-94c5-c8803c13836a'} Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88cd3633-0f20-4fd2-94c5-c8803c13836a could not be found. Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:29.527230 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88cd3633-0f20-4fd2-94c5-c8803c13836a could not be found. Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88cd3633-0f20-4fd2-94c5-c8803c13836a could not be found. Jun 16 14:49:29.529258 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:29.536743 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7b5dbc4d-27d0-4011-a5fa-beec0dd7f135 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Returning 404 to user: Instance 88cd3633-0f20-4fd2-94c5-c8803c13836a could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:29.545684 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7b5dbc4d-27d0-4011-a5fa-beec0dd7f135 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a" status: 404 len: 111 microversion: 2.1 time: 0.157274 Jun 16 14:49:29.548074 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1151/2265] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:29 2022] GET /compute/v2.1/servers/88cd3633-0f20-4fd2-94c5-c8803c13836a => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:29.568453 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c50037b6-27f9-4ce9-a308-9d7aa6713c5d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:29.679222 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c50037b6-27f9-4ce9-a308-9d7aa6713c5d tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "DELETE /compute/v2.1/os-server-groups/a74e683f-8a1f-405f-8fb8-95762d26da01" status: 204 len: 0 microversion: 2.1 time: 0.124511 Jun 16 14:49:29.704570 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1152/2266] 10.222.0.57 () {58 vars in 1265 bytes} [Thu Jun 16 14:49:29 2022] DELETE /compute/v2.1/os-server-groups/a74e683f-8a1f-405f-8fb8-95762d26da01 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 14:49:29.723417 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-852b1b1d-bbcc-48d8-9dc1-c883c9c997ff tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:29.726732 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-852b1b1d-bbcc-48d8-9dc1-c883c9c997ff tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: ebabcdb6-1a81-4841-a33e-921e67a0d2f6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:29.739640 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-852b1b1d-bbcc-48d8-9dc1-c883c9c997ff tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:29.740238 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-852b1b1d-bbcc-48d8-9dc1-c883c9c997ff tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:29.745395 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-852b1b1d-bbcc-48d8-9dc1-c883c9c997ff tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:29.751603 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-852b1b1d-bbcc-48d8-9dc1-c883c9c997ff tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:29.842629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-852b1b1d-bbcc-48d8-9dc1-c883c9c997ff tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: ebabcdb6-1a81-4841-a33e-921e67a0d2f6] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:49:30.134440 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-852b1b1d-bbcc-48d8-9dc1-c883c9c997ff tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6" status: 204 len: 0 microversion: 2.1 time: 0.427116 Jun 16 14:49:30.135525 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1153/2267] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:49:29 2022] DELETE /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:49:30.157287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-72048332-395e-48e0-825b-083e0f325b79 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:30.161879 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-72048332-395e-48e0-825b-083e0f325b79 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:30.195660 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:49:30.196453 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:49:30.197326 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:49:30.198070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:49:30.198849 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:49:30.199033 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-72048332-395e-48e0-825b-083e0f325b79 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:30.200028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-72048332-395e-48e0-825b-083e0f325b79 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:30.201535 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-72048332-395e-48e0-825b-083e0f325b79 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:30.202467 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-72048332-395e-48e0-825b-083e0f325b79 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:30.233302 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:30.233799 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:30.247954 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:30.249134 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:30.288241 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-72048332-395e-48e0-825b-083e0f325b79 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:49:30.320314 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:30.366206 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Getting quotas for project 08cd81fd52f54249b82d5282cd42bf23. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:49:30.407132 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Getting quotas for user 22846c38ccc944339adcd2defab2beb0 and project 08cd81fd52f54249b82d5282cd42bf23. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:49:30.476601 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:49:30.501792 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:49:30.504312 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-72048332-395e-48e0-825b-083e0f325b79 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "DELETE /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76" status: 204 len: 0 microversion: 2.1 time: 0.361607 Jun 16 14:49:30.508585 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1154/2268] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:49:30 2022] DELETE /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:49:30.518355 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b2788b2a-f22d-425f-bbb7-499f9a2e1e02 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:30.519338 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b2788b2a-f22d-425f-bbb7-499f9a2e1e02 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:30.541348 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2788b2a-f22d-425f-bbb7-499f9a2e1e02 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:30.541689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2788b2a-f22d-425f-bbb7-499f9a2e1e02 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:30.542587 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2788b2a-f22d-425f-bbb7-499f9a2e1e02 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:30.543252 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2788b2a-f22d-425f-bbb7-499f9a2e1e02 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:30.851650 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-14b90e06-11ab-46dd-a910-6f14320d09e0 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.329494 Jun 16 14:49:30.856961 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1115/2269] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:49:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 14:49:30.902746 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-96e504c8-963e-4097-9a2a-186deabb9cb5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:30.904271 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-96e504c8-963e-4097-9a2a-186deabb9cb5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: ebabcdb6-1a81-4841-a33e-921e67a0d2f6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:30.932487 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-96e504c8-963e-4097-9a2a-186deabb9cb5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:30.944191 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-96e504c8-963e-4097-9a2a-186deabb9cb5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:30.950666 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-96e504c8-963e-4097-9a2a-186deabb9cb5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:30.953794 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-96e504c8-963e-4097-9a2a-186deabb9cb5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:31.582811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b2788b2a-f22d-425f-bbb7-499f9a2e1e02 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:31.638762 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b2788b2a-f22d-425f-bbb7-499f9a2e1e02 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1319 microversion: 2.1 time: 1.127666 Jun 16 14:49:31.643300 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1155/2270] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:30 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1319 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:31.700539 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7b0a92ad-9c09-49f7-a8d4-c7342d9f1f1e tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:31.716803 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7b0a92ad-9c09-49f7-a8d4-c7342d9f1f1e tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:32.052305 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7b0a92ad-9c09-49f7-a8d4-c7342d9f1f1e tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:32.083841 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7b0a92ad-9c09-49f7-a8d4-c7342d9f1f1e tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1216 microversion: 2.1 time: 0.432150 Jun 16 14:49:32.087693 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1156/2271] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:31 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1216 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:32.667959 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-db01747c-4b5c-4b2a-af78-89a3f21dfb08 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:32.671821 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-db01747c-4b5c-4b2a-af78-89a3f21dfb08 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:32.688531 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-db01747c-4b5c-4b2a-af78-89a3f21dfb08 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:32.689868 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-db01747c-4b5c-4b2a-af78-89a3f21dfb08 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:32.691691 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-db01747c-4b5c-4b2a-af78-89a3f21dfb08 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:32.693015 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-db01747c-4b5c-4b2a-af78-89a3f21dfb08 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:33.299646 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-96e504c8-963e-4097-9a2a-186deabb9cb5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:33.352622 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-96e504c8-963e-4097-9a2a-186deabb9cb5 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6" status: 200 len: 1475 microversion: 2.1 time: 2.474379 Jun 16 14:49:33.353683 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1116/2272] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:30 2022] GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6 => generated 1475 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:33.374860 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-517de4dc-5e12-4e1b-9b51-29542172c599 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:33.376596 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-517de4dc-5e12-4e1b-9b51-29542172c599 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:33.418766 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-517de4dc-5e12-4e1b-9b51-29542172c599 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:33.420212 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-517de4dc-5e12-4e1b-9b51-29542172c599 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:33.421878 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-517de4dc-5e12-4e1b-9b51-29542172c599 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:33.423170 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-517de4dc-5e12-4e1b-9b51-29542172c599 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:33.921812 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-517de4dc-5e12-4e1b-9b51-29542172c599 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:33.923862 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-db01747c-4b5c-4b2a-af78-89a3f21dfb08 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:33.932014 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-db01747c-4b5c-4b2a-af78-89a3f21dfb08 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1319 microversion: 2.1 time: 1.273859 Jun 16 14:49:33.932633 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1157/2273] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:32 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1319 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:33.977537 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-517de4dc-5e12-4e1b-9b51-29542172c599 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1212 microversion: 2.1 time: 0.617013 Jun 16 14:49:33.997626 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1117/2274] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:33 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1212 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:34.271865 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8d8d3308-36e9-4b1b-b6e6-dc1c4b115706 tempest-TenantUsagesNegativeTestJSON-1900032617 tempest-TenantUsagesNegativeTestJSON-1900032617-project-admin] 10.222.0.57 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-15T14%3A49%3A33.801097&end=2022-06-17T14%3A49%3A33.801097" status: 404 len: 112 microversion: - time: 0.337721 Jun 16 14:49:34.277694 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1158/2275] 10.222.0.57 () {58 vars in 1315 bytes} [Thu Jun 16 14:49:33 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-15T14%3A49%3A33.801097&end=2022-06-17T14%3A49%3A33.801097 => generated 112 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 14:49:34.284118 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-21c618c9-3219-4a21-b109-8433145b5480 tempest-TenantUsagesNegativeTestJSON-1900032617 tempest-TenantUsagesNegativeTestJSON-1900032617-project-admin] Calling method '.version_select at 0x7fdeff522160>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:34.303060 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-21c618c9-3219-4a21-b109-8433145b5480 tempest-TenantUsagesNegativeTestJSON-1900032617 tempest-TenantUsagesNegativeTestJSON-1900032617-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-21c618c9-3219-4a21-b109-8433145b5480 tempest-TenantUsagesNegativeTestJSON-1900032617 tempest-TenantUsagesNegativeTestJSON-1900032617-project-admin] Request method failure captured: Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/os-simple-tenant-usage/2422532509d74c5aa889ace59a77efb9?start=2022-06-17T14%3A49%3A33.801097&end=2022-06-15T14%3A49%3A33.801097 HTTP/1.1 Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0L9EROOZtAY-XAU8z4rjVVio33mVkgXt6y0Tj2Dr1loxRoqE3wfptTPCfekwt3HUD98DbXL1VLV50FkZwjYEybM_mO9YlxY4vWS9umO1YH2zqpNyAL6fRdoaCA0xXLxVHjAFUBiVEyAoe-XSBsaTnz6arisubyQGA7tiwn0op2f-Wg Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: ea927a3d687d4e6a8a32e8717264f1ce Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1900032617 Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:49:34.312387 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:49:34.313652 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ea927a3d687d4e6a8a32e8717264f1ce", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea927a3d687d4e6a8a32e8717264f1ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea927a3d687d4e6a8a32e8717264f1ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ea927a3d687d4e6a8a32e8717264f1ce"}]}] Jun 16 14:49:34.313652 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1900032617 Jun 16 14:49:34.313652 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: ea927a3d687d4e6a8a32e8717264f1ce Jun 16 14:49:34.313652 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1900032617 Jun 16 14:49:34.313652 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-TenantUsagesNegativeTestJSON-1900032617-project-admin Jun 16 14:49:34.313652 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:49:34.313652 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:49:34.313652 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: aefc2062b1bf45a0866ef4884bc6dd91 Jun 16 14:49:34.313652 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1900032617-project-admin Jun 16 14:49:34.313652 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:49:34.313652 n-d-836830-4 devstack@n-api.service[125863]: exception: Invalid start time. The start time cannot occur after the end time. Jun 16 14:49:34.313652 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '2422532509d74c5aa889ace59a77efb9'} Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 16 14:49:34.314326 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jun 16 14:49:34.315397 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:34.315397 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:34.315397 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:34.315397 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:34.315397 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:34.315397 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:34.315397 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:34.315397 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:34.315397 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jun 16 14:49:34.315397 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:34.317470 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-21c618c9-3219-4a21-b109-8433145b5480 tempest-TenantUsagesNegativeTestJSON-1900032617 tempest-TenantUsagesNegativeTestJSON-1900032617-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:34.318780 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-21c618c9-3219-4a21-b109-8433145b5480 tempest-TenantUsagesNegativeTestJSON-1900032617 tempest-TenantUsagesNegativeTestJSON-1900032617-project-admin] 10.222.0.57 "GET /compute/v2.1/os-simple-tenant-usage/2422532509d74c5aa889ace59a77efb9?start=2022-06-17T14%3A49%3A33.801097&end=2022-06-15T14%3A49%3A33.801097" status: 400 len: 111 microversion: 2.1 time: 0.038594 Jun 16 14:49:34.319759 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1118/2276] 10.222.0.57 () {58 vars in 1411 bytes} [Thu Jun 16 14:49:34 2022] GET /compute/v2.1/os-simple-tenant-usage/2422532509d74c5aa889ace59a77efb9?start=2022-06-17T14%3A49%3A33.801097&end=2022-06-15T14%3A49%3A33.801097 => generated 111 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:49:34.382133 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5a13b66c-c686-4a46-8d23-d6b4aeda6e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:34.385806 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5a13b66c-c686-4a46-8d23-d6b4aeda6e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: ebabcdb6-1a81-4841-a33e-921e67a0d2f6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:34.417411 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5a13b66c-c686-4a46-8d23-d6b4aeda6e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:34.421931 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5a13b66c-c686-4a46-8d23-d6b4aeda6e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:34.425960 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5a13b66c-c686-4a46-8d23-d6b4aeda6e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:34.427006 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5a13b66c-c686-4a46-8d23-d6b4aeda6e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:34.656061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dbd577be-046e-4942-9c7b-f3ce6ea7c045 tempest-TenantUsagesNegativeTestJSON-2026833245 tempest-TenantUsagesNegativeTestJSON-2026833245-project] Calling method '.version_select at 0x7fdeffcb1a60>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:34.660649 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-dbd577be-046e-4942-9c7b-f3ce6ea7c045 tempest-TenantUsagesNegativeTestJSON-2026833245 tempest-TenantUsagesNegativeTestJSON-2026833245-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '4a340605b3ac4555b4adbd2146b8d17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2422532509d74c5aa889ace59a77efb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dbd577be-046e-4942-9c7b-f3ce6ea7c045 tempest-TenantUsagesNegativeTestJSON-2026833245 tempest-TenantUsagesNegativeTestJSON-2026833245-project] Request method failure captured: Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-15T14%3A49%3A33.801097&end=2022-06-17T14%3A49%3A33.801097&detailed=1 HTTP/1.1 Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0L7WOrDSh4UoHsvWJogTocNxzB3xA-kBia2UdIsqmLLHl0iuHebxtbkmMv3pk4EnZePJhhFI9Y8K1LGsVQ0wALDSgV4HZPC8VwKJl3sQGK3cwIIdB2ceuLFA5RJNXi0x-GREi0JBlzyfOYxNk8m5XhVKevszC7SEs-A2YS-cqUtIk4 Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 2422532509d74c5aa889ace59a77efb9 Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2026833245 Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:49:34.664240 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:49:34.665616 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2422532509d74c5aa889ace59a77efb9", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2422532509d74c5aa889ace59a77efb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2422532509d74c5aa889ace59a77efb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2422532509d74c5aa889ace59a77efb9"}]}] Jun 16 14:49:34.665616 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2026833245 Jun 16 14:49:34.665616 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 2422532509d74c5aa889ace59a77efb9 Jun 16 14:49:34.665616 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2026833245 Jun 16 14:49:34.665616 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-TenantUsagesNegativeTestJSON-2026833245-project Jun 16 14:49:34.665616 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:49:34.665616 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:49:34.665616 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 4a340605b3ac4555b4adbd2146b8d17c Jun 16 14:49:34.665616 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2026833245-project Jun 16 14:49:34.665616 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:49:34.665616 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 16 14:49:34.665616 n-d-836830-4 devstack@n-api.service[125862]: action_args: {} Jun 16 14:49:34.665616 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:49:34.666336 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:49:34.667445 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:49:34.669543 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 16 14:49:34.669543 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:49:34.674368 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dbd577be-046e-4942-9c7b-f3ce6ea7c045 tempest-TenantUsagesNegativeTestJSON-2026833245 tempest-TenantUsagesNegativeTestJSON-2026833245-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:34.675793 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-dbd577be-046e-4942-9c7b-f3ce6ea7c045 tempest-TenantUsagesNegativeTestJSON-2026833245 tempest-TenantUsagesNegativeTestJSON-2026833245-project] 10.222.0.57 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-15T14%3A49%3A33.801097&end=2022-06-17T14%3A49%3A33.801097&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.347883 Jun 16 14:49:34.681132 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1159/2277] 10.222.0.57 () {58 vars in 1334 bytes} [Thu Jun 16 14:49:34 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-15T14%3A49%3A33.801097&end=2022-06-17T14%3A49%3A33.801097&detailed=1 => generated 123 bytes in 354 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:49:34.962893 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-49f8a907-b516-4948-8d9e-2471b834c5a1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:34.966399 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-49f8a907-b516-4948-8d9e-2471b834c5a1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:34.987489 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49f8a907-b516-4948-8d9e-2471b834c5a1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:34.991071 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49f8a907-b516-4948-8d9e-2471b834c5a1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:34.992150 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49f8a907-b516-4948-8d9e-2471b834c5a1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:34.994119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49f8a907-b516-4948-8d9e-2471b834c5a1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:36.364909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-49f8a907-b516-4948-8d9e-2471b834c5a1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:36.453647 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-49f8a907-b516-4948-8d9e-2471b834c5a1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1319 microversion: 2.1 time: 1.487899 Jun 16 14:49:36.454845 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1160/2278] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:34 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1319 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:36.477700 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f8872fd8-66ec-4505-bbd1-889b8f68d54d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:36.500672 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f8872fd8-66ec-4505-bbd1-889b8f68d54d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:36.556914 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:36.595844 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f8872fd8-66ec-4505-bbd1-889b8f68d54d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:36.596943 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f8872fd8-66ec-4505-bbd1-889b8f68d54d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:36.612357 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f8872fd8-66ec-4505-bbd1-889b8f68d54d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:36.614090 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f8872fd8-66ec-4505-bbd1-889b8f68d54d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:36.843680 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5a13b66c-c686-4a46-8d23-d6b4aeda6e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:36.931045 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5a13b66c-c686-4a46-8d23-d6b4aeda6e26 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6" status: 200 len: 1475 microversion: 2.1 time: 2.548119 Jun 16 14:49:36.942902 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1119/2279] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:34 2022] GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6 => generated 1475 bytes in 2566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:36.956916 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f8872fd8-66ec-4505-bbd1-889b8f68d54d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:36.993719 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f8872fd8-66ec-4505-bbd1-889b8f68d54d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1274 microversion: 2.1 time: 0.509737 Jun 16 14:49:36.995199 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-18f4c44a-9985-498b-beae-19c3a8645f11 req-39be1825-a2d1-4398-acd2-5d7b96903997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d23270-9297-4a55-8d4c-022f8ffcedf6", "tag": "c8f6b10d-ca3a-483e-a435-128bb7a6a621"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:36.996695 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1161/2280] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:36 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1274 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:37.112968 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-18f4c44a-9985-498b-beae-19c3a8645f11 req-39be1825-a2d1-4398-acd2-5d7b96903997 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:37.113800 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-18f4c44a-9985-498b-beae-19c3a8645f11 req-39be1825-a2d1-4398-acd2-5d7b96903997 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:37.171669 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-18f4c44a-9985-498b-beae-19c3a8645f11 req-39be1825-a2d1-4398-acd2-5d7b96903997 service nova] Creating event network-changed:c8f6b10d-ca3a-483e-a435-128bb7a6a621 for instance e6d23270-9297-4a55-8d4c-022f8ffcedf6 on n-h2-836830-4 Jun 16 14:49:37.198560 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-18f4c44a-9985-498b-beae-19c3a8645f11 req-39be1825-a2d1-4398-acd2-5d7b96903997 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242832 Jun 16 14:49:37.203508 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1120/2281] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:37.488054 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-193c8a13-b4d1-48f6-b1c1-f2d0813801f9 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:37.490037 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-193c8a13-b4d1-48f6-b1c1-f2d0813801f9 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:37.522045 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-193c8a13-b4d1-48f6-b1c1-f2d0813801f9 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:37.522914 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-193c8a13-b4d1-48f6-b1c1-f2d0813801f9 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:37.524288 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-193c8a13-b4d1-48f6-b1c1-f2d0813801f9 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:37.525093 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-193c8a13-b4d1-48f6-b1c1-f2d0813801f9 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:37.979051 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ef01063f-7e7f-4388-82ba-96780fbc9163 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:37.984445 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ef01063f-7e7f-4388-82ba-96780fbc9163 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: ebabcdb6-1a81-4841-a33e-921e67a0d2f6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:38.003175 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:38.027618 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef01063f-7e7f-4388-82ba-96780fbc9163 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:38.028563 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef01063f-7e7f-4388-82ba-96780fbc9163 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:38.041369 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef01063f-7e7f-4388-82ba-96780fbc9163 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:38.041369 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef01063f-7e7f-4388-82ba-96780fbc9163 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:38.440790 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-193c8a13-b4d1-48f6-b1c1-f2d0813801f9 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:38.457026 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-193c8a13-b4d1-48f6-b1c1-f2d0813801f9 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1319 microversion: 2.1 time: 0.978211 Jun 16 14:49:38.460855 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1162/2282] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:37 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1319 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:38.486695 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-81786db8-ca27-475b-878b-86e996bd9d44 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:38.490776 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-81786db8-ca27-475b-878b-86e996bd9d44 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:38.519976 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-81786db8-ca27-475b-878b-86e996bd9d44 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:38.525406 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-81786db8-ca27-475b-878b-86e996bd9d44 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:38.529827 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-81786db8-ca27-475b-878b-86e996bd9d44 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:38.530964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-81786db8-ca27-475b-878b-86e996bd9d44 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:38.944663 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-81786db8-ca27-475b-878b-86e996bd9d44 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:38.990561 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ef01063f-7e7f-4388-82ba-96780fbc9163 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:39.007668 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-81786db8-ca27-475b-878b-86e996bd9d44 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1274 microversion: 2.1 time: 0.542962 Jun 16 14:49:39.013854 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1163/2283] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:38 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1274 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:39.027226 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ef01063f-7e7f-4388-82ba-96780fbc9163 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6" status: 200 len: 1475 microversion: 2.1 time: 1.054579 Jun 16 14:49:39.034523 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1121/2284] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:37 2022] GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6 => generated 1475 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:39.500355 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-40875f54-74e0-4f07-a7a4-454e6c59d115 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:39.505786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-40875f54-74e0-4f07-a7a4-454e6c59d115 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:39.555963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-40875f54-74e0-4f07-a7a4-454e6c59d115 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:39.557761 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-40875f54-74e0-4f07-a7a4-454e6c59d115 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:39.586684 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-40875f54-74e0-4f07-a7a4-454e6c59d115 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:39.590910 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-40875f54-74e0-4f07-a7a4-454e6c59d115 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:39.809385 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-76403412-12bf-4781-939d-9a1d77b5434f req-12c0636d-1134-4b2e-a586-e8fb79e3ff63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459d1e53-76b9-48a6-819b-9718e32f6f76", "name": "network-vif-deleted", "tag": "710e4f94-9261-4fcb-9d50-6b753fda429f"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:39.891279 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-76403412-12bf-4781-939d-9a1d77b5434f req-12c0636d-1134-4b2e-a586-e8fb79e3ff63 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:39.899554 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-76403412-12bf-4781-939d-9a1d77b5434f req-12c0636d-1134-4b2e-a586-e8fb79e3ff63 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:39.986089 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-76403412-12bf-4781-939d-9a1d77b5434f req-12c0636d-1134-4b2e-a586-e8fb79e3ff63 service nova] Creating event network-vif-deleted:710e4f94-9261-4fcb-9d50-6b753fda429f for instance 459d1e53-76b9-48a6-819b-9718e32f6f76 on n-h1-836830-4 Jun 16 14:49:40.018978 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-76403412-12bf-4781-939d-9a1d77b5434f req-12c0636d-1134-4b2e-a586-e8fb79e3ff63 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222399 Jun 16 14:49:40.026021 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1122/2285] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:40.054600 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9c56755b-8067-4288-8cfc-d4f4e0aaffea tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:40.056008 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9c56755b-8067-4288-8cfc-d4f4e0aaffea tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:40.099593 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9c56755b-8067-4288-8cfc-d4f4e0aaffea tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:40.100771 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9c56755b-8067-4288-8cfc-d4f4e0aaffea tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:40.103705 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9c56755b-8067-4288-8cfc-d4f4e0aaffea tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:40.107919 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9c56755b-8067-4288-8cfc-d4f4e0aaffea tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:40.251943 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-40875f54-74e0-4f07-a7a4-454e6c59d115 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:40.289351 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-40875f54-74e0-4f07-a7a4-454e6c59d115 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1319 microversion: 2.1 time: 0.802868 Jun 16 14:49:40.290435 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1164/2286] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:39 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1319 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:40.317684 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:40.329235 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f11b9304-3727-4e3f-8a2d-e752e4317154 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:40.332492 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f11b9304-3727-4e3f-8a2d-e752e4317154 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: ebabcdb6-1a81-4841-a33e-921e67a0d2f6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:40.361761 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f11b9304-3727-4e3f-8a2d-e752e4317154 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:40.362599 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f11b9304-3727-4e3f-8a2d-e752e4317154 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:40.364118 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f11b9304-3727-4e3f-8a2d-e752e4317154 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:40.364895 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f11b9304-3727-4e3f-8a2d-e752e4317154 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:40.448659 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=6 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:40.634181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f11b9304-3727-4e3f-8a2d-e752e4317154 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:40.643317 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f11b9304-3727-4e3f-8a2d-e752e4317154 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:40.644772 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-f11b9304-3727-4e3f-8a2d-e752e4317154 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lazy-loading 'fault' on Instance uuid ebabcdb6-1a81-4841-a33e-921e67a0d2f6 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:49:40.717440 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9c56755b-8067-4288-8cfc-d4f4e0aaffea tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:40.755634 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9c56755b-8067-4288-8cfc-d4f4e0aaffea tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1274 microversion: 2.1 time: 0.724324 Jun 16 14:49:40.756753 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1123/2287] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:40 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1274 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:41.322136 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e360a692-d40b-4f96-9083-2ca386e18a74 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:41.326350 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e360a692-d40b-4f96-9083-2ca386e18a74 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:41.347581 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e360a692-d40b-4f96-9083-2ca386e18a74 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:41.353541 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e360a692-d40b-4f96-9083-2ca386e18a74 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:41.355511 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e360a692-d40b-4f96-9083-2ca386e18a74 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:41.358421 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e360a692-d40b-4f96-9083-2ca386e18a74 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:42.022071 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f11b9304-3727-4e3f-8a2d-e752e4317154 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:42.040975 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f11b9304-3727-4e3f-8a2d-e752e4317154 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6" status: 200 len: 1309 microversion: 2.1 time: 1.742745 Jun 16 14:49:42.041690 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1165/2288] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:40 2022] GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6 => generated 1309 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:42.072650 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a489cc9a-3194-4979-a28e-73a0aafc28ae tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:42.073584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a489cc9a-3194-4979-a28e-73a0aafc28ae tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:42.087223 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:42.098500 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a489cc9a-3194-4979-a28e-73a0aafc28ae tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:42.101807 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a489cc9a-3194-4979-a28e-73a0aafc28ae tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:42.103891 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a489cc9a-3194-4979-a28e-73a0aafc28ae tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:42.106612 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a489cc9a-3194-4979-a28e-73a0aafc28ae tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:42.198623 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e360a692-d40b-4f96-9083-2ca386e18a74 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:42.234031 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e360a692-d40b-4f96-9083-2ca386e18a74 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1319 microversion: 2.1 time: 0.918662 Jun 16 14:49:42.241613 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1124/2289] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:41 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1319 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:42.252131 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-b164986d-b2d6-4255-b6a3-f8a9159bc4d7 req-4771a107-1113-4a42-81c6-8b4fb0a8b74a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebabcdb6-1a81-4841-a33e-921e67a0d2f6", "name": "network-vif-deleted", "tag": "8f89bbb6-77f8-45b7-9492-458a024a5387"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:42.292188 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-b164986d-b2d6-4255-b6a3-f8a9159bc4d7 req-4771a107-1113-4a42-81c6-8b4fb0a8b74a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:42.294010 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-b164986d-b2d6-4255-b6a3-f8a9159bc4d7 req-4771a107-1113-4a42-81c6-8b4fb0a8b74a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:42.329055 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-b164986d-b2d6-4255-b6a3-f8a9159bc4d7 req-4771a107-1113-4a42-81c6-8b4fb0a8b74a service nova] Creating event network-vif-deleted:8f89bbb6-77f8-45b7-9492-458a024a5387 for instance ebabcdb6-1a81-4841-a33e-921e67a0d2f6 on n-h1-836830-4 Jun 16 14:49:42.354229 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-b164986d-b2d6-4255-b6a3-f8a9159bc4d7 req-4771a107-1113-4a42-81c6-8b4fb0a8b74a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109739 Jun 16 14:49:42.360076 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1125/2290] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:43.077231 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a2ee2e08-40dd-406b-a952-6b7cb9c4be27 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:43.093110 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a2ee2e08-40dd-406b-a952-6b7cb9c4be27 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: ebabcdb6-1a81-4841-a33e-921e67a0d2f6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:43.121468 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a2ee2e08-40dd-406b-a952-6b7cb9c4be27 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:43.122693 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a2ee2e08-40dd-406b-a952-6b7cb9c4be27 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:43.128775 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a2ee2e08-40dd-406b-a952-6b7cb9c4be27 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:43.130003 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a2ee2e08-40dd-406b-a952-6b7cb9c4be27 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:43.169556 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-a2ee2e08-40dd-406b-a952-6b7cb9c4be27 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] HTTP exception thrown: Instance ebabcdb6-1a81-4841-a33e-921e67a0d2f6 could not be found. Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a2ee2e08-40dd-406b-a952-6b7cb9c4be27 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Request method failure captured: Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6 HTTP/1.1 Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0HYDWK04k6vDj2W3DKvKiJ3grVSO6yw5Re07xNYsMLFGaw4PP0IsO014SYFozYYzMejGdOVwzaZAGhULCpC5BC_U8Zk-i7zmM_tR7aE8CHBq2lggTmOdHzG41N8cFL94bF10zdnGrevWMKipIdDv40OeFO1i2fgtLdfe8Q9RdAwHTI Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:49:43.177435 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:49:43.178769 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f00d93de6d784ffdbbfbfe050b70e4a8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f00d93de6d784ffdbbfbfe050b70e4a8"}]}] Jun 16 14:49:43.178769 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:43.178769 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:43.178769 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:43.178769 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:43.178769 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:49:43.178769 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:49:43.178769 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 70569cb340194ec0876d91d79cc6fa5f Jun 16 14:49:43.178769 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:43.178769 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:49:43.178769 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance ebabcdb6-1a81-4841-a33e-921e67a0d2f6 could not be found. Jun 16 14:49:43.178769 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'ebabcdb6-1a81-4841-a33e-921e67a0d2f6'} Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebabcdb6-1a81-4841-a33e-921e67a0d2f6 could not be found. Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:43.179429 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebabcdb6-1a81-4841-a33e-921e67a0d2f6 could not be found. Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebabcdb6-1a81-4841-a33e-921e67a0d2f6 could not be found. Jun 16 14:49:43.180509 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:43.194783 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a2ee2e08-40dd-406b-a952-6b7cb9c4be27 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Returning 404 to user: Instance ebabcdb6-1a81-4841-a33e-921e67a0d2f6 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:43.196270 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a2ee2e08-40dd-406b-a952-6b7cb9c4be27 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6" status: 404 len: 111 microversion: 2.1 time: 0.127553 Jun 16 14:49:43.197520 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1126/2291] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:43 2022] GET /compute/v2.1/servers/ebabcdb6-1a81-4841-a33e-921e67a0d2f6 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:43.282543 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a489cc9a-3194-4979-a28e-73a0aafc28ae tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:43.325537 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a489cc9a-3194-4979-a28e-73a0aafc28ae tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1274 microversion: 2.1 time: 1.274285 Jun 16 14:49:43.341348 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1166/2292] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:42 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1274 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:43.380337 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7e50ec74-1666-42ed-9db4-43b12ec7f6f4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:43.381367 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7e50ec74-1666-42ed-9db4-43b12ec7f6f4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:43.401423 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7e50ec74-1666-42ed-9db4-43b12ec7f6f4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:43.402062 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7e50ec74-1666-42ed-9db4-43b12ec7f6f4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:43.407605 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7e50ec74-1666-42ed-9db4-43b12ec7f6f4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:43.408236 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7e50ec74-1666-42ed-9db4-43b12ec7f6f4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:43.945751 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0a06461f-254b-499d-bdc6-72e2c858a5d4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:43.947138 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0a06461f-254b-499d-bdc6-72e2c858a5d4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 459d1e53-76b9-48a6-819b-9718e32f6f76] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:43.978103 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0a06461f-254b-499d-bdc6-72e2c858a5d4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:43.978872 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0a06461f-254b-499d-bdc6-72e2c858a5d4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:43.985838 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0a06461f-254b-499d-bdc6-72e2c858a5d4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:43.991869 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0a06461f-254b-499d-bdc6-72e2c858a5d4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:44.114257 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-0a06461f-254b-499d-bdc6-72e2c858a5d4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] HTTP exception thrown: Instance 459d1e53-76b9-48a6-819b-9718e32f6f76 could not be found. Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0a06461f-254b-499d-bdc6-72e2c858a5d4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Request method failure captured: Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 HTTP/1.1 Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0HYDWK04k6vDj2W3DKvKiJ3grVSO6yw5Re07xNYsMLFGaw4PP0IsO014SYFozYYzMejGdOVwzaZAGhULCpC5BC_U8Zk-i7zmM_tR7aE8CHBq2lggTmOdHzG41N8cFL94bF10zdnGrevWMKipIdDv40OeFO1i2fgtLdfe8Q9RdAwHTI Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:49:44.123151 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:49:44.125922 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f00d93de6d784ffdbbfbfe050b70e4a8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f00d93de6d784ffdbbfbfe050b70e4a8"}]}] Jun 16 14:49:44.125922 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:44.125922 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:44.125922 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:44.125922 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:44.125922 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:49:44.125922 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:49:44.125922 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 70569cb340194ec0876d91d79cc6fa5f Jun 16 14:49:44.125922 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:44.125922 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:49:44.125922 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 459d1e53-76b9-48a6-819b-9718e32f6f76 could not be found. Jun 16 14:49:44.125922 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '459d1e53-76b9-48a6-819b-9718e32f6f76'} Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 459d1e53-76b9-48a6-819b-9718e32f6f76 could not be found. Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:44.127410 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 459d1e53-76b9-48a6-819b-9718e32f6f76 could not be found. Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 459d1e53-76b9-48a6-819b-9718e32f6f76 could not be found. Jun 16 14:49:44.129844 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:44.137638 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0a06461f-254b-499d-bdc6-72e2c858a5d4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Returning 404 to user: Instance 459d1e53-76b9-48a6-819b-9718e32f6f76 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:44.140599 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0a06461f-254b-499d-bdc6-72e2c858a5d4 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76" status: 404 len: 111 microversion: 2.1 time: 0.935990 Jun 16 14:49:44.148936 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1127/2293] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:43 2022] GET /compute/v2.1/servers/459d1e53-76b9-48a6-819b-9718e32f6f76 => generated 111 bytes in 945 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:44.170221 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-333d04a2-0924-4c29-be0a-6c7737600ba6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:44.300187 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-333d04a2-0924-4c29-be0a-6c7737600ba6 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "DELETE /compute/v2.1/os-server-groups/1559d51e-ea8d-42f2-8628-45af7c1cb09b" status: 204 len: 0 microversion: 2.1 time: 0.143584 Jun 16 14:49:44.312947 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1128/2294] 10.222.0.57 () {58 vars in 1265 bytes} [Thu Jun 16 14:49:44 2022] DELETE /compute/v2.1/os-server-groups/1559d51e-ea8d-42f2-8628-45af7c1cb09b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:49:44.350683 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cfa41517-38e0-48da-9f06-38d6b5e6c9e1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:44.356552 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cfa41517-38e0-48da-9f06-38d6b5e6c9e1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:44.393414 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cfa41517-38e0-48da-9f06-38d6b5e6c9e1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:44.394236 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cfa41517-38e0-48da-9f06-38d6b5e6c9e1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:44.396024 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cfa41517-38e0-48da-9f06-38d6b5e6c9e1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:44.397140 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cfa41517-38e0-48da-9f06-38d6b5e6c9e1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:44.484163 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cfa41517-38e0-48da-9f06-38d6b5e6c9e1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:49:44.665518 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cfa41517-38e0-48da-9f06-38d6b5e6c9e1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 204 len: 0 microversion: 2.1 time: 0.349917 Jun 16 14:49:44.666494 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1129/2295] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:49:44 2022] DELETE /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:49:44.683336 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4d6e8153-24e8-4af8-b75c-7a4db2d1f96b tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:44.684630 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4d6e8153-24e8-4af8-b75c-7a4db2d1f96b tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:44.696982 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d6e8153-24e8-4af8-b75c-7a4db2d1f96b tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:44.697449 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d6e8153-24e8-4af8-b75c-7a4db2d1f96b tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:44.703102 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d6e8153-24e8-4af8-b75c-7a4db2d1f96b tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:44.703711 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d6e8153-24e8-4af8-b75c-7a4db2d1f96b tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:45.036383 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4d6e8153-24e8-4af8-b75c-7a4db2d1f96b tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:45.045787 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4d6e8153-24e8-4af8-b75c-7a4db2d1f96b tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1274 microversion: 2.1 time: 0.377968 Jun 16 14:49:45.046701 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1130/2296] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:44 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1274 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:45.056240 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-02ece05e-8726-450f-8960-ee8b8ff23367 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:45.057145 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-02ece05e-8726-450f-8960-ee8b8ff23367 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:45.074173 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-02ece05e-8726-450f-8960-ee8b8ff23367 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:45.075452 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-02ece05e-8726-450f-8960-ee8b8ff23367 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:45.076452 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-02ece05e-8726-450f-8960-ee8b8ff23367 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:45.077126 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-02ece05e-8726-450f-8960-ee8b8ff23367 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:45.106971 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7e50ec74-1666-42ed-9db4-43b12ec7f6f4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:45.136329 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7e50ec74-1666-42ed-9db4-43b12ec7f6f4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1319 microversion: 2.1 time: 1.789246 Jun 16 14:49:45.147101 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1167/2297] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:43 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1319 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:45.156844 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-f6ec4210-f555-44f0-9b3f-2f08ed08af46 req-cf40d345-5c79-4434-afc9-f119598578df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c12ef1f-2dc9-41e9-b5dc-c677801c691f", "tag": "991c50ac-177d-4a27-abc8-28ea3f729d88"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:45.194797 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-f6ec4210-f555-44f0-9b3f-2f08ed08af46 req-cf40d345-5c79-4434-afc9-f119598578df service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:45.195634 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-f6ec4210-f555-44f0-9b3f-2f08ed08af46 req-cf40d345-5c79-4434-afc9-f119598578df service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:45.254563 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-f6ec4210-f555-44f0-9b3f-2f08ed08af46 req-cf40d345-5c79-4434-afc9-f119598578df service nova] Creating event network-changed:991c50ac-177d-4a27-abc8-28ea3f729d88 for instance 9c12ef1f-2dc9-41e9-b5dc-c677801c691f on n-h2-836830-4 Jun 16 14:49:45.268878 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-f6ec4210-f555-44f0-9b3f-2f08ed08af46 req-cf40d345-5c79-4434-afc9-f119598578df service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119591 Jun 16 14:49:45.269608 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1168/2298] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:46.005374 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-02ece05e-8726-450f-8960-ee8b8ff23367 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:46.014559 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-02ece05e-8726-450f-8960-ee8b8ff23367 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1472 microversion: 2.1 time: 0.966431 Jun 16 14:49:46.018763 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1131/2299] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:45 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1472 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:46.093157 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ca8f6d48-a5c4-40ef-8e26-f6b964313ccd tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:46.096234 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ca8f6d48-a5c4-40ef-8e26-f6b964313ccd tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:46.112704 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca8f6d48-a5c4-40ef-8e26-f6b964313ccd tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:46.114969 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca8f6d48-a5c4-40ef-8e26-f6b964313ccd tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:46.117049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca8f6d48-a5c4-40ef-8e26-f6b964313ccd tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:46.118181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca8f6d48-a5c4-40ef-8e26-f6b964313ccd tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:46.168967 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-31f2b941-4668-4ceb-9148-e656c1725f71 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:46.175261 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-31f2b941-4668-4ceb-9148-e656c1725f71 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:46.213301 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31f2b941-4668-4ceb-9148-e656c1725f71 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:46.215025 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31f2b941-4668-4ceb-9148-e656c1725f71 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:46.217257 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31f2b941-4668-4ceb-9148-e656c1725f71 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:46.218238 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-31f2b941-4668-4ceb-9148-e656c1725f71 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:46.288859 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:46.750225 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-31f2b941-4668-4ceb-9148-e656c1725f71 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:46.759248 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-31f2b941-4668-4ceb-9148-e656c1725f71 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1319 microversion: 2.1 time: 0.598687 Jun 16 14:49:46.759861 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1132/2300] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:46 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1319 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:47.046239 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-44986cdd-0c92-4cfb-8b9c-68814a1b1bdb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:47.046847 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-44986cdd-0c92-4cfb-8b9c-68814a1b1bdb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:47.059983 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44986cdd-0c92-4cfb-8b9c-68814a1b1bdb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:47.060481 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44986cdd-0c92-4cfb-8b9c-68814a1b1bdb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:47.061400 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44986cdd-0c92-4cfb-8b9c-68814a1b1bdb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:47.061974 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-44986cdd-0c92-4cfb-8b9c-68814a1b1bdb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:47.611308 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ca8f6d48-a5c4-40ef-8e26-f6b964313ccd tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:47.623232 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ca8f6d48-a5c4-40ef-8e26-f6b964313ccd tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1316 microversion: 2.1 time: 1.551955 Jun 16 14:49:47.632248 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1169/2301] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:46 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1316 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:47.797372 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-07f3d4d7-373a-4517-9b9b-d5ea6f226e85 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:47.798275 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-07f3d4d7-373a-4517-9b9b-d5ea6f226e85 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:47.812901 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07f3d4d7-373a-4517-9b9b-d5ea6f226e85 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:47.813780 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07f3d4d7-373a-4517-9b9b-d5ea6f226e85 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:47.815157 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07f3d4d7-373a-4517-9b9b-d5ea6f226e85 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:47.816078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07f3d4d7-373a-4517-9b9b-d5ea6f226e85 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:48.757263 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-44986cdd-0c92-4cfb-8b9c-68814a1b1bdb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:48.773286 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-44986cdd-0c92-4cfb-8b9c-68814a1b1bdb tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1472 microversion: 2.1 time: 1.731351 Jun 16 14:49:48.782513 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1133/2302] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:47 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1472 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:48.788788 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2924ab6d-988a-4c80-9cf7-25688dd4da6a tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:48.789900 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2924ab6d-988a-4c80-9cf7-25688dd4da6a tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:48.803692 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2924ab6d-988a-4c80-9cf7-25688dd4da6a tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:48.805084 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2924ab6d-988a-4c80-9cf7-25688dd4da6a tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:48.807300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2924ab6d-988a-4c80-9cf7-25688dd4da6a tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:48.808396 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2924ab6d-988a-4c80-9cf7-25688dd4da6a tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:49.195505 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-07f3d4d7-373a-4517-9b9b-d5ea6f226e85 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:49.223086 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-07f3d4d7-373a-4517-9b9b-d5ea6f226e85 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1319 microversion: 2.1 time: 1.429940 Jun 16 14:49:49.229197 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1170/2303] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:47 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1319 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:49.685324 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-551650b4-0c09-46e7-9dd2-3c2de0c37377 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:49.722243 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-551650b4-0c09-46e7-9dd2-3c2de0c37377 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.490477 Jun 16 14:49:49.729745 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1171/2304] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:49:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:49.753009 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1698a4c7-9be8-4513-bf22-376638f5cd20 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:49.829085 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1698a4c7-9be8-4513-bf22-376638f5cd20 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.089998 Jun 16 14:49:49.831285 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1172/2305] 10.222.0.57 () {58 vars in 1124 bytes} [Thu Jun 16 14:49:49 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:49.842581 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-92651bed-a557-4d98-9d3c-0364a62fe7d8 req-7dd66da1-2eb5-40e0-ab27-38152e821e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d23270-9297-4a55-8d4c-022f8ffcedf6", "name": "network-vif-plugged", "status": "completed", "tag": "c8f6b10d-ca3a-483e-a435-128bb7a6a621"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:49.862026 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-92651bed-a557-4d98-9d3c-0364a62fe7d8 req-7dd66da1-2eb5-40e0-ab27-38152e821e30 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:49.870480 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-92651bed-a557-4d98-9d3c-0364a62fe7d8 req-7dd66da1-2eb5-40e0-ab27-38152e821e30 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:49.921734 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-92651bed-a557-4d98-9d3c-0364a62fe7d8 req-7dd66da1-2eb5-40e0-ab27-38152e821e30 service nova] Creating event network-vif-plugged:c8f6b10d-ca3a-483e-a435-128bb7a6a621 for instance e6d23270-9297-4a55-8d4c-022f8ffcedf6 on n-h2-836830-4 Jun 16 14:49:49.952251 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-92651bed-a557-4d98-9d3c-0364a62fe7d8 req-7dd66da1-2eb5-40e0-ab27-38152e821e30 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116395 Jun 16 14:49:49.964201 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1173/2306] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:49.991307 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-651c1089-0eab-45d4-b03a-5f0e8967cee1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:49.993365 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-651c1089-0eab-45d4-b03a-5f0e8967cee1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:50.020920 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-651c1089-0eab-45d4-b03a-5f0e8967cee1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:50.023361 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-651c1089-0eab-45d4-b03a-5f0e8967cee1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:50.025299 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-651c1089-0eab-45d4-b03a-5f0e8967cee1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:50.033283 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-651c1089-0eab-45d4-b03a-5f0e8967cee1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:50.292592 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2924ab6d-988a-4c80-9cf7-25688dd4da6a tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:50.325717 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2924ab6d-988a-4c80-9cf7-25688dd4da6a tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1316 microversion: 2.1 time: 1.547341 Jun 16 14:49:50.349021 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1134/2307] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:48 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1316 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:50.378564 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-911deec1-941a-457d-90f5-fc92e6b999a6 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:50.406266 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-911deec1-941a-457d-90f5-fc92e6b999a6 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.051419 Jun 16 14:49:50.408217 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1135/2308] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:49:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:50.416928 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d3f43de7-db5d-454d-b687-87d11799e21d tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:50.419109 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d3f43de7-db5d-454d-b687-87d11799e21d tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:50.432485 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3f43de7-db5d-454d-b687-87d11799e21d tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:50.433712 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3f43de7-db5d-454d-b687-87d11799e21d tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:50.435942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3f43de7-db5d-454d-b687-87d11799e21d tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:50.436879 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d3f43de7-db5d-454d-b687-87d11799e21d tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:51.398238 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-651c1089-0eab-45d4-b03a-5f0e8967cee1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:51.442812 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-651c1089-0eab-45d4-b03a-5f0e8967cee1 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1472 microversion: 2.1 time: 1.471000 Jun 16 14:49:51.446516 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1174/2309] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:49 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1472 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:51.488196 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0272ec3b-72cd-46b9-a546-496fd2770f73 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:51.502888 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d3f43de7-db5d-454d-b687-87d11799e21d tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:51.517062 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d3f43de7-db5d-454d-b687-87d11799e21d tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1319 microversion: 2.1 time: 1.104103 Jun 16 14:49:51.518922 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1136/2310] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:50 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1319 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:51.519317 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0272ec3b-72cd-46b9-a546-496fd2770f73 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.066684 Jun 16 14:49:51.523666 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1175/2311] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:49:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:51.529779 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-09851bbc-468a-49f4-86c0-c5804e44df99 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:51.535171 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-09851bbc-468a-49f4-86c0-c5804e44df99 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:51.554366 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-09851bbc-468a-49f4-86c0-c5804e44df99 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:51.555605 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-09851bbc-468a-49f4-86c0-c5804e44df99 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:51.557210 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-09851bbc-468a-49f4-86c0-c5804e44df99 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:51.558312 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-09851bbc-468a-49f4-86c0-c5804e44df99 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:51.558539 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f84a58b6-568f-48d8-be90-6bf36a4e2b13 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:51.686429 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f84a58b6-568f-48d8-be90-6bf36a4e2b13 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.136665 Jun 16 14:49:51.688165 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1176/2312] 10.222.0.57 () {58 vars in 1164 bytes} [Thu Jun 16 14:49:51 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:51.724809 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-31088c60-7d96-4a87-9da3-68c79136a50d tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:51.750162 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-31088c60-7d96-4a87-9da3-68c79136a50d tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042962 Jun 16 14:49:51.751879 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1177/2313] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:49:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:51.771384 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-30b1b20a-2a10-4e0e-827e-3233b4f6b33d tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:51.828802 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-30b1b20a-2a10-4e0e-827e-3233b4f6b33d tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.065290 Jun 16 14:49:51.844268 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1178/2314] 10.222.0.57 () {58 vars in 1168 bytes} [Thu Jun 16 14:49:51 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:51.862128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6d33d522-3377-45f5-be58-53eec8f825e4 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:51.926575 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6d33d522-3377-45f5-be58-53eec8f825e4 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.055665 Jun 16 14:49:51.944430 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1179/2315] 10.222.0.57 () {58 vars in 1160 bytes} [Thu Jun 16 14:49:51 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:51.944430 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-34603a43-38f5-4aab-9364-eb9a590d1adb tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:51.953158 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-34603a43-38f5-4aab-9364-eb9a590d1adb tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015549 Jun 16 14:49:51.956875 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1180/2316] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:49:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:51.974657 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-178e4e7b-7272-4904-bed6-255df089ea69 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:52.073643 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-178e4e7b-7272-4904-bed6-255df089ea69 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.107071 Jun 16 14:49:52.075231 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1181/2317] 10.222.0.57 () {58 vars in 1166 bytes} [Thu Jun 16 14:49:51 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:52.088666 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-21a75394-1854-4f3c-b000-ba5552489582 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:52.109999 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-21a75394-1854-4f3c-b000-ba5552489582 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025078 Jun 16 14:49:52.111283 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1182/2318] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:49:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:52.123052 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c0a2f725-a60d-4620-9594-76b12a50eca0 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:52.200239 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c0a2f725-a60d-4620-9594-76b12a50eca0 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.082013 Jun 16 14:49:52.209678 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1183/2319] 10.222.0.57 () {58 vars in 1143 bytes} [Thu Jun 16 14:49:52 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:52.225043 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-81658559-bf50-429f-9175-9ee0f03ad4ac tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:52.248844 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-81658559-bf50-429f-9175-9ee0f03ad4ac tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037661 Jun 16 14:49:52.256578 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1184/2320] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:49:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:52.285834 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6d3d91cd-0d9e-4bef-94b8-b315c1b97600 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:52.343189 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6d3d91cd-0d9e-4bef-94b8-b315c1b97600 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.085304 Jun 16 14:49:52.346491 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1185/2321] 10.222.0.57 () {58 vars in 1147 bytes} [Thu Jun 16 14:49:52 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:52.374762 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-89861afc-6856-4515-9430-c613316d5a7d req-25b7ffe6-1214-4939-ac54-00fe715339ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24da35f6-76a6-4bb9-8b00-9408845d6289", "tag": "45b4b68d-7250-4ba3-8453-0fbbb0deac78"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:52.402015 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-89861afc-6856-4515-9430-c613316d5a7d req-25b7ffe6-1214-4939-ac54-00fe715339ff service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:52.416683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-89861afc-6856-4515-9430-c613316d5a7d req-25b7ffe6-1214-4939-ac54-00fe715339ff service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:52.441714 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-89861afc-6856-4515-9430-c613316d5a7d req-25b7ffe6-1214-4939-ac54-00fe715339ff service nova] Creating event network-changed:45b4b68d-7250-4ba3-8453-0fbbb0deac78 for instance 24da35f6-76a6-4bb9-8b00-9408845d6289 on n-h1-836830-4 Jun 16 14:49:52.481320 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-89861afc-6856-4515-9430-c613316d5a7d req-25b7ffe6-1214-4939-ac54-00fe715339ff service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116212 Jun 16 14:49:52.482641 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1186/2322] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:52.504714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-608f6c6f-92da-46e3-8551-d8752339926a tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:52.528053 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-608f6c6f-92da-46e3-8551-d8752339926a tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.043474 Jun 16 14:49:52.528980 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1187/2323] 10.222.0.57 () {58 vars in 1139 bytes} [Thu Jun 16 14:49:52 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:52.542194 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7fccd737-4b84-48e7-9a5e-9d70ece5beef tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:52.544708 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7fccd737-4b84-48e7-9a5e-9d70ece5beef tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:52.553652 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7fccd737-4b84-48e7-9a5e-9d70ece5beef tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:52.554562 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7fccd737-4b84-48e7-9a5e-9d70ece5beef tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:52.555645 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7fccd737-4b84-48e7-9a5e-9d70ece5beef tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:52.556290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7fccd737-4b84-48e7-9a5e-9d70ece5beef tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:52.622802 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:52.993772 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7fccd737-4b84-48e7-9a5e-9d70ece5beef tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:53.013288 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-09851bbc-468a-49f4-86c0-c5804e44df99 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:53.024618 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-09851bbc-468a-49f4-86c0-c5804e44df99 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1316 microversion: 2.1 time: 1.503776 Jun 16 14:49:53.033444 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1137/2324] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:51 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1316 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:53.049033 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0f31facd-7a0f-42ae-9b6f-7cb8ac81734f tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:53.056028 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7fccd737-4b84-48e7-9a5e-9d70ece5beef tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1430 microversion: 2.1 time: 0.519266 Jun 16 14:49:53.057636 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1188/2325] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:52 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1430 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:53.070523 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0f31facd-7a0f-42ae-9b6f-7cb8ac81734f tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035186 Jun 16 14:49:53.071135 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1138/2326] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:49:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:53.087754 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cce8d98b-70d0-4050-a7d7-3c0274e5b8ba tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:53.094352 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-95e3a38a-dcc0-49a2-8f2e-84dcd099eedc tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:53.096160 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-95e3a38a-dcc0-49a2-8f2e-84dcd099eedc tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:53.117434 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-95e3a38a-dcc0-49a2-8f2e-84dcd099eedc tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:53.118966 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-95e3a38a-dcc0-49a2-8f2e-84dcd099eedc tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:53.121807 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-95e3a38a-dcc0-49a2-8f2e-84dcd099eedc tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:53.124773 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-95e3a38a-dcc0-49a2-8f2e-84dcd099eedc tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:53.171206 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cce8d98b-70d0-4050-a7d7-3c0274e5b8ba tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.092075 Jun 16 14:49:53.172531 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1139/2327] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:49:53 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:53.186086 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5cb671d8-dda3-4959-9642-3d2f5ced3a3e tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:53.220478 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5cb671d8-dda3-4959-9642-3d2f5ced3a3e tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039028 Jun 16 14:49:53.241564 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1140/2328] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:49:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:53.252179 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-93fde5ba-7998-4ede-904f-13fc97115d62 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:53.264041 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-93fde5ba-7998-4ede-904f-13fc97115d62 tempest-FlavorsV2TestJSON-393757723 tempest-FlavorsV2TestJSON-393757723-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020802 Jun 16 14:49:53.273726 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1141/2329] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:49:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:53.359941 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-8e1d404e-9313-471b-b554-55e1a857b6f3 req-13edb109-1fb7-4ea4-a3e5-5df4bb9e36dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc", "name": "network-vif-deleted", "tag": "05c0eff0-1b94-46e0-bbf5-a7cf99df002c"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:53.423662 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-8e1d404e-9313-471b-b554-55e1a857b6f3 req-13edb109-1fb7-4ea4-a3e5-5df4bb9e36dc service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:53.425028 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-8e1d404e-9313-471b-b554-55e1a857b6f3 req-13edb109-1fb7-4ea4-a3e5-5df4bb9e36dc service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:53.491033 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-8e1d404e-9313-471b-b554-55e1a857b6f3 req-13edb109-1fb7-4ea4-a3e5-5df4bb9e36dc service nova] Creating event network-vif-deleted:05c0eff0-1b94-46e0-bbf5-a7cf99df002c for instance 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc on n-h2-836830-4 Jun 16 14:49:53.517254 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-8e1d404e-9313-471b-b554-55e1a857b6f3 req-13edb109-1fb7-4ea4-a3e5-5df4bb9e36dc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172729 Jun 16 14:49:53.526964 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1142/2330] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:49:54.070004 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-977ea150-2c72-42d9-8653-06dfa0db2999 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:54.080159 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-977ea150-2c72-42d9-8653-06dfa0db2999 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:54.097398 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-977ea150-2c72-42d9-8653-06dfa0db2999 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:54.098106 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-977ea150-2c72-42d9-8653-06dfa0db2999 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:54.099109 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-977ea150-2c72-42d9-8653-06dfa0db2999 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:54.099719 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-977ea150-2c72-42d9-8653-06dfa0db2999 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:54.196353 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-95e3a38a-dcc0-49a2-8f2e-84dcd099eedc tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:54.206169 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-95e3a38a-dcc0-49a2-8f2e-84dcd099eedc tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 200 len: 1506 microversion: 2.1 time: 1.145723 Jun 16 14:49:54.215956 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1189/2331] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:53 2022] GET /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 1506 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:54.237932 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e673164e-a3a3-4b18-acb9-22216381a087 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:54.241098 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e673164e-a3a3-4b18-acb9-22216381a087 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:54.256590 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e673164e-a3a3-4b18-acb9-22216381a087 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:54.263206 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e673164e-a3a3-4b18-acb9-22216381a087 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:54.264814 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e673164e-a3a3-4b18-acb9-22216381a087 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:54.265980 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e673164e-a3a3-4b18-acb9-22216381a087 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:54.352632 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e673164e-a3a3-4b18-acb9-22216381a087 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:54.353106 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e673164e-a3a3-4b18-acb9-22216381a087 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:54.359778 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-e673164e-a3a3-4b18-acb9-22216381a087 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lazy-loading 'fault' on Instance uuid 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:49:54.644878 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e673164e-a3a3-4b18-acb9-22216381a087 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70569cb340194ec0876d91d79cc6fa5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f00d93de6d784ffdbbfbfe050b70e4a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:54.656882 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e673164e-a3a3-4b18-acb9-22216381a087 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 200 len: 1306 microversion: 2.1 time: 0.439111 Jun 16 14:49:54.658554 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1190/2332] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:54 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 1306 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:54.674837 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b2a060e7-48a6-42a9-98d6-da5ebfc6de8e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:54.675581 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b2a060e7-48a6-42a9-98d6-da5ebfc6de8e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 9c12ef1f-2dc9-41e9-b5dc-c677801c691f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:54.700786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2a060e7-48a6-42a9-98d6-da5ebfc6de8e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:54.700786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2a060e7-48a6-42a9-98d6-da5ebfc6de8e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:54.704149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2a060e7-48a6-42a9-98d6-da5ebfc6de8e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:54.706058 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2a060e7-48a6-42a9-98d6-da5ebfc6de8e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:54.931087 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-977ea150-2c72-42d9-8653-06dfa0db2999 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:54.967620 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-977ea150-2c72-42d9-8653-06dfa0db2999 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1316 microversion: 2.1 time: 0.914914 Jun 16 14:49:54.972631 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1143/2333] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:54 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1316 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:55.070775 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-9cf903a5-0681-4a4e-aba8-2068bf7aac3c req-8bcec98e-ee94-4167-9ada-e5918ef081bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c12ef1f-2dc9-41e9-b5dc-c677801c691f", "name": "network-vif-plugged", "status": "completed", "tag": "991c50ac-177d-4a27-abc8-28ea3f729d88"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:55.098809 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-9cf903a5-0681-4a4e-aba8-2068bf7aac3c req-8bcec98e-ee94-4167-9ada-e5918ef081bc service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:55.099881 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-9cf903a5-0681-4a4e-aba8-2068bf7aac3c req-8bcec98e-ee94-4167-9ada-e5918ef081bc service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:55.126210 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-9cf903a5-0681-4a4e-aba8-2068bf7aac3c req-8bcec98e-ee94-4167-9ada-e5918ef081bc service nova] Creating event network-vif-plugged:991c50ac-177d-4a27-abc8-28ea3f729d88 for instance 9c12ef1f-2dc9-41e9-b5dc-c677801c691f on n-h2-836830-4 Jun 16 14:49:55.141200 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-9cf903a5-0681-4a4e-aba8-2068bf7aac3c req-8bcec98e-ee94-4167-9ada-e5918ef081bc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076347 Jun 16 14:49:55.142241 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1144/2334] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:55.701895 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-380d8013-5bc9-4564-9d3b-85fe81f9f9e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:55.713281 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-380d8013-5bc9-4564-9d3b-85fe81f9f9e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] [instance: 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:55.771168 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-380d8013-5bc9-4564-9d3b-85fe81f9f9e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:55.774668 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-380d8013-5bc9-4564-9d3b-85fe81f9f9e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:55.776473 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-380d8013-5bc9-4564-9d3b-85fe81f9f9e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:55.790991 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-380d8013-5bc9-4564-9d3b-85fe81f9f9e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:55.853464 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-380d8013-5bc9-4564-9d3b-85fe81f9f9e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] HTTP exception thrown: Instance 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc could not be found. Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-380d8013-5bc9-4564-9d3b-85fe81f9f9e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Request method failure captured: Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc HTTP/1.1 Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0HYDWK04k6vDj2W3DKvKiJ3grVSO6yw5Re07xNYsMLFGaw4PP0IsO014SYFozYYzMejGdOVwzaZAGhULCpC5BC_U8Zk-i7zmM_tR7aE8CHBq2lggTmOdHzG41N8cFL94bF10zdnGrevWMKipIdDv40OeFO1i2fgtLdfe8Q9RdAwHTI Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:49:55.857617 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:49:55.859022 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f00d93de6d784ffdbbfbfe050b70e4a8", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f00d93de6d784ffdbbfbfe050b70e4a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f00d93de6d784ffdbbfbfe050b70e4a8"}]}] Jun 16 14:49:55.859022 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:55.859022 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: f00d93de6d784ffdbbfbfe050b70e4a8 Jun 16 14:49:55.859022 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2118918086 Jun 16 14:49:55.859022 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:55.859022 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:49:55.859022 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:49:55.859022 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 70569cb340194ec0876d91d79cc6fa5f Jun 16 14:49:55.859022 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServersOnMultiNodesTest-2118918086-project Jun 16 14:49:55.859022 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:49:55.859022 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc could not be found. Jun 16 14:49:55.859022 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc'} Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc could not be found. Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:49:55.859720 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc could not be found. Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc could not be found. Jun 16 14:49:55.860871 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:49:55.861984 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-380d8013-5bc9-4564-9d3b-85fe81f9f9e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] Returning 404 to user: Instance 6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:49:55.864008 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-380d8013-5bc9-4564-9d3b-85fe81f9f9e8 tempest-ServersOnMultiNodesTest-2118918086 tempest-ServersOnMultiNodesTest-2118918086-project] 10.222.0.57 "GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc" status: 404 len: 111 microversion: 2.1 time: 0.184725 Jun 16 14:49:55.865226 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1145/2335] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:55 2022] GET /compute/v2.1/servers/6df19c8c-29d4-4ca8-8d4a-6c844f6db4fc => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:49:55.992234 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8d9d8840-e539-4c76-be86-b8ed577e1d21 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:55.992895 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8d9d8840-e539-4c76-be86-b8ed577e1d21 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:56.005327 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8d9d8840-e539-4c76-be86-b8ed577e1d21 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:56.007388 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8d9d8840-e539-4c76-be86-b8ed577e1d21 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:56.008901 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8d9d8840-e539-4c76-be86-b8ed577e1d21 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:56.012753 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8d9d8840-e539-4c76-be86-b8ed577e1d21 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:56.592127 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8d9d8840-e539-4c76-be86-b8ed577e1d21 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:56.626629 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8d9d8840-e539-4c76-be86-b8ed577e1d21 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1316 microversion: 2.1 time: 0.639499 Jun 16 14:49:56.647896 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1146/2336] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:55 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1316 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:56.784502 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b2a060e7-48a6-42a9-98d6-da5ebfc6de8e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:56.803143 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b2a060e7-48a6-42a9-98d6-da5ebfc6de8e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/9c12ef1f-2dc9-41e9-b5dc-c677801c691f" status: 200 len: 1319 microversion: 2.1 time: 2.140125 Jun 16 14:49:56.804427 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1191/2337] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:54 2022] GET /compute/v2.1/servers/9c12ef1f-2dc9-41e9-b5dc-c677801c691f => generated 1319 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:57.668538 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-82096318-ff16-4f39-814f-96ba66799912 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:57.671199 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-82096318-ff16-4f39-814f-96ba66799912 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:57.696227 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-82096318-ff16-4f39-814f-96ba66799912 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:57.697121 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-82096318-ff16-4f39-814f-96ba66799912 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:57.698533 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-82096318-ff16-4f39-814f-96ba66799912 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:57.699735 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-82096318-ff16-4f39-814f-96ba66799912 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:57.837164 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4d56813b-9957-4dfb-a4ad-a42e0259ee77 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:57.841671 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4d56813b-9957-4dfb-a4ad-a42e0259ee77 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 9c12ef1f-2dc9-41e9-b5dc-c677801c691f] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:57.876933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d56813b-9957-4dfb-a4ad-a42e0259ee77 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:57.879677 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d56813b-9957-4dfb-a4ad-a42e0259ee77 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:57.882302 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d56813b-9957-4dfb-a4ad-a42e0259ee77 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:57.886758 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4d56813b-9957-4dfb-a4ad-a42e0259ee77 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:58.521567 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-82096318-ff16-4f39-814f-96ba66799912 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:58.533692 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-82096318-ff16-4f39-814f-96ba66799912 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1316 microversion: 2.1 time: 0.872600 Jun 16 14:49:58.546148 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1147/2338] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:57 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1316 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:58.630958 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-4d56813b-9957-4dfb-a4ad-a42e0259ee77 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:49:58.641643 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4d56813b-9957-4dfb-a4ad-a42e0259ee77 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/9c12ef1f-2dc9-41e9-b5dc-c677801c691f" status: 200 len: 1506 microversion: 2.1 time: 0.813320 Jun 16 14:49:58.643792 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1192/2339] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:57 2022] GET /compute/v2.1/servers/9c12ef1f-2dc9-41e9-b5dc-c677801c691f => generated 1506 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:58.679301 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a864420d-7e80-4dad-a3e2-7d2a813ab224 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:58.681300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a864420d-7e80-4dad-a3e2-7d2a813ab224 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 9c12ef1f-2dc9-41e9-b5dc-c677801c691f] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:58.699395 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a864420d-7e80-4dad-a3e2-7d2a813ab224 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:58.701410 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a864420d-7e80-4dad-a3e2-7d2a813ab224 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:58.703846 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a864420d-7e80-4dad-a3e2-7d2a813ab224 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:58.704876 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a864420d-7e80-4dad-a3e2-7d2a813ab224 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:58.798091 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a864420d-7e80-4dad-a3e2-7d2a813ab224 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 9c12ef1f-2dc9-41e9-b5dc-c677801c691f] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:49:59.042429 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a864420d-7e80-4dad-a3e2-7d2a813ab224 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9c12ef1f-2dc9-41e9-b5dc-c677801c691f" status: 204 len: 0 microversion: 2.1 time: 0.374789 Jun 16 14:49:59.043568 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1148/2340] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:49:58 2022] DELETE /compute/v2.1/servers/9c12ef1f-2dc9-41e9-b5dc-c677801c691f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 14:49:59.061191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cb7cb5aa-99a5-4b53-adcf-3af25dfb01d8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:59.063066 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cb7cb5aa-99a5-4b53-adcf-3af25dfb01d8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:59.093251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cb7cb5aa-99a5-4b53-adcf-3af25dfb01d8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:59.094657 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cb7cb5aa-99a5-4b53-adcf-3af25dfb01d8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:59.096462 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cb7cb5aa-99a5-4b53-adcf-3af25dfb01d8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:59.103406 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cb7cb5aa-99a5-4b53-adcf-3af25dfb01d8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:59.208813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cb7cb5aa-99a5-4b53-adcf-3af25dfb01d8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: e6d23270-9297-4a55-8d4c-022f8ffcedf6] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:49:59.444367 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cb7cb5aa-99a5-4b53-adcf-3af25dfb01d8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6" status: 204 len: 0 microversion: 2.1 time: 0.391780 Jun 16 14:49:59.445524 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1193/2341] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:49:59 2022] DELETE /compute/v2.1/servers/e6d23270-9297-4a55-8d4c-022f8ffcedf6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 14:49:59.554146 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bbab3088-e741-4fe2-a2ef-3f1dddc147ba tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:59.555267 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bbab3088-e741-4fe2-a2ef-3f1dddc147ba tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:49:59.568514 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bbab3088-e741-4fe2-a2ef-3f1dddc147ba tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:59.577413 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bbab3088-e741-4fe2-a2ef-3f1dddc147ba tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:59.580684 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bbab3088-e741-4fe2-a2ef-3f1dddc147ba tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:49:59.581137 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bbab3088-e741-4fe2-a2ef-3f1dddc147ba tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:49:59.682150 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-686938266", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "63cc44ba-8560-4c05-a818-c3b2c9e1ceda"}]}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:59.900287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] validate_networks() for [('63cc44ba-8560-4c05-a818-c3b2c9e1ceda', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:50:00.244780 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bbab3088-e741-4fe2-a2ef-3f1dddc147ba tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:00.256611 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bbab3088-e741-4fe2-a2ef-3f1dddc147ba tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1316 microversion: 2.1 time: 0.707903 Jun 16 14:50:00.271716 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1149/2342] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:49:59 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1316 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:50:01.929473 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c7cd6c2a-f64d-43bb-b67b-a8a7de0e2afa tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Action: 'create', calling method: .version_select at 0x7fdeffb8b670>, body: {"keypair": {"name": "tempest-keypair-577065716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBau2uhJ6snZs6aOTa+9zLnnD7789MZQtWkVl4ogjTi/YNAu8EBFnj3fF8TmrrwQzk3cPsWTgLimcb0WhhLZXBKHJIfvPfknlW1DFrBJHod83q1LYqmKdvvBcJG4h2QqRA=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:01.988720 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-c7cd6c2a-f64d-43bb-b67b-a8a7de0e2afa tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Getting quotas for project 8f5198d96e9344898c15d63c0aa8615b. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:50:02.017635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-c7cd6c2a-f64d-43bb-b67b-a8a7de0e2afa tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Getting quotas for user 60631612044343e1ad556690ed0eabe7 and project 8f5198d96e9344898c15d63c0aa8615b. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:50:02.131675 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c7cd6c2a-f64d-43bb-b67b-a8a7de0e2afa tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.539896 Jun 16 14:50:02.132709 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1150/2343] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:50:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:02.170697 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3e21c6ac-662a-4b44-9172-a2693184f2a3 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:02.185586 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3e21c6ac-662a-4b44-9172-a2693184f2a3 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:02.211689 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3e21c6ac-662a-4b44-9172-a2693184f2a3 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:02.220599 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3e21c6ac-662a-4b44-9172-a2693184f2a3 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:02.223053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3e21c6ac-662a-4b44-9172-a2693184f2a3 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:02.226707 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3e21c6ac-662a-4b44-9172-a2693184f2a3 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:04.063477 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3e21c6ac-662a-4b44-9172-a2693184f2a3 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:04.095614 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3e21c6ac-662a-4b44-9172-a2693184f2a3 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1316 microversion: 2.1 time: 1.946469 Jun 16 14:50:04.097288 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1151/2344] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:02 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1316 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:04.144447 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:50:04.146641 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:50:04.148191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:50:04.149583 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:50:04.150723 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:50:04.192652 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:04.196242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:04.200323 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:04.208938 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:04.271323 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Getting quotas for project c4268b504d13415f9d0e23844936bf25. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:50:04.300346 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Getting quotas for user be1e4996a4ab47be9bafdd07293277d0 and project c4268b504d13415f9d0e23844936bf25. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:50:04.359105 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Going to run 2 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:50:04.365885 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1972ad93-7fd8-4543-8c50-9f3948d5be42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:50:04.550994 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=1972ad93-7fd8-4543-8c50-9f3948d5be42,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:50:04.761775 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0c9058fc-4b20-41f3-ae86-a1c92d49dd58 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 5.084457 Jun 16 14:50:04.763092 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1194/2345] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:49:59 2022] POST /compute/v2.1/servers => generated 32 bytes in 5087 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 16 14:50:04.777792 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-011b006f-222c-4072-807b-e84d5ab83cad tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:04.811313 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-011b006f-222c-4072-807b-e84d5ab83cad tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:04.816934 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-011b006f-222c-4072-807b-e84d5ab83cad tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Searching by: {'deleted': False, 'project_id': 'c4268b504d13415f9d0e23844936bf25'} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:50:04.894936 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-011b006f-222c-4072-807b-e84d5ab83cad tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:04.897026 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-011b006f-222c-4072-807b-e84d5ab83cad tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:04.899260 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-011b006f-222c-4072-807b-e84d5ab83cad tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:04.899728 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-011b006f-222c-4072-807b-e84d5ab83cad tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:05.054512 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.multi_cell_list [None req-011b006f-222c-4072-807b-e84d5ab83cad tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=125863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:50:05.138280 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-98995dd3-fb26-4f84-a02d-fa3fc0960be5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:05.148440 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-98995dd3-fb26-4f84-a02d-fa3fc0960be5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:05.194586 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98995dd3-fb26-4f84-a02d-fa3fc0960be5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:05.198321 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98995dd3-fb26-4f84-a02d-fa3fc0960be5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:05.210519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98995dd3-fb26-4f84-a02d-fa3fc0960be5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:05.214159 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98995dd3-fb26-4f84-a02d-fa3fc0960be5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:05.265374 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-011b006f-222c-4072-807b-e84d5ab83cad tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.492164 Jun 16 14:50:05.274420 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1152/2346] 10.222.0.57 () {58 vars in 1124 bytes} [Thu Jun 16 14:50:04 2022] GET /compute/v2.1/servers => generated 1333 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:05.297668 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e05d6700-7556-41b7-a8cc-42f2795116f5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:05.300337 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e05d6700-7556-41b7-a8cc-42f2795116f5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:05.801360 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e05d6700-7556-41b7-a8cc-42f2795116f5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:05.821770 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e05d6700-7556-41b7-a8cc-42f2795116f5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1217 microversion: 2.1 time: 0.542750 Jun 16 14:50:05.822838 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1153/2347] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:05 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1217 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:05.839487 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-97faa532-7bb6-4a34-a5ed-8b009f1d4bb4 req-8acaad8e-3086-4361-b83e-6788fba85f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d23270-9297-4a55-8d4c-022f8ffcedf6", "name": "network-vif-deleted", "tag": "c8f6b10d-ca3a-483e-a435-128bb7a6a621"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:05.879265 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-97faa532-7bb6-4a34-a5ed-8b009f1d4bb4 req-8acaad8e-3086-4361-b83e-6788fba85f51 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:05.883439 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-97faa532-7bb6-4a34-a5ed-8b009f1d4bb4 req-8acaad8e-3086-4361-b83e-6788fba85f51 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:05.914259 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-97faa532-7bb6-4a34-a5ed-8b009f1d4bb4 req-8acaad8e-3086-4361-b83e-6788fba85f51 service nova] Creating event network-vif-deleted:c8f6b10d-ca3a-483e-a435-128bb7a6a621 for instance e6d23270-9297-4a55-8d4c-022f8ffcedf6 on n-h2-836830-4 Jun 16 14:50:05.925828 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-97faa532-7bb6-4a34-a5ed-8b009f1d4bb4 req-8acaad8e-3086-4361-b83e-6788fba85f51 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100873 Jun 16 14:50:05.928982 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1154/2348] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:06.884314 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1c785160-8c22-42b2-8427-86865dd50417 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:06.898661 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1c785160-8c22-42b2-8427-86865dd50417 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:06.964870 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:07.485270 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1c785160-8c22-42b2-8427-86865dd50417 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:07.535136 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1c785160-8c22-42b2-8427-86865dd50417 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1217 microversion: 2.1 time: 0.697162 Jun 16 14:50:07.546044 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1155/2349] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:06 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1217 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:07.761766 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-98995dd3-fb26-4f84-a02d-fa3fc0960be5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:07.835800 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-98995dd3-fb26-4f84-a02d-fa3fc0960be5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1316 microversion: 2.1 time: 2.709226 Jun 16 14:50:07.864822 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1195/2350] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:05 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1316 bytes in 2754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:08.133391 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-6d5d7ecf-4ce1-49ea-beda-38f5c8d53d1a req-568e6723-d313-4134-ab29-114fb0443729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c12ef1f-2dc9-41e9-b5dc-c677801c691f", "name": "network-vif-deleted", "tag": "991c50ac-177d-4a27-abc8-28ea3f729d88"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:08.255365 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-6d5d7ecf-4ce1-49ea-beda-38f5c8d53d1a req-568e6723-d313-4134-ab29-114fb0443729 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:08.256113 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-6d5d7ecf-4ce1-49ea-beda-38f5c8d53d1a req-568e6723-d313-4134-ab29-114fb0443729 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:08.348058 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-6d5d7ecf-4ce1-49ea-beda-38f5c8d53d1a req-568e6723-d313-4134-ab29-114fb0443729 service nova] Creating event network-vif-deleted:991c50ac-177d-4a27-abc8-28ea3f729d88 for instance 9c12ef1f-2dc9-41e9-b5dc-c677801c691f on n-h2-836830-4 Jun 16 14:50:08.363971 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-6d5d7ecf-4ce1-49ea-beda-38f5c8d53d1a req-568e6723-d313-4134-ab29-114fb0443729 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246207 Jun 16 14:50:08.367187 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1156/2351] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:08.554935 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-01205b7c-c9c1-44c4-a5ad-313a711c02c5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:08.555761 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-01205b7c-c9c1-44c4-a5ad-313a711c02c5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:08.591443 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01205b7c-c9c1-44c4-a5ad-313a711c02c5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:08.592031 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01205b7c-c9c1-44c4-a5ad-313a711c02c5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:08.596447 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01205b7c-c9c1-44c4-a5ad-313a711c02c5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:08.597270 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01205b7c-c9c1-44c4-a5ad-313a711c02c5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:08.930233 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-deaa962c-2d3c-4f3b-bfaa-f3486ee77011 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Action: 'create', calling method: .version_select at 0x7fdeffcb7550>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBHG/wXJp0TDjOnWlVT2CoWzF6/nuGWF02iUQCM9biLK//rayJ0EjQevrgr2mJ0y2sbVRELttlkGcq10PZaAV/P1RfFN2bdT5N3uwMa6JhWKO52ItKkGyk/qBjdoJS6lA=="}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:08.942540 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-deaa962c-2d3c-4f3b-bfaa-f3486ee77011 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-deaa962c-2d3c-4f3b-bfaa-f3486ee77011 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Request method failure captured: Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 257 Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0MgJ0tteUcEoAj2Zs97ttvyOUZbPOL2DP5caTHN0rjSj3ZgFHDqUbvpDGcJnzg1pjTw70EKFwackQKvCHjUcnNnM7V5TYZVPAAcHyaZd_aEi5IOLZ3TxckJhycxOupZMTr1mx2Emdsb5Uys5ozX9oxg0Uka408acHhAv17A5RAvNIg Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:50:08.953559 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:50:08.955110 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_de7fa8dbe9ab4c8789efd8c521533357", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/de7fa8dbe9ab4c8789efd8c521533357"}]}] Jun 16 14:50:08.955110 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:08.955110 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:08.955110 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:08.955110 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:08.955110 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:50:08.955110 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:50:08.955110 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: c5f6b5535059473d98349108ab9ab553 Jun 16 14:50:08.955110 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:08.955110 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:50:08.955110 n-d-836830-4 devstack@n-api.service[125862]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBHG/wXJp0TDjOnWlVT2CoWzF6/nuGWF02iUQCM9biLK//rayJ0EjQevrgr2mJ0y2sbVRELttlkGcq10PZaAV/P1RfFN2bdT5N3uwMa6JhWKO52ItKkGyk/qBjdoJS6lA=="}} Jun 16 14:50:08.955110 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBHG/wXJp0TDjOnWlVT2CoWzF6/nuGWF02iUQCM9biLK//rayJ0EjQevrgr2mJ0y2sbVRELttlkGcq10PZaAV/P1RfFN2bdT5N3uwMa6JhWKO52ItKkGyk/qBjdoJS6lA=='}}} Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jun 16 14:50:08.955784 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 16 14:50:08.956945 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 16 14:50:08.958296 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 16 14:50:08.958296 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jun 16 14:50:08.958296 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:08.958296 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:08.958296 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:08.958296 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:08.958296 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:08.958296 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:08.958296 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:08.958296 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:08.958296 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jun 16 14:50:08.958296 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:08.958296 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-deaa962c-2d3c-4f3b-bfaa-f3486ee77011 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:08.959767 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-deaa962c-2d3c-4f3b-bfaa-f3486ee77011 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.515466 Jun 16 14:50:08.962327 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1196/2352] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:50:08 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 519 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 14:50:08.976852 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-86e9c88e-ae4d-4958-853f-4aed36fbe6d5 req-b31262e5-4b7d-4da4-9cfc-7ce506f99130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24da35f6-76a6-4bb9-8b00-9408845d6289", "name": "network-vif-plugged", "status": "completed", "tag": "45b4b68d-7250-4ba3-8453-0fbbb0deac78"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:08.981909 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:09.001957 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-86e9c88e-ae4d-4958-853f-4aed36fbe6d5 req-b31262e5-4b7d-4da4-9cfc-7ce506f99130 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:09.003061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-86e9c88e-ae4d-4958-853f-4aed36fbe6d5 req-b31262e5-4b7d-4da4-9cfc-7ce506f99130 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:09.045445 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-86e9c88e-ae4d-4958-853f-4aed36fbe6d5 req-b31262e5-4b7d-4da4-9cfc-7ce506f99130 service nova] Creating event network-vif-plugged:45b4b68d-7250-4ba3-8453-0fbbb0deac78 for instance 24da35f6-76a6-4bb9-8b00-9408845d6289 on n-h1-836830-4 Jun 16 14:50:09.065584 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-86e9c88e-ae4d-4958-853f-4aed36fbe6d5 req-b31262e5-4b7d-4da4-9cfc-7ce506f99130 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092730 Jun 16 14:50:09.067511 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1197/2353] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:09.094323 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bde4a6da-fc65-4a37-b028-9e2d1ace1ea2 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:09.097131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bde4a6da-fc65-4a37-b028-9e2d1ace1ea2 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:09.099941 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-01205b7c-c9c1-44c4-a5ad-313a711c02c5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:09.112535 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bde4a6da-fc65-4a37-b028-9e2d1ace1ea2 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:09.113664 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bde4a6da-fc65-4a37-b028-9e2d1ace1ea2 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:09.115833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bde4a6da-fc65-4a37-b028-9e2d1ace1ea2 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:09.116874 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bde4a6da-fc65-4a37-b028-9e2d1ace1ea2 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:09.147472 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-01205b7c-c9c1-44c4-a5ad-313a711c02c5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1213 microversion: 2.1 time: 0.596265 Jun 16 14:50:09.153811 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1157/2354] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:08 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1213 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:50:09.179262 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1d8a2d69-c3f9-4868-a464-4874c3d3a992 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Action: 'create', calling method: .version_select at 0x7fdf0c43f8b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1987887701", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:09.278640 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-1d8a2d69-c3f9-4868-a464-4874c3d3a992 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Getting quotas for project de7fa8dbe9ab4c8789efd8c521533357. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:50:09.325878 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-1d8a2d69-c3f9-4868-a464-4874c3d3a992 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Getting quotas for user c5f6b5535059473d98349108ab9ab553 and project de7fa8dbe9ab4c8789efd8c521533357. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:50:09.443476 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-1d8a2d69-c3f9-4868-a464-4874c3d3a992 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1d8a2d69-c3f9-4868-a464-4874c3d3a992 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Request method failure captured: Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 2167 Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0MgJ0tteUcEoAj2Zs97ttvyOUZbPOL2DP5caTHN0rjSj3ZgFHDqUbvpDGcJnzg1pjTw70EKFwackQKvCHjUcnNnM7V5TYZVPAAcHyaZd_aEi5IOLZ3TxckJhycxOupZMTr1mx2Emdsb5Uys5ozX9oxg0Uka408acHhAv17A5RAvNIg Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_de7fa8dbe9ab4c8789efd8c521533357", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/de7fa8dbe9ab4c8789efd8c521533357"}]}] Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: c5f6b5535059473d98349108ab9ab553 Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1987887701", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:50:09.466864 n-d-836830-4 devstack@n-api.service[125863]: exception: Keypair data is invalid: failed to generate fingerprint Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1987887701', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:09.470799 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1d8a2d69-c3f9-4868-a464-4874c3d3a992 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1d8a2d69-c3f9-4868-a464-4874c3d3a992 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.316102 Jun 16 14:50:09.477794 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1158/2355] 10.222.0.57 () {60 vars in 1159 bytes} [Thu Jun 16 14:50:09 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 320 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:09.531823 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-31b80134-fe5b-4eea-917c-128c586c68a4 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Action: 'create', calling method: .version_select at 0x7fdf0c43f430>, body: {"keypair": {"name": "tempest-keypair-360022795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDtjL9R81QLiFZZUsYkrCP9taTwrFdbgCRkbrBGLpGll/Hjsje8vnFDxqrc4wkhTy45Lpa45UwN6qdc+4Ig8kYJcjsAylpLZ0Rbf2jrRrogVpxTD8ZfOCP2lMnV4C3qYw=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:09.638090 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-31b80134-fe5b-4eea-917c-128c586c68a4 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Getting quotas for project de7fa8dbe9ab4c8789efd8c521533357. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:50:09.671330 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-31b80134-fe5b-4eea-917c-128c586c68a4 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Getting quotas for user c5f6b5535059473d98349108ab9ab553 and project de7fa8dbe9ab4c8789efd8c521533357. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:50:09.842690 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bde4a6da-fc65-4a37-b028-9e2d1ace1ea2 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:09.873105 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-31b80134-fe5b-4eea-917c-128c586c68a4 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.371537 Jun 16 14:50:09.892503 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1159/2356] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:50:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:09.894894 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bde4a6da-fc65-4a37-b028-9e2d1ace1ea2 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1316 microversion: 2.1 time: 0.824818 Jun 16 14:50:09.899357 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1198/2357] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:09 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1316 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:09.923099 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-dedc70b2-0a08-4cfa-a72a-a1176a60d265 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Action: 'create', calling method: .version_select at 0x7fdf0c3eaf70>, body: {"keypair": {"name": "tempest-keypair-360022795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaHqoS0H0AbyCIgwyP7bRPhqg3yZoNxdYj4ofWEJN6JS9Qa2ocfNEvICraIlzirS7Eep+LoUe3dzXF4M4+VKIMHjJAQzBHvjqnEYgBISb8DcOzmxB3AZr5CxpnCAmBoVg=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:10.025696 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-dedc70b2-0a08-4cfa-a72a-a1176a60d265 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Getting quotas for project de7fa8dbe9ab4c8789efd8c521533357. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:50:10.068359 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-dedc70b2-0a08-4cfa-a72a-a1176a60d265 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Getting quotas for user c5f6b5535059473d98349108ab9ab553 and project de7fa8dbe9ab4c8789efd8c521533357. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:50:10.185302 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-dedc70b2-0a08-4cfa-a72a-a1176a60d265 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] HTTP exception thrown: Key pair 'tempest-keypair-360022795' already exists. Jun 16 14:50:10.191053 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-52293561-5f2c-4a50-8cff-33069ae6fee4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:10.200535 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-52293561-5f2c-4a50-8cff-33069ae6fee4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-dedc70b2-0a08-4cfa-a72a-a1176a60d265 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Request method failure captured: Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 272 Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0MgJ0tteUcEoAj2Zs97ttvyOUZbPOL2DP5caTHN0rjSj3ZgFHDqUbvpDGcJnzg1pjTw70EKFwackQKvCHjUcnNnM7V5TYZVPAAcHyaZd_aEi5IOLZ3TxckJhycxOupZMTr1mx2Emdsb5Uys5ozX9oxg0Uka408acHhAv17A5RAvNIg Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_de7fa8dbe9ab4c8789efd8c521533357", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/de7fa8dbe9ab4c8789efd8c521533357"}]}] Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: c5f6b5535059473d98349108ab9ab553 Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: {"keypair": {"name": "tempest-keypair-360022795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaHqoS0H0AbyCIgwyP7bRPhqg3yZoNxdYj4ofWEJN6JS9Qa2ocfNEvICraIlzirS7Eep+LoUe3dzXF4M4+VKIMHjJAQzBHvjqnEYgBISb8DcOzmxB3AZr5CxpnCAmBoVg=="}} Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: exception: Key pair 'tempest-keypair-360022795' already exists. Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-360022795', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaHqoS0H0AbyCIgwyP7bRPhqg3yZoNxdYj4ofWEJN6JS9Qa2ocfNEvICraIlzirS7Eep+LoUe3dzXF4M4+VKIMHjJAQzBHvjqnEYgBISb8DcOzmxB3AZr5CxpnCAmBoVg=='}}} Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result.read() Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'c5f6b5535059473d98349108ab9ab553-tempest-keypair-360022795' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 16 14:50:10.206585 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi session.flush() Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result.read() Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 16 14:50:10.209957 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'c5f6b5535059473d98349108ab9ab553-tempest-keypair-360022795' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 16, 14, 50, 10, 165156), 'updated_at': None, 'name': 'tempest-keypair-360022795', 'user_id': 'c5f6b5535059473d98349108ab9ab553', 'fingerprint': '29:37:1e:57:c8:da:44:73:e3:e7:99:ac:2a:65:b8:4c', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaHqoS0H0AbyCIgwyP7bRPhqg3yZoNxdYj4ofWEJN6JS9Qa2ocfNEvICraIlzirS7Eep+LoUe3dzXF4M4+VKIMHjJAQzBHvjqnEYgBISb8DcOzmxB3AZr5CxpnCAmBoVg==', 'type': 'ssh'}] Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi keypair.create() Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._create() Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-360022795' already exists. Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jun 16 14:50:10.217148 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-360022795' already exists. Jun 16 14:50:10.221640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.221640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:10.221640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.221640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.221640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:10.221640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:10.221640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:10.221640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:10.221640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-360022795' already exists. Jun 16 14:50:10.221640 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.230297 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-dedc70b2-0a08-4cfa-a72a-a1176a60d265 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Returning 409 to user: Key pair 'tempest-keypair-360022795' already exists. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:10.232404 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-dedc70b2-0a08-4cfa-a72a-a1176a60d265 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.337440 Jun 16 14:50:10.237656 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1160/2358] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:50:09 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 344 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:50:10.252013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-52293561-5f2c-4a50-8cff-33069ae6fee4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:10.252992 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-52293561-5f2c-4a50-8cff-33069ae6fee4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:10.255381 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-52293561-5f2c-4a50-8cff-33069ae6fee4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:10.267009 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-52293561-5f2c-4a50-8cff-33069ae6fee4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:10.277928 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cd36e9b2-d918-4b86-8db2-9721549c4f48 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Calling method '.version_select at 0x7fdeffc95b80>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:10.394971 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cd36e9b2-d918-4b86-8db2-9721549c4f48 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-360022795" status: 202 len: 0 microversion: 2.1 time: 0.151295 Jun 16 14:50:10.396399 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1161/2359] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jun 16 14:50:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-360022795 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:50:10.413375 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-57271b35-669b-4d85-b178-d81c5f1a5346 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Action: 'create', calling method: .version_select at 0x7fdeffe10b80>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGyC3cZfj4b2+8XQJeIapgSPLuOpirJP2Eb5mP1sSEBKpWCfyUREqUKIYGaPel3B6YOb1faIVGM9/XQZLnwrdHcPDIv69S+yGTpxXfTkKxUWVdySWpFFXOBolVbiAFz+g=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-57271b35-669b-4d85-b178-d81c5f1a5346 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Request method failure captured: Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 247 Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0MgJ0tteUcEoAj2Zs97ttvyOUZbPOL2DP5caTHN0rjSj3ZgFHDqUbvpDGcJnzg1pjTw70EKFwackQKvCHjUcnNnM7V5TYZVPAAcHyaZd_aEi5IOLZ3TxckJhycxOupZMTr1mx2Emdsb5Uys5ozX9oxg0Uka408acHhAv17A5RAvNIg Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_de7fa8dbe9ab4c8789efd8c521533357", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/de7fa8dbe9ab4c8789efd8c521533357"}]}] Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: c5f6b5535059473d98349108ab9ab553 Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGyC3cZfj4b2+8XQJeIapgSPLuOpirJP2Eb5mP1sSEBKpWCfyUREqUKIYGaPel3B6YOb1faIVGM9/XQZLnwrdHcPDIv69S+yGTpxXfTkKxUWVdySWpFFXOBolVbiAFz+g=="}} Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGyC3cZfj4b2+8XQJeIapgSPLuOpirJP2Eb5mP1sSEBKpWCfyUREqUKIYGaPel3B6YOb1faIVGM9/XQZLnwrdHcPDIv69S+yGTpxXfTkKxUWVdySWpFFXOBolVbiAFz+g=='}}} Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi '' Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:50:10.417179 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:50:10.421086 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:50:10.421086 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:50:10.421086 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:50:10.421086 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:50:10.421086 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 16 14:50:10.421086 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.421086 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:10.421086 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.421086 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.421086 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:10.421086 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:10.421086 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:50:10.421086 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:50:10.421086 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 16 14:50:10.421086 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.424073 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-57271b35-669b-4d85-b178-d81c5f1a5346 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:10.425166 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-57271b35-669b-4d85-b178-d81c5f1a5346 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.016511 Jun 16 14:50:10.431275 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1162/2360] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:50:10 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 14:50:10.438053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-652535b2-55fa-4a02-952a-26a9e197f096 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Action: 'create', calling method: .version_select at 0x7fdf0c38e8b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1202571228", "public_key": " "}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:10.465207 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-652535b2-55fa-4a02-952a-26a9e197f096 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Getting quotas for project de7fa8dbe9ab4c8789efd8c521533357. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:50:10.493102 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-652535b2-55fa-4a02-952a-26a9e197f096 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Getting quotas for user c5f6b5535059473d98349108ab9ab553 and project de7fa8dbe9ab4c8789efd8c521533357. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:50:10.559173 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-652535b2-55fa-4a02-952a-26a9e197f096 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-652535b2-55fa-4a02-952a-26a9e197f096 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Request method failure captured: Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 95 Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0MgJ0tteUcEoAj2Zs97ttvyOUZbPOL2DP5caTHN0rjSj3ZgFHDqUbvpDGcJnzg1pjTw70EKFwackQKvCHjUcnNnM7V5TYZVPAAcHyaZd_aEi5IOLZ3TxckJhycxOupZMTr1mx2Emdsb5Uys5ozX9oxg0Uka408acHhAv17A5RAvNIg Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_de7fa8dbe9ab4c8789efd8c521533357", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/de7fa8dbe9ab4c8789efd8c521533357"}]}] Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: c5f6b5535059473d98349108ab9ab553 Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1202571228", "public_key": " "}} Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: exception: Keypair data is invalid: failed to generate fingerprint Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1202571228', 'public_key': ' '}}} Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:10.566116 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-652535b2-55fa-4a02-952a-26a9e197f096 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-652535b2-55fa-4a02-952a-26a9e197f096 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.139126 Jun 16 14:50:10.587166 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1163/2361] 10.222.0.57 () {60 vars in 1157 bytes} [Thu Jun 16 14:50:10 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:10.598792 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fbeb865d-8cf3-4921-9f89-827c964d44fb tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Action: 'create', calling method: .version_select at 0x7fdf0c046d30>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+LzzyI5XBSod5Nrqw2MWKYY9cfBadKJ1iruq4CodZci2qFJUrdR0uJsIsV2HPCepSDBG1v2WiQVfw46/54Xa6m8aqwUBRaIueLn1jJ8nDjSai48rlnN2WIZ1blTYUwDA=="}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fbeb865d-8cf3-4921-9f89-827c964d44fb tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Request method failure captured: Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 507 Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0MgJ0tteUcEoAj2Zs97ttvyOUZbPOL2DP5caTHN0rjSj3ZgFHDqUbvpDGcJnzg1pjTw70EKFwackQKvCHjUcnNnM7V5TYZVPAAcHyaZd_aEi5IOLZ3TxckJhycxOupZMTr1mx2Emdsb5Uys5ozX9oxg0Uka408acHhAv17A5RAvNIg Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_de7fa8dbe9ab4c8789efd8c521533357", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/de7fa8dbe9ab4c8789efd8c521533357"}]}] Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: c5f6b5535059473d98349108ab9ab553 Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+LzzyI5XBSod5Nrqw2MWKYY9cfBadKJ1iruq4CodZci2qFJUrdR0uJsIsV2HPCepSDBG1v2WiQVfw46/54Xa6m8aqwUBRaIueLn1jJ8nDjSai48rlnN2WIZ1blTYUwDA=="}} Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+LzzyI5XBSod5Nrqw2MWKYY9cfBadKJ1iruq4CodZci2qFJUrdR0uJsIsV2HPCepSDBG1v2WiQVfw46/54Xa6m8aqwUBRaIueLn1jJ8nDjSai48rlnN2WIZ1blTYUwDA=='}}} Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jun 16 14:50:10.611956 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.618808 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fbeb865d-8cf3-4921-9f89-827c964d44fb tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:10.634609 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fbeb865d-8cf3-4921-9f89-827c964d44fb tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.028713 Jun 16 14:50:10.634609 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1164/2362] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:50:10 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 14:50:10.645441 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-aefc5994-db7e-4aa2-83f9-c0f4dc86ff86 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Action: 'create', calling method: .version_select at 0x7fdf0c060700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1994294926", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:10.728695 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-aefc5994-db7e-4aa2-83f9-c0f4dc86ff86 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Getting quotas for project de7fa8dbe9ab4c8789efd8c521533357. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:50:10.745754 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-aefc5994-db7e-4aa2-83f9-c0f4dc86ff86 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Getting quotas for user c5f6b5535059473d98349108ab9ab553 and project de7fa8dbe9ab4c8789efd8c521533357. Resources: {'key_pairs'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:50:10.804957 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-aefc5994-db7e-4aa2-83f9-c0f4dc86ff86 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-aefc5994-db7e-4aa2-83f9-c0f4dc86ff86 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Request method failure captured: Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 118 Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0MgJ0tteUcEoAj2Zs97ttvyOUZbPOL2DP5caTHN0rjSj3ZgFHDqUbvpDGcJnzg1pjTw70EKFwackQKvCHjUcnNnM7V5TYZVPAAcHyaZd_aEi5IOLZ3TxckJhycxOupZMTr1mx2Emdsb5Uys5ozX9oxg0Uka408acHhAv17A5RAvNIg Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_de7fa8dbe9ab4c8789efd8c521533357", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/de7fa8dbe9ab4c8789efd8c521533357"}]}] Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: c5f6b5535059473d98349108ab9ab553 Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1994294926", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: exception: Keypair data is invalid: failed to generate fingerprint Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1994294926', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 16 14:50:10.810747 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-aefc5994-db7e-4aa2-83f9-c0f4dc86ff86 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-aefc5994-db7e-4aa2-83f9-c0f4dc86ff86 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.179919 Jun 16 14:50:10.827756 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1165/2363] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:50:10 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:10.844465 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f40612a6-3b95-4deb-af5d-b8b65877eb18 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Calling method '.version_select at 0x7fdf0c01aca0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:10.892107 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-f40612a6-3b95-4deb-af5d-b8b65877eb18 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1949819526 not found for user c5f6b5535059473d98349108ab9ab553 Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f40612a6-3b95-4deb-af5d-b8b65877eb18 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Request method failure captured: Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1949819526 HTTP/1.1 Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0MgJ0tteUcEoAj2Zs97ttvyOUZbPOL2DP5caTHN0rjSj3ZgFHDqUbvpDGcJnzg1pjTw70EKFwackQKvCHjUcnNnM7V5TYZVPAAcHyaZd_aEi5IOLZ3TxckJhycxOupZMTr1mx2Emdsb5Uys5ozX9oxg0Uka408acHhAv17A5RAvNIg Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_de7fa8dbe9ab4c8789efd8c521533357", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/de7fa8dbe9ab4c8789efd8c521533357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/de7fa8dbe9ab4c8789efd8c521533357"}]}] Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: de7fa8dbe9ab4c8789efd8c521533357 Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1549683039 Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: c5f6b5535059473d98349108ab9ab553 Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1549683039-project Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: exception: Keypair tempest-keypair-non-existent-1949819526 not found for user c5f6b5535059473d98349108ab9ab553 Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'tempest-keypair-non-existent-1949819526'} Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1949819526 not found for user c5f6b5535059473d98349108ab9ab553 Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.896147 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1949819526 not found for user c5f6b5535059473d98349108ab9ab553 Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1949819526 not found for user c5f6b5535059473d98349108ab9ab553 Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f40612a6-3b95-4deb-af5d-b8b65877eb18 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1949819526 not found for user c5f6b5535059473d98349108ab9ab553 {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f40612a6-3b95-4deb-af5d-b8b65877eb18 tempest-KeyPairsNegativeTestJSON-1549683039 tempest-KeyPairsNegativeTestJSON-1549683039-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1949819526" status: 404 len: 145 microversion: 2.1 time: 0.073250 Jun 16 14:50:10.903650 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1166/2364] 10.222.0.57 () {58 vars in 1259 bytes} [Thu Jun 16 14:50:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1949819526 => generated 145 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:50:10.952941 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5b9522b4-c006-4b90-a0fd-7d3e2d501eb6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:10.958576 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5b9522b4-c006-4b90-a0fd-7d3e2d501eb6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:10.981691 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b9522b4-c006-4b90-a0fd-7d3e2d501eb6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:10.982151 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b9522b4-c006-4b90-a0fd-7d3e2d501eb6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:10.982527 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-52293561-5f2c-4a50-8cff-33069ae6fee4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:10.988330 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b9522b4-c006-4b90-a0fd-7d3e2d501eb6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:10.988923 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5b9522b4-c006-4b90-a0fd-7d3e2d501eb6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:11.006056 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:11.014472 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-52293561-5f2c-4a50-8cff-33069ae6fee4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1287 microversion: 2.1 time: 0.846207 Jun 16 14:50:11.015096 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1199/2365] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:10 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1287 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:50:11.947429 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5b9522b4-c006-4b90-a0fd-7d3e2d501eb6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:11.960671 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5b9522b4-c006-4b90-a0fd-7d3e2d501eb6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1316 microversion: 2.1 time: 1.034495 Jun 16 14:50:11.963690 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1167/2366] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:10 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1316 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:12.032921 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c5cedcde-4167-497d-b649-d5e7898a9a37 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:12.034259 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c5cedcde-4167-497d-b649-d5e7898a9a37 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:12.053390 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c5cedcde-4167-497d-b649-d5e7898a9a37 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:12.056718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c5cedcde-4167-497d-b649-d5e7898a9a37 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:12.062347 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c5cedcde-4167-497d-b649-d5e7898a9a37 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:12.063461 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c5cedcde-4167-497d-b649-d5e7898a9a37 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:12.282518 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c5cedcde-4167-497d-b649-d5e7898a9a37 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:12.300147 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c5cedcde-4167-497d-b649-d5e7898a9a37 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1275 microversion: 2.1 time: 0.271099 Jun 16 14:50:12.301185 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1200/2367] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:12 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1275 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:50:12.979395 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ba5a347b-8793-47bc-9b4c-f8ac1827be2f tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:12.980020 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ba5a347b-8793-47bc-9b4c-f8ac1827be2f tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:13.020110 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba5a347b-8793-47bc-9b4c-f8ac1827be2f tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:13.020585 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba5a347b-8793-47bc-9b4c-f8ac1827be2f tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:13.021413 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba5a347b-8793-47bc-9b4c-f8ac1827be2f tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:13.021874 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ba5a347b-8793-47bc-9b4c-f8ac1827be2f tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:13.184273 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1a2afb83-13df-4c5d-87e0-6168cebf7635 tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Action: 'update', calling method: .version_select at 0x7fdeffacc4c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:13.387178 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a2afb83-13df-4c5d-87e0-6168cebf7635 tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:13.387838 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a2afb83-13df-4c5d-87e0-6168cebf7635 tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:13.389763 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a2afb83-13df-4c5d-87e0-6168cebf7635 tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:13.394672 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a2afb83-13df-4c5d-87e0-6168cebf7635 tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:13.606233 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1a2afb83-13df-4c5d-87e0-6168cebf7635 tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/d992fb89722f497fa49122b7bb8f84d3" status: 200 len: 240 microversion: 2.36 time: 0.833111 Jun 16 14:50:13.621688 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1168/2368] 10.222.0.57 () {62 vars in 1302 bytes} [Thu Jun 16 14:50:12 2022] PUT /compute/v2.1/os-quota-sets/d992fb89722f497fa49122b7bb8f84d3 => generated 240 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:50:13.635281 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ba5a347b-8793-47bc-9b4c-f8ac1827be2f tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:13.640278 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-153004a9-7fd0-4a2a-8f48-b3671949084e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:13.646306 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-153004a9-7fd0-4a2a-8f48-b3671949084e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:13.669650 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-153004a9-7fd0-4a2a-8f48-b3671949084e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:13.670165 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-153004a9-7fd0-4a2a-8f48-b3671949084e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:13.671297 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-153004a9-7fd0-4a2a-8f48-b3671949084e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:13.689331 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-153004a9-7fd0-4a2a-8f48-b3671949084e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:13.689559 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ba5a347b-8793-47bc-9b4c-f8ac1827be2f tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1466 microversion: 2.1 time: 0.708073 Jun 16 14:50:13.691845 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1201/2369] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:12 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1466 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:50:13.703876 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c532b963-0f12-49b8-ad5f-a046f7e45a2e tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Calling method '.version_select at 0x7fdf0c7bc9d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:13.910482 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c532b963-0f12-49b8-ad5f-a046f7e45a2e tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:13.910948 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c532b963-0f12-49b8-ad5f-a046f7e45a2e tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:13.912014 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c532b963-0f12-49b8-ad5f-a046f7e45a2e tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:13.914714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c532b963-0f12-49b8-ad5f-a046f7e45a2e tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:13.963305 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-153004a9-7fd0-4a2a-8f48-b3671949084e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:13.978335 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-153004a9-7fd0-4a2a-8f48-b3671949084e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1275 microversion: 2.1 time: 0.355473 Jun 16 14:50:13.980244 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1169/2370] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:13 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1275 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:13.991424 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2daa1f7d-7ee7-4977-8a22-36e2c71aebb7 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:13.996039 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2daa1f7d-7ee7-4977-8a22-36e2c71aebb7 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:14.003259 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c532b963-0f12-49b8-ad5f-a046f7e45a2e tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/d992fb89722f497fa49122b7bb8f84d3/detail" status: 200 len: 672 microversion: 2.36 time: 0.309127 Jun 16 14:50:14.003948 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1202/2371] 10.222.0.57 () {60 vars in 1303 bytes} [Thu Jun 16 14:50:13 2022] GET /compute/v2.1/os-quota-sets/d992fb89722f497fa49122b7bb8f84d3/detail => generated 672 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:50:14.026123 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2daa1f7d-7ee7-4977-8a22-36e2c71aebb7 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:14.031790 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2daa1f7d-7ee7-4977-8a22-36e2c71aebb7 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:14.035493 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2daa1f7d-7ee7-4977-8a22-36e2c71aebb7 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:14.039216 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2daa1f7d-7ee7-4977-8a22-36e2c71aebb7 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:14.177181 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2daa1f7d-7ee7-4977-8a22-36e2c71aebb7 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:50:14.419549 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-766489b6-05ce-44f5-a699-8b421713c65f tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Action: 'update', calling method: .version_select at 0x7fdeffeb0ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:14.459830 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2daa1f7d-7ee7-4977-8a22-36e2c71aebb7 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "DELETE /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 204 len: 0 microversion: 2.1 time: 0.469019 Jun 16 14:50:14.462745 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1170/2372] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:50:13 2022] DELETE /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:50:14.479485 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2ef68a7d-e15c-40c5-a3de-61446bbf4a6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:14.484330 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2ef68a7d-e15c-40c5-a3de-61446bbf4a6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:14.504741 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ef68a7d-e15c-40c5-a3de-61446bbf4a6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:14.506136 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ef68a7d-e15c-40c5-a3de-61446bbf4a6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:14.508553 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ef68a7d-e15c-40c5-a3de-61446bbf4a6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:14.509468 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ef68a7d-e15c-40c5-a3de-61446bbf4a6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:14.695977 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-766489b6-05ce-44f5-a699-8b421713c65f tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:14.696438 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-766489b6-05ce-44f5-a699-8b421713c65f tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:14.702908 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-766489b6-05ce-44f5-a699-8b421713c65f tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:14.705745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-766489b6-05ce-44f5-a699-8b421713c65f tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:14.827544 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-766489b6-05ce-44f5-a699-8b421713c65f tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:14.828787 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-766489b6-05ce-44f5-a699-8b421713c65f tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:14.830029 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-766489b6-05ce-44f5-a699-8b421713c65f tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:14.839375 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-766489b6-05ce-44f5-a699-8b421713c65f tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:14.968787 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-766489b6-05ce-44f5-a699-8b421713c65f tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-quota-sets/d992fb89722f497fa49122b7bb8f84d3?user_id=1eda891d18794fea8802128b824a9a3b" status: 200 len: 240 microversion: 2.36 time: 0.555211 Jun 16 14:50:14.970594 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1203/2373] 10.222.0.57 () {62 vars in 1383 bytes} [Thu Jun 16 14:50:14 2022] PUT /compute/v2.1/os-quota-sets/d992fb89722f497fa49122b7bb8f84d3?user_id=1eda891d18794fea8802128b824a9a3b => generated 240 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:50:15.002440 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ed52b300-4056-4cae-a94c-787a14611f50 tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] Calling method '.version_select at 0x7fdeffc8bb80>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:15.423471 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ed52b300-4056-4cae-a94c-787a14611f50 tempest-QuotasAdminTestV236-788228587 tempest-QuotasAdminTestV236-788228587-project-admin] 10.222.0.57 "GET /compute/v2.1/os-quota-sets/d992fb89722f497fa49122b7bb8f84d3?user_id=1eda891d18794fea8802128b824a9a3b" status: 200 len: 282 microversion: 2.36 time: 0.433725 Jun 16 14:50:15.426446 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1204/2374] 10.222.0.57 () {60 vars in 1363 bytes} [Thu Jun 16 14:50:14 2022] GET /compute/v2.1/os-quota-sets/d992fb89722f497fa49122b7bb8f84d3?user_id=1eda891d18794fea8802128b824a9a3b => generated 282 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:50:15.445277 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-09878008-835b-4719-8d46-5aecef7698d4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:15.446863 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-09878008-835b-4719-8d46-5aecef7698d4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:15.472272 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-09878008-835b-4719-8d46-5aecef7698d4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:15.472891 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-09878008-835b-4719-8d46-5aecef7698d4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:15.474913 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-09878008-835b-4719-8d46-5aecef7698d4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:15.476165 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-09878008-835b-4719-8d46-5aecef7698d4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:16.034886 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-09878008-835b-4719-8d46-5aecef7698d4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:16.048294 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-09878008-835b-4719-8d46-5aecef7698d4 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1275 microversion: 2.1 time: 0.619847 Jun 16 14:50:16.052770 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1205/2375] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:15 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1275 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:17.069640 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f9e6eb1e-3d79-41c2-b047-0408ed45a981 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:17.070331 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f9e6eb1e-3d79-41c2-b047-0408ed45a981 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:17.113577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f9e6eb1e-3d79-41c2-b047-0408ed45a981 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:17.115225 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f9e6eb1e-3d79-41c2-b047-0408ed45a981 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:17.118100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f9e6eb1e-3d79-41c2-b047-0408ed45a981 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:17.123896 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f9e6eb1e-3d79-41c2-b047-0408ed45a981 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:17.700904 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2ef68a7d-e15c-40c5-a3de-61446bbf4a6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:17.749794 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2ef68a7d-e15c-40c5-a3de-61446bbf4a6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1472 microversion: 2.1 time: 3.280591 Jun 16 14:50:17.756595 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1171/2376] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:14 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1472 bytes in 3282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:17.777590 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f9e6eb1e-3d79-41c2-b047-0408ed45a981 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:17.812059 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f9e6eb1e-3d79-41c2-b047-0408ed45a981 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1275 microversion: 2.1 time: 0.746409 Jun 16 14:50:17.828113 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1206/2377] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:17 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1275 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:50:18.800599 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-80f21d10-db26-4fe5-9a84-726eeb92cbb5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:18.801974 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-80f21d10-db26-4fe5-9a84-726eeb92cbb5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:18.854707 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-df14049f-736a-401b-831c-dd7257b7cd4e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:18.855868 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-df14049f-736a-401b-831c-dd7257b7cd4e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:18.888311 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-80f21d10-db26-4fe5-9a84-726eeb92cbb5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:18.889433 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-80f21d10-db26-4fe5-9a84-726eeb92cbb5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:18.890909 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-80f21d10-db26-4fe5-9a84-726eeb92cbb5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:18.891742 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-80f21d10-db26-4fe5-9a84-726eeb92cbb5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:18.894163 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-df14049f-736a-401b-831c-dd7257b7cd4e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:18.896954 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-df14049f-736a-401b-831c-dd7257b7cd4e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:18.903790 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-df14049f-736a-401b-831c-dd7257b7cd4e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:18.904781 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-df14049f-736a-401b-831c-dd7257b7cd4e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:19.059860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:19.291866 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-df14049f-736a-401b-831c-dd7257b7cd4e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:19.324142 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-df14049f-736a-401b-831c-dd7257b7cd4e tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1275 microversion: 2.1 time: 0.475765 Jun 16 14:50:19.331560 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1207/2378] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:18 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1275 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:19.535617 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-80f21d10-db26-4fe5-9a84-726eeb92cbb5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:19.592001 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-80f21d10-db26-4fe5-9a84-726eeb92cbb5 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1430 microversion: 2.1 time: 0.813370 Jun 16 14:50:19.609127 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1172/2379] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:18 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1430 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:50:20.163942 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-91768aa1-bb6c-4b3e-a6e2-59429bbe43ab req-72d315ad-b362-4b0f-b15b-82532f5c2e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24da35f6-76a6-4bb9-8b00-9408845d6289", "name": "network-vif-deleted", "tag": "45b4b68d-7250-4ba3-8453-0fbbb0deac78"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:20.236958 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-91768aa1-bb6c-4b3e-a6e2-59429bbe43ab req-72d315ad-b362-4b0f-b15b-82532f5c2e91 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:20.237939 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-91768aa1-bb6c-4b3e-a6e2-59429bbe43ab req-72d315ad-b362-4b0f-b15b-82532f5c2e91 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:20.322416 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-91768aa1-bb6c-4b3e-a6e2-59429bbe43ab req-72d315ad-b362-4b0f-b15b-82532f5c2e91 service nova] Creating event network-vif-deleted:45b4b68d-7250-4ba3-8453-0fbbb0deac78 for instance 24da35f6-76a6-4bb9-8b00-9408845d6289 on n-h1-836830-4 Jun 16 14:50:20.364959 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-38f69bc6-7c58-44c8-9e3c-3093331019e7 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:20.366701 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-38f69bc6-7c58-44c8-9e3c-3093331019e7 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:20.372465 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-91768aa1-bb6c-4b3e-a6e2-59429bbe43ab req-72d315ad-b362-4b0f-b15b-82532f5c2e91 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196802 Jun 16 14:50:20.379090 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1208/2380] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:20.399037 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38f69bc6-7c58-44c8-9e3c-3093331019e7 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:20.402109 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38f69bc6-7c58-44c8-9e3c-3093331019e7 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:20.412190 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38f69bc6-7c58-44c8-9e3c-3093331019e7 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:20.417811 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-38f69bc6-7c58-44c8-9e3c-3093331019e7 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:20.639814 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-833608d9-211e-450f-b1e8-5ffb73a38a41 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:20.640908 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-833608d9-211e-450f-b1e8-5ffb73a38a41 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:20.682117 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-833608d9-211e-450f-b1e8-5ffb73a38a41 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:20.687264 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-833608d9-211e-450f-b1e8-5ffb73a38a41 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:20.690724 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-833608d9-211e-450f-b1e8-5ffb73a38a41 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:20.694748 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-833608d9-211e-450f-b1e8-5ffb73a38a41 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:20.841291 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-833608d9-211e-450f-b1e8-5ffb73a38a41 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:20.842038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-833608d9-211e-450f-b1e8-5ffb73a38a41 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:20.852394 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-833608d9-211e-450f-b1e8-5ffb73a38a41 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lazy-loading 'fault' on Instance uuid 24da35f6-76a6-4bb9-8b00-9408845d6289 {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:50:21.067417 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-833608d9-211e-450f-b1e8-5ffb73a38a41 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22846c38ccc944339adcd2defab2beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cd81fd52f54249b82d5282cd42bf23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:21.137126 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-833608d9-211e-450f-b1e8-5ffb73a38a41 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 200 len: 1306 microversion: 2.1 time: 0.502277 Jun 16 14:50:21.174282 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1209/2381] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:20 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 1306 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:50:22.172849 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-aae0b9ca-fc33-4062-a56d-ed50812f2513 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:22.180167 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-aae0b9ca-fc33-4062-a56d-ed50812f2513 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:22.206615 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aae0b9ca-fc33-4062-a56d-ed50812f2513 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:22.217963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aae0b9ca-fc33-4062-a56d-ed50812f2513 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:22.220115 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aae0b9ca-fc33-4062-a56d-ed50812f2513 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:22.221266 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aae0b9ca-fc33-4062-a56d-ed50812f2513 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:22.265395 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-aae0b9ca-fc33-4062-a56d-ed50812f2513 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] HTTP exception thrown: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-aae0b9ca-fc33-4062-a56d-ed50812f2513 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Request method failure captured: Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 HTTP/1.1 Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0L2onkdVP9PP3dm32FqoOwisARTSZo5hpTGboj3-AG-qDu2ojhkq7o4KIz2DC3rfcto2ELwTBhmXZlktZy5Ae5cUgqtNRrz4gkatg09KMrdoNgyyiJegRUMMEcVdJtBW3ClgnoKvpbr2soKVsJq95q0CKdz6_tUWAzwO3vigYDWefU Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 08cd81fd52f54249b82d5282cd42bf23 Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_08cd81fd52f54249b82d5282cd42bf23", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08cd81fd52f54249b82d5282cd42bf23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08cd81fd52f54249b82d5282cd42bf23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/08cd81fd52f54249b82d5282cd42bf23"}]}] Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 08cd81fd52f54249b82d5282cd42bf23 Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesNegativeTestJSON-3357689-project Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 22846c38ccc944339adcd2defab2beb0 Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesNegativeTestJSON-3357689-project Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '24da35f6-76a6-4bb9-8b00-9408845d6289'} Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:22.274052 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.282326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.282326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:22.282326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:22.282326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:22.282326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:22.282326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.282326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.299042 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-aae0b9ca-fc33-4062-a56d-ed50812f2513 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Returning 404 to user: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:22.301362 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-aae0b9ca-fc33-4062-a56d-ed50812f2513 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 404 len: 111 microversion: 2.1 time: 0.136392 Jun 16 14:50:22.307478 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1210/2382] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:22 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:50:22.317833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-be88e609-d049-471e-8f35-5dc34f4b55df tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1312749855", "metadata": {"image_type": "test"}}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:22.327883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-be88e609-d049-471e-8f35-5dc34f4b55df tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:22.378455 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be88e609-d049-471e-8f35-5dc34f4b55df tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:22.379689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be88e609-d049-471e-8f35-5dc34f4b55df tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:22.381217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be88e609-d049-471e-8f35-5dc34f4b55df tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:22.382515 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be88e609-d049-471e-8f35-5dc34f4b55df tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:22.427299 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-be88e609-d049-471e-8f35-5dc34f4b55df tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] HTTP exception thrown: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-be88e609-d049-471e-8f35-5dc34f4b55df tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Request method failure captured: Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289/action HTTP/1.1 Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 112 Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0L2onkdVP9PP3dm32FqoOwisARTSZo5hpTGboj3-AG-qDu2ojhkq7o4KIz2DC3rfcto2ELwTBhmXZlktZy5Ae5cUgqtNRrz4gkatg09KMrdoNgyyiJegRUMMEcVdJtBW3ClgnoKvpbr2soKVsJq95q0CKdz6_tUWAzwO3vigYDWefU Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 08cd81fd52f54249b82d5282cd42bf23 Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_08cd81fd52f54249b82d5282cd42bf23", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08cd81fd52f54249b82d5282cd42bf23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08cd81fd52f54249b82d5282cd42bf23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/08cd81fd52f54249b82d5282cd42bf23"}]}] Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 08cd81fd52f54249b82d5282cd42bf23 Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesNegativeTestJSON-3357689-project Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 22846c38ccc944339adcd2defab2beb0 Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesNegativeTestJSON-3357689-project Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1312749855", "metadata": {"image_type": "test"}}} Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '24da35f6-76a6-4bb9-8b00-9408845d6289', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1312749855', 'metadata': {'image_type': 'test'}}}} Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 16 14:50:22.433200 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:50:22.445069 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:50:22.445069 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:50:22.445069 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:50:22.445069 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.445069 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.445069 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:22.445069 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.445069 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.445069 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:22.445069 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:22.445069 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:22.445069 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:22.445069 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.445069 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.456055 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-be88e609-d049-471e-8f35-5dc34f4b55df tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Returning 404 to user: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:22.458184 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-be88e609-d049-471e-8f35-5dc34f4b55df tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "POST /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289/action" status: 404 len: 111 microversion: 2.1 time: 0.148203 Jun 16 14:50:22.460169 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1211/2383] 10.222.0.57 () {60 vars in 1278 bytes} [Thu Jun 16 14:50:22 2022] POST /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289/action => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:50:22.493935 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3b0f87c5-afe7-4882-ae3a-b568c6033f25 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1289915246", "metadata": {"image_type": "test"}}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:22.502180 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3b0f87c5-afe7-4882-ae3a-b568c6033f25 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Failed to fetch instance by id tempest-invalid-2062456080 {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 16 14:50:22.503115 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-3b0f87c5-afe7-4882-ae3a-b568c6033f25 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] HTTP exception thrown: Instance tempest-invalid-2062456080 could not be found. Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3b0f87c5-afe7-4882-ae3a-b568c6033f25 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Request method failure captured: Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/servers/tempest-invalid-2062456080/action HTTP/1.1 Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 112 Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0L2onkdVP9PP3dm32FqoOwisARTSZo5hpTGboj3-AG-qDu2ojhkq7o4KIz2DC3rfcto2ELwTBhmXZlktZy5Ae5cUgqtNRrz4gkatg09KMrdoNgyyiJegRUMMEcVdJtBW3ClgnoKvpbr2soKVsJq95q0CKdz6_tUWAzwO3vigYDWefU Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 08cd81fd52f54249b82d5282cd42bf23 Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_08cd81fd52f54249b82d5282cd42bf23", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08cd81fd52f54249b82d5282cd42bf23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08cd81fd52f54249b82d5282cd42bf23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/08cd81fd52f54249b82d5282cd42bf23"}]}] Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 08cd81fd52f54249b82d5282cd42bf23 Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesNegativeTestJSON-3357689-project Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 22846c38ccc944339adcd2defab2beb0 Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesNegativeTestJSON-3357689-project Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1289915246", "metadata": {"image_type": "test"}}} Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance tempest-invalid-2062456080 could not be found. Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'tempest-invalid-2062456080', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1289915246', 'metadata': {'image_type': 'test'}}}} Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-2062456080 could not be found. Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-2062456080 could not be found. Jun 16 14:50:22.508250 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.524080 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:22.524080 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.524080 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.524080 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:22.524080 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:22.524080 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:22.524080 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:22.524080 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-2062456080 could not be found. Jun 16 14:50:22.524080 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.524080 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3b0f87c5-afe7-4882-ae3a-b568c6033f25 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Returning 404 to user: Instance tempest-invalid-2062456080 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:22.524080 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3b0f87c5-afe7-4882-ae3a-b568c6033f25 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "POST /compute/v2.1/servers/tempest-invalid-2062456080/action" status: 404 len: 101 microversion: 2.1 time: 0.042545 Jun 16 14:50:22.524080 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1212/2384] 10.222.0.57 () {60 vars in 1248 bytes} [Thu Jun 16 14:50:22 2022] POST /compute/v2.1/servers/tempest-invalid-2062456080/action => generated 101 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:50:22.550355 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4bb1d6de-0568-4bea-a282-93dc03cfb996 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-845112949"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:22.557342 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4bb1d6de-0568-4bea-a282-93dc03cfb996 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 16 14:50:22.558231 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-4bb1d6de-0568-4bea-a282-93dc03cfb996 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4bb1d6de-0568-4bea-a282-93dc03cfb996 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Request method failure captured: Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 56 Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0L2onkdVP9PP3dm32FqoOwisARTSZo5hpTGboj3-AG-qDu2ojhkq7o4KIz2DC3rfcto2ELwTBhmXZlktZy5Ae5cUgqtNRrz4gkatg09KMrdoNgyyiJegRUMMEcVdJtBW3ClgnoKvpbr2soKVsJq95q0CKdz6_tUWAzwO3vigYDWefU Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 08cd81fd52f54249b82d5282cd42bf23 Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_08cd81fd52f54249b82d5282cd42bf23", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08cd81fd52f54249b82d5282cd42bf23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08cd81fd52f54249b82d5282cd42bf23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/08cd81fd52f54249b82d5282cd42bf23"}]}] Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 08cd81fd52f54249b82d5282cd42bf23 Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesNegativeTestJSON-3357689-project Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 22846c38ccc944339adcd2defab2beb0 Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesNegativeTestJSON-3357689-project Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: {"createImage": {"name": "tempest-test-snap-845112949"}} Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-845112949'}}} Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 14:50:22.561182 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.570911 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:22.570911 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.570911 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.570911 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:22.570911 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:22.570911 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:22.570911 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:22.570911 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 14:50:22.570911 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.570911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4bb1d6de-0568-4bea-a282-93dc03cfb996 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:22.576190 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4bb1d6de-0568-4bea-a282-93dc03cfb996 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.048601 Jun 16 14:50:22.577105 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1213/2385] 10.222.0.57 () {60 vars in 1274 bytes} [Thu Jun 16 14:50:22 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:50:22.609659 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2e0fa5f9-1006-4ae0-ad93-166365664f72 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-660383698"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:22.611641 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2e0fa5f9-1006-4ae0-ad93-166365664f72 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 16 14:50:22.612572 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-2e0fa5f9-1006-4ae0-ad93-166365664f72 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2e0fa5f9-1006-4ae0-ad93-166365664f72 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Request method failure captured: Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 56 Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0L2onkdVP9PP3dm32FqoOwisARTSZo5hpTGboj3-AG-qDu2ojhkq7o4KIz2DC3rfcto2ELwTBhmXZlktZy5Ae5cUgqtNRrz4gkatg09KMrdoNgyyiJegRUMMEcVdJtBW3ClgnoKvpbr2soKVsJq95q0CKdz6_tUWAzwO3vigYDWefU Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 08cd81fd52f54249b82d5282cd42bf23 Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_08cd81fd52f54249b82d5282cd42bf23", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08cd81fd52f54249b82d5282cd42bf23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08cd81fd52f54249b82d5282cd42bf23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/08cd81fd52f54249b82d5282cd42bf23"}]}] Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 08cd81fd52f54249b82d5282cd42bf23 Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesNegativeTestJSON-3357689-project Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 22846c38ccc944339adcd2defab2beb0 Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesNegativeTestJSON-3357689-project Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: {"createImage": {"name": "tempest-test-snap-660383698"}} Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-660383698'}}} Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 14:50:22.632297 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.640043 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:22.640043 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.640043 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.640043 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:22.640043 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:22.640043 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:22.640043 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:22.640043 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 16 14:50:22.640043 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.640043 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2e0fa5f9-1006-4ae0-ad93-166365664f72 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:22.643854 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2e0fa5f9-1006-4ae0-ad93-166365664f72 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.063598 Jun 16 14:50:22.652345 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1214/2386] 10.222.0.57 () {60 vars in 1280 bytes} [Thu Jun 16 14:50:22 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:50:22.672552 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-007bda5a-c021-4513-9fc7-4bb2f15eeb6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:22.684848 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-007bda5a-c021-4513-9fc7-4bb2f15eeb6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:22.705908 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-007bda5a-c021-4513-9fc7-4bb2f15eeb6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:22.717781 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-007bda5a-c021-4513-9fc7-4bb2f15eeb6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:22.730313 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-007bda5a-c021-4513-9fc7-4bb2f15eeb6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:22.731744 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-007bda5a-c021-4513-9fc7-4bb2f15eeb6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:22.775544 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-007bda5a-c021-4513-9fc7-4bb2f15eeb6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] HTTP exception thrown: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-007bda5a-c021-4513-9fc7-4bb2f15eeb6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Request method failure captured: Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 HTTP/1.1 Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0L2onkdVP9PP3dm32FqoOwisARTSZo5hpTGboj3-AG-qDu2ojhkq7o4KIz2DC3rfcto2ELwTBhmXZlktZy5Ae5cUgqtNRrz4gkatg09KMrdoNgyyiJegRUMMEcVdJtBW3ClgnoKvpbr2soKVsJq95q0CKdz6_tUWAzwO3vigYDWefU Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 08cd81fd52f54249b82d5282cd42bf23 Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_08cd81fd52f54249b82d5282cd42bf23", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08cd81fd52f54249b82d5282cd42bf23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08cd81fd52f54249b82d5282cd42bf23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/08cd81fd52f54249b82d5282cd42bf23"}]}] Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 08cd81fd52f54249b82d5282cd42bf23 Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesNegativeTestJSON-3357689-project Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 22846c38ccc944339adcd2defab2beb0 Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesNegativeTestJSON-3357689-project Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '24da35f6-76a6-4bb9-8b00-9408845d6289'} Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:50:22.787729 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:50:22.796963 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.796963 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.796963 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:22.796963 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.796963 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.796963 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:22.796963 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:22.796963 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:22.796963 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:22.796963 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.796963 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.803295 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-007bda5a-c021-4513-9fc7-4bb2f15eeb6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Returning 404 to user: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:22.803295 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-007bda5a-c021-4513-9fc7-4bb2f15eeb6d tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "DELETE /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 404 len: 111 microversion: 2.1 time: 0.146650 Jun 16 14:50:22.803936 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1215/2387] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:50:22 2022] DELETE /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:50:22.815249 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c7efaa77-b68e-4c26-a859-96671fca17c6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:22.816755 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c7efaa77-b68e-4c26-a859-96671fca17c6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] [instance: 24da35f6-76a6-4bb9-8b00-9408845d6289] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:22.829557 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c7efaa77-b68e-4c26-a859-96671fca17c6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:22.831013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c7efaa77-b68e-4c26-a859-96671fca17c6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:22.832899 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c7efaa77-b68e-4c26-a859-96671fca17c6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:22.833912 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c7efaa77-b68e-4c26-a859-96671fca17c6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:22.887982 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-c7efaa77-b68e-4c26-a859-96671fca17c6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] HTTP exception thrown: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c7efaa77-b68e-4c26-a859-96671fca17c6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Request method failure captured: Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 HTTP/1.1 Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0L2onkdVP9PP3dm32FqoOwisARTSZo5hpTGboj3-AG-qDu2ojhkq7o4KIz2DC3rfcto2ELwTBhmXZlktZy5Ae5cUgqtNRrz4gkatg09KMrdoNgyyiJegRUMMEcVdJtBW3ClgnoKvpbr2soKVsJq95q0CKdz6_tUWAzwO3vigYDWefU Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 08cd81fd52f54249b82d5282cd42bf23 Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_08cd81fd52f54249b82d5282cd42bf23", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08cd81fd52f54249b82d5282cd42bf23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/08cd81fd52f54249b82d5282cd42bf23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/08cd81fd52f54249b82d5282cd42bf23"}]}] Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 08cd81fd52f54249b82d5282cd42bf23 Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-3357689 Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesNegativeTestJSON-3357689-project Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 22846c38ccc944339adcd2defab2beb0 Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesNegativeTestJSON-3357689-project Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '24da35f6-76a6-4bb9-8b00-9408845d6289'} Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:22.891628 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.897824 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:22.897824 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:22.897824 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:22.897824 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:22.897824 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:22.897824 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. Jun 16 14:50:22.897824 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:50:22.901988 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c7efaa77-b68e-4c26-a859-96671fca17c6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] Returning 404 to user: Instance 24da35f6-76a6-4bb9-8b00-9408845d6289 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:22.903946 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c7efaa77-b68e-4c26-a859-96671fca17c6 tempest-ImagesNegativeTestJSON-3357689 tempest-ImagesNegativeTestJSON-3357689-project] 10.222.0.57 "GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289" status: 404 len: 111 microversion: 2.1 time: 0.095640 Jun 16 14:50:22.905501 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1216/2388] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:22 2022] GET /compute/v2.1/servers/24da35f6-76a6-4bb9-8b00-9408845d6289 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:50:22.916442 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "0334ee08-1767-4bb0-81bd-98ff92772afb"}], "security_groups": [{"name": "tempest-securitygroup--1399195656"}], "key_name": "tempest-keypair-577065716", "user_data": "}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:23.421774 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=4 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:23.434711 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] validate_networks() for [('0334ee08-1767-4bb0-81bd-98ff92772afb', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:50:23.594729 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=36 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:24.026288 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-38f69bc6-7c58-44c8-9e3c-3093331019e7 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:24.047463 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-38f69bc6-7c58-44c8-9e3c-3093331019e7 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1317 microversion: 2.1 time: 3.694059 Jun 16 14:50:24.052970 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1173/2389] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:20 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1317 bytes in 3700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:24.395916 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1143630037", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "8f2bdb2a-89e7-4760-bf67-a768c01f1b49"}]}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:24.436775 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:24.545339 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] validate_networks() for [('8f2bdb2a-89e7-4760-bf67-a768c01f1b49', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:50:24.859470 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=9 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:25.354788 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:50:25.355309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:50:25.356629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:50:25.357667 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:50:25.358731 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:50:25.372639 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=24 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:25.416663 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:25.417301 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:25.418977 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:25.419583 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:25.475349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Getting quotas for project 8f5198d96e9344898c15d63c0aa8615b. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:50:25.493123 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Getting quotas for user 60631612044343e1ad556690ed0eabe7 and project 8f5198d96e9344898c15d63c0aa8615b. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:50:25.534661 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:50:25.540713 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:50:25.688838 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c722e1ed-22d2-4a0f-876d-b4ba0682816f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.780558 Jun 16 14:50:25.701805 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1217/2390] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:50:22 2022] POST /compute/v2.1/servers => generated 409 bytes in 2795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:50:25.717039 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8028243c-2d3d-4ba9-9dca-307800ce57c0 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:25.720417 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8028243c-2d3d-4ba9-9dca-307800ce57c0 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:25.742138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8028243c-2d3d-4ba9-9dca-307800ce57c0 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:25.744728 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8028243c-2d3d-4ba9-9dca-307800ce57c0 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:25.747495 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8028243c-2d3d-4ba9-9dca-307800ce57c0 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:25.748845 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8028243c-2d3d-4ba9-9dca-307800ce57c0 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:26.302927 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8028243c-2d3d-4ba9-9dca-307800ce57c0 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:26.338868 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8028243c-2d3d-4ba9-9dca-307800ce57c0 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1317 microversion: 2.1 time: 0.632622 Jun 16 14:50:26.343926 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1218/2391] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:25 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1317 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:26.371629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-92b44d83-090d-49b8-9ada-2a64880884c0 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:26.374665 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-92b44d83-090d-49b8-9ada-2a64880884c0 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:26.973533 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-92b44d83-090d-49b8-9ada-2a64880884c0 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:27.000320 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-92b44d83-090d-49b8-9ada-2a64880884c0 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1225 microversion: 2.1 time: 0.654074 Jun 16 14:50:27.006191 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1219/2392] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:26 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1225 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:27.376586 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b2a97b99-f8bd-4fc5-864d-e81b5f416fd8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:27.383078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b2a97b99-f8bd-4fc5-864d-e81b5f416fd8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:27.411022 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2a97b99-f8bd-4fc5-864d-e81b5f416fd8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:27.425759 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2a97b99-f8bd-4fc5-864d-e81b5f416fd8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:27.426888 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2a97b99-f8bd-4fc5-864d-e81b5f416fd8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:27.427963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b2a97b99-f8bd-4fc5-864d-e81b5f416fd8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:28.183994 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b2a97b99-f8bd-4fc5-864d-e81b5f416fd8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:28.201259 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b2a97b99-f8bd-4fc5-864d-e81b5f416fd8 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1317 microversion: 2.1 time: 0.833060 Jun 16 14:50:28.218452 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1220/2393] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:27 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1317 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:50:28.241181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f0a75870-1a97-4b7d-8099-da4d491ea0b5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:28.255654 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f0a75870-1a97-4b7d-8099-da4d491ea0b5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:28.325446 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f0a75870-1a97-4b7d-8099-da4d491ea0b5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:28.338836 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f0a75870-1a97-4b7d-8099-da4d491ea0b5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:28.340866 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f0a75870-1a97-4b7d-8099-da4d491ea0b5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:28.350758 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f0a75870-1a97-4b7d-8099-da4d491ea0b5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:28.713209 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f0a75870-1a97-4b7d-8099-da4d491ea0b5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:28.770563 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f0a75870-1a97-4b7d-8099-da4d491ea0b5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1277 microversion: 2.1 time: 0.553922 Jun 16 14:50:28.789791 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1221/2394] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:28 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1277 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:29.302618 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-501530764", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:29.472554 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:50:29.474809 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:50:29.476183 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:50:29.477359 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:50:29.481317 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:50:29.533432 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:29.540029 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:29.549311 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:29.550772 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:29.607819 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] validate_networks() for None {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:50:29.637156 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Getting quotas for project aa616e014da1416aa7369181bd1518e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:50:29.656115 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Getting quotas for user 4e78da3d7a6f45d7abe04bc447f7c870 and project aa616e014da1416aa7369181bd1518e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:50:29.724141 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:50:29.727028 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:50:29.888196 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1f7846de-461e-4c01-90e9-7126bea6fa17 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.832474 Jun 16 14:50:29.888882 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1174/2395] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:50:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 5834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:50:29.912438 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c5931725-6818-4d46-b0e6-a49153f0ee2c tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:29.913111 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c5931725-6818-4d46-b0e6-a49153f0ee2c tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:29.939358 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c5931725-6818-4d46-b0e6-a49153f0ee2c tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:29.939719 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c5931725-6818-4d46-b0e6-a49153f0ee2c tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:29.940555 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c5931725-6818-4d46-b0e6-a49153f0ee2c tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:29.941013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c5931725-6818-4d46-b0e6-a49153f0ee2c tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:30.212538 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:50:30.213651 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:50:30.218329 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:50:30.219243 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:50:30.220035 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:50:30.275422 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:30.276268 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:30.278744 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:30.279515 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:30.314947 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Getting quotas for project 516446d68e6b452c83140a9cf4625619. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:50:30.325981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:30.327664 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Getting quotas for user 00c2308f7caf47369c442b63533253de and project 516446d68e6b452c83140a9cf4625619. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:50:30.380083 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:50:30.389669 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:50:30.562596 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e42afa7a-92cf-4e06-b210-a064c0f98f62 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.764153 Jun 16 14:50:30.572373 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1222/2396] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:50:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:50:30.598355 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9c065b06-d40e-47e7-9799-d05ffbb4236e tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:30.599260 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9c065b06-d40e-47e7-9799-d05ffbb4236e tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:30.640330 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9c065b06-d40e-47e7-9799-d05ffbb4236e tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:30.643027 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9c065b06-d40e-47e7-9799-d05ffbb4236e tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:30.647202 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9c065b06-d40e-47e7-9799-d05ffbb4236e tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:30.651149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9c065b06-d40e-47e7-9799-d05ffbb4236e tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:31.401978 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9c065b06-d40e-47e7-9799-d05ffbb4236e tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:31.452390 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9c065b06-d40e-47e7-9799-d05ffbb4236e tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1283 microversion: 2.1 time: 0.860938 Jun 16 14:50:31.455354 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1223/2397] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:30 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1283 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:31.499031 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c8eed810-cf70-4069-bfee-bfcd7a9d98d5 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:31.509385 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c8eed810-cf70-4069-bfee-bfcd7a9d98d5 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:31.780213 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c8eed810-cf70-4069-bfee-bfcd7a9d98d5 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:31.822818 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c8eed810-cf70-4069-bfee-bfcd7a9d98d5 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1215 microversion: 2.1 time: 0.356676 Jun 16 14:50:31.824804 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1224/2398] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:31 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1215 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:31.843916 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8a6984ab-9cdd-45a9-9abd-87e6c01418d5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:31.848038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8a6984ab-9cdd-45a9-9abd-87e6c01418d5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:32.195616 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8a6984ab-9cdd-45a9-9abd-87e6c01418d5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:32.231967 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8a6984ab-9cdd-45a9-9abd-87e6c01418d5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1216 microversion: 2.1 time: 0.404617 Jun 16 14:50:32.237573 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1225/2399] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:31 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1216 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:32.476818 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d56416b6-643d-4481-bb88-6bdcc70ea43c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:32.479257 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d56416b6-643d-4481-bb88-6bdcc70ea43c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:32.514020 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d56416b6-643d-4481-bb88-6bdcc70ea43c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:32.515289 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d56416b6-643d-4481-bb88-6bdcc70ea43c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:32.528521 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d56416b6-643d-4481-bb88-6bdcc70ea43c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:32.530448 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d56416b6-643d-4481-bb88-6bdcc70ea43c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:32.769419 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d56416b6-643d-4481-bb88-6bdcc70ea43c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:32.811187 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d56416b6-643d-4481-bb88-6bdcc70ea43c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1283 microversion: 2.1 time: 0.341212 Jun 16 14:50:32.812710 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1226/2400] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:32 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1283 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:32.858602 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-877acc55-bd8c-452e-91d7-99819be6d731 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:32.861313 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-877acc55-bd8c-452e-91d7-99819be6d731 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:32.890202 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-877acc55-bd8c-452e-91d7-99819be6d731 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:32.895917 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-877acc55-bd8c-452e-91d7-99819be6d731 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:32.901944 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-877acc55-bd8c-452e-91d7-99819be6d731 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:32.903181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-877acc55-bd8c-452e-91d7-99819be6d731 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:33.632965 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-877acc55-bd8c-452e-91d7-99819be6d731 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:33.649744 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-877acc55-bd8c-452e-91d7-99819be6d731 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1267 microversion: 2.1 time: 0.810925 Jun 16 14:50:33.663445 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1227/2401] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:32 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1267 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:33.701604 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c5931725-6818-4d46-b0e6-a49153f0ee2c tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:33.729356 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0414638a-6428-4ce4-8057-68f2d890fd74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:33.738422 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0414638a-6428-4ce4-8057-68f2d890fd74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:33.756035 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c5931725-6818-4d46-b0e6-a49153f0ee2c tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1317 microversion: 2.1 time: 3.844602 Jun 16 14:50:33.757746 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1175/2402] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:29 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1317 bytes in 3868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:33.842677 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0414638a-6428-4ce4-8057-68f2d890fd74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:33.891945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-a7b25d00-175b-46f1-8dcb-05bcd9a67583 req-4e3b62d4-ce7a-481e-b97f-e564de1ffccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be464d9-2abf-480e-9511-7a4ec415ce2a", "tag": "5bc6aa8b-e395-4b98-abff-087bfaa42324"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:33.896442 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0414638a-6428-4ce4-8057-68f2d890fd74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:33.905004 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0414638a-6428-4ce4-8057-68f2d890fd74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:33.905960 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0414638a-6428-4ce4-8057-68f2d890fd74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:33.980549 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-a7b25d00-175b-46f1-8dcb-05bcd9a67583 req-4e3b62d4-ce7a-481e-b97f-e564de1ffccc service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:33.984820 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-a7b25d00-175b-46f1-8dcb-05bcd9a67583 req-4e3b62d4-ce7a-481e-b97f-e564de1ffccc service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:34.092837 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-a7b25d00-175b-46f1-8dcb-05bcd9a67583 req-4e3b62d4-ce7a-481e-b97f-e564de1ffccc service nova] Creating event network-changed:5bc6aa8b-e395-4b98-abff-087bfaa42324 for instance 1be464d9-2abf-480e-9511-7a4ec415ce2a on n-h1-836830-4 Jun 16 14:50:34.127554 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-a7b25d00-175b-46f1-8dcb-05bcd9a67583 req-4e3b62d4-ce7a-481e-b97f-e564de1ffccc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.348380 Jun 16 14:50:34.135511 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1176/2403] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:34.182891 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fba16246-09af-4569-9cfa-bd0f672db3b7 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:34.189434 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fba16246-09af-4569-9cfa-bd0f672db3b7 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:34.221055 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fba16246-09af-4569-9cfa-bd0f672db3b7 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:34.228888 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fba16246-09af-4569-9cfa-bd0f672db3b7 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:34.233699 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fba16246-09af-4569-9cfa-bd0f672db3b7 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:34.235044 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fba16246-09af-4569-9cfa-bd0f672db3b7 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:34.338065 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0414638a-6428-4ce4-8057-68f2d890fd74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:34.368057 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0414638a-6428-4ce4-8057-68f2d890fd74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1268 microversion: 2.1 time: 0.693170 Jun 16 14:50:34.382250 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1228/2404] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:33 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1268 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:34.705956 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-df22d297-10a1-48e3-ab7e-313c34481925 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:34.719472 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-df22d297-10a1-48e3-ab7e-313c34481925 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:34.773372 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-df22d297-10a1-48e3-ab7e-313c34481925 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:34.785547 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-df22d297-10a1-48e3-ab7e-313c34481925 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:34.791618 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-df22d297-10a1-48e3-ab7e-313c34481925 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:34.804525 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-df22d297-10a1-48e3-ab7e-313c34481925 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:35.252497 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-df22d297-10a1-48e3-ab7e-313c34481925 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:35.296065 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-df22d297-10a1-48e3-ab7e-313c34481925 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1273 microversion: 2.1 time: 0.606056 Jun 16 14:50:35.297925 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1229/2405] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:34 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1273 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:35.322661 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fba16246-09af-4569-9cfa-bd0f672db3b7 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:35.354006 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6c7728c6-ac8e-4af3-8f5b-f82364e05a97 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:35.355941 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6c7728c6-ac8e-4af3-8f5b-f82364e05a97 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:35.389189 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fba16246-09af-4569-9cfa-bd0f672db3b7 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1283 microversion: 2.1 time: 1.241961 Jun 16 14:50:35.389685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c7728c6-ac8e-4af3-8f5b-f82364e05a97 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:35.390174 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c7728c6-ac8e-4af3-8f5b-f82364e05a97 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:35.391028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c7728c6-ac8e-4af3-8f5b-f82364e05a97 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:35.395210 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1177/2406] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:34 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1283 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:35.410193 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c7728c6-ac8e-4af3-8f5b-f82364e05a97 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:35.423378 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7d688d44-8a2d-420b-bfff-27e8f1a485ce tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:35.425090 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7d688d44-8a2d-420b-bfff-27e8f1a485ce tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:35.440181 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7d688d44-8a2d-420b-bfff-27e8f1a485ce tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:35.441471 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7d688d44-8a2d-420b-bfff-27e8f1a485ce tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:35.444327 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7d688d44-8a2d-420b-bfff-27e8f1a485ce tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:35.446034 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7d688d44-8a2d-420b-bfff-27e8f1a485ce tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:36.039587 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6c7728c6-ac8e-4af3-8f5b-f82364e05a97 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:36.056849 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6c7728c6-ac8e-4af3-8f5b-f82364e05a97 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1317 microversion: 2.1 time: 0.754601 Jun 16 14:50:36.059696 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1230/2407] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:35 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1317 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:36.331436 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b709dde9-59df-4e1c-9d90-860f7f6940fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:36.332076 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b709dde9-59df-4e1c-9d90-860f7f6940fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:36.350072 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b709dde9-59df-4e1c-9d90-860f7f6940fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:36.353092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b709dde9-59df-4e1c-9d90-860f7f6940fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:36.354206 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b709dde9-59df-4e1c-9d90-860f7f6940fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:36.355122 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b709dde9-59df-4e1c-9d90-860f7f6940fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:36.674307 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7d688d44-8a2d-420b-bfff-27e8f1a485ce tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:36.717714 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7d688d44-8a2d-420b-bfff-27e8f1a485ce tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1274 microversion: 2.1 time: 1.309566 Jun 16 14:50:36.759131 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1178/2408] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:35 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1274 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:36.785844 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1a83901a-fffc-48d8-bb02-c7f6e6b109fe tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:36.792778 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1a83901a-fffc-48d8-bb02-c7f6e6b109fe tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:36.819030 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a83901a-fffc-48d8-bb02-c7f6e6b109fe tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:36.824367 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a83901a-fffc-48d8-bb02-c7f6e6b109fe tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:36.827592 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a83901a-fffc-48d8-bb02-c7f6e6b109fe tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:36.835796 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1a83901a-fffc-48d8-bb02-c7f6e6b109fe tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:36.856282 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b709dde9-59df-4e1c-9d90-860f7f6940fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:36.889956 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b709dde9-59df-4e1c-9d90-860f7f6940fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1273 microversion: 2.1 time: 0.564904 Jun 16 14:50:36.921241 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1231/2409] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:36 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1273 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:36.987271 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-6863605d-2e21-43a9-9fe8-4513daf8bac2 req-6180c08e-3ac1-4039-ac9c-9b5a38a11695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1972ad93-7fd8-4543-8c50-9f3948d5be42", "tag": "dffb6435-1d69-4ea3-8dd2-4cd53a4fefd2"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:37.051181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-6863605d-2e21-43a9-9fe8-4513daf8bac2 req-6180c08e-3ac1-4039-ac9c-9b5a38a11695 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:37.056896 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-6863605d-2e21-43a9-9fe8-4513daf8bac2 req-6180c08e-3ac1-4039-ac9c-9b5a38a11695 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:37.112683 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-6863605d-2e21-43a9-9fe8-4513daf8bac2 req-6180c08e-3ac1-4039-ac9c-9b5a38a11695 service nova] Creating event network-changed:dffb6435-1d69-4ea3-8dd2-4cd53a4fefd2 for instance 1972ad93-7fd8-4543-8c50-9f3948d5be42 on n-h1-836830-4 Jun 16 14:50:37.135254 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-6863605d-2e21-43a9-9fe8-4513daf8bac2 req-6180c08e-3ac1-4039-ac9c-9b5a38a11695 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152269 Jun 16 14:50:37.138250 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1232/2410] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:37.161945 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-78355ee6-3368-4a47-8c0b-dcb417ec9135 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:37.167270 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-78355ee6-3368-4a47-8c0b-dcb417ec9135 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:37.203263 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78355ee6-3368-4a47-8c0b-dcb417ec9135 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:37.209313 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78355ee6-3368-4a47-8c0b-dcb417ec9135 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:37.212716 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78355ee6-3368-4a47-8c0b-dcb417ec9135 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:37.213539 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-78355ee6-3368-4a47-8c0b-dcb417ec9135 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:37.735565 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1a83901a-fffc-48d8-bb02-c7f6e6b109fe tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:37.758660 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1a83901a-fffc-48d8-bb02-c7f6e6b109fe tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1283 microversion: 2.1 time: 0.995706 Jun 16 14:50:37.764639 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1179/2411] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:36 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1283 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:37.785908 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-49130805-c626-4af2-bdf6-ba33580a38f9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:37.791513 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-49130805-c626-4af2-bdf6-ba33580a38f9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:37.820979 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-49130805-c626-4af2-bdf6-ba33580a38f9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:37.823520 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-49130805-c626-4af2-bdf6-ba33580a38f9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:37.832344 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-49130805-c626-4af2-bdf6-ba33580a38f9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:37.833571 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-49130805-c626-4af2-bdf6-ba33580a38f9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:38.808480 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-49130805-c626-4af2-bdf6-ba33580a38f9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:38.855100 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-49130805-c626-4af2-bdf6-ba33580a38f9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1274 microversion: 2.1 time: 1.071124 Jun 16 14:50:38.857894 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1180/2412] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:37 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1274 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:38.883230 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2a312307-9be5-473f-87cf-642ab8e2e3c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:38.888334 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2a312307-9be5-473f-87cf-642ab8e2e3c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:38.925908 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a312307-9be5-473f-87cf-642ab8e2e3c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:38.927432 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a312307-9be5-473f-87cf-642ab8e2e3c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:38.934164 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a312307-9be5-473f-87cf-642ab8e2e3c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:38.942922 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2a312307-9be5-473f-87cf-642ab8e2e3c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:39.085378 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-78355ee6-3368-4a47-8c0b-dcb417ec9135 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:39.119866 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-78355ee6-3368-4a47-8c0b-dcb417ec9135 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1317 microversion: 2.1 time: 1.976665 Jun 16 14:50:39.121346 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1233/2413] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:37 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1317 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:39.145342 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1a8def20-25fa-44ec-a4a8-a3584342bd6a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:39.146587 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1a8def20-25fa-44ec-a4a8-a3584342bd6a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:39.172621 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1a8def20-25fa-44ec-a4a8-a3584342bd6a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:39.173468 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1a8def20-25fa-44ec-a4a8-a3584342bd6a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:39.174951 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1a8def20-25fa-44ec-a4a8-a3584342bd6a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:39.181116 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1a8def20-25fa-44ec-a4a8-a3584342bd6a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:39.448141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1a8def20-25fa-44ec-a4a8-a3584342bd6a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:39.496017 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1a8def20-25fa-44ec-a4a8-a3584342bd6a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1283 microversion: 2.1 time: 0.371546 Jun 16 14:50:39.497078 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1234/2414] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:39 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1283 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:39.595356 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:39.629178 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2a312307-9be5-473f-87cf-642ab8e2e3c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:39.717644 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=6 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:39.740885 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2a312307-9be5-473f-87cf-642ab8e2e3c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1273 microversion: 2.1 time: 0.879946 Jun 16 14:50:39.779566 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1181/2415] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:38 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1273 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:39.879579 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-30f71639-7e1b-48c4-90d4-967ff585e327 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:39.879579 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-30f71639-7e1b-48c4-90d4-967ff585e327 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:39.916754 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-30f71639-7e1b-48c4-90d4-967ff585e327 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:39.918344 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-30f71639-7e1b-48c4-90d4-967ff585e327 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:39.925828 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-30f71639-7e1b-48c4-90d4-967ff585e327 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:39.927141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-30f71639-7e1b-48c4-90d4-967ff585e327 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:39.948412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:40.149317 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-de0cf767-2e43-45d5-8523-b58e18c82a68 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:40.157945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-de0cf767-2e43-45d5-8523-b58e18c82a68 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:40.220857 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de0cf767-2e43-45d5-8523-b58e18c82a68 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:40.225414 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de0cf767-2e43-45d5-8523-b58e18c82a68 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:40.239493 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de0cf767-2e43-45d5-8523-b58e18c82a68 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:40.240299 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-de0cf767-2e43-45d5-8523-b58e18c82a68 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:40.301388 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:40.574708 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-30f71639-7e1b-48c4-90d4-967ff585e327 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:40.594719 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-30f71639-7e1b-48c4-90d4-967ff585e327 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1274 microversion: 2.1 time: 0.723957 Jun 16 14:50:40.598301 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1235/2416] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:39 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1274 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:40.608802 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-64025363-d6be-42e6-b46f-a5f900e52358 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:40.611126 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-64025363-d6be-42e6-b46f-a5f900e52358 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:40.628524 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-64025363-d6be-42e6-b46f-a5f900e52358 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:40.629345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-64025363-d6be-42e6-b46f-a5f900e52358 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:40.630331 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-64025363-d6be-42e6-b46f-a5f900e52358 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:40.635124 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-64025363-d6be-42e6-b46f-a5f900e52358 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:40.863180 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-64025363-d6be-42e6-b46f-a5f900e52358 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:40.889510 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-64025363-d6be-42e6-b46f-a5f900e52358 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1283 microversion: 2.1 time: 0.289454 Jun 16 14:50:40.918016 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1236/2417] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:40 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1283 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:40.945003 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-00c06d37-84b6-4095-857b-c4e3df502a07 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:40.947266 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-00c06d37-84b6-4095-857b-c4e3df502a07 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:40.976154 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00c06d37-84b6-4095-857b-c4e3df502a07 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:40.977850 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00c06d37-84b6-4095-857b-c4e3df502a07 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:40.979175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00c06d37-84b6-4095-857b-c4e3df502a07 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:40.981298 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00c06d37-84b6-4095-857b-c4e3df502a07 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:41.206100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-00c06d37-84b6-4095-857b-c4e3df502a07 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:41.225608 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-00c06d37-84b6-4095-857b-c4e3df502a07 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1273 microversion: 2.1 time: 0.306221 Jun 16 14:50:41.231377 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1237/2418] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:40 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1273 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:41.711627 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a3147399-c9f6-43ae-8af1-c15c19b5883c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1852820829", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": "none"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:41.845176 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a3147399-c9f6-43ae-8af1-c15c19b5883c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:50:41.845621 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a3147399-c9f6-43ae-8af1-c15c19b5883c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:50:41.846158 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a3147399-c9f6-43ae-8af1-c15c19b5883c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:50:41.848431 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a3147399-c9f6-43ae-8af1-c15c19b5883c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:50:41.848935 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a3147399-c9f6-43ae-8af1-c15c19b5883c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:50:41.873717 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3147399-c9f6-43ae-8af1-c15c19b5883c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:41.874167 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3147399-c9f6-43ae-8af1-c15c19b5883c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:41.876581 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3147399-c9f6-43ae-8af1-c15c19b5883c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:41.877248 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a3147399-c9f6-43ae-8af1-c15c19b5883c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:41.927369 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-a3147399-c9f6-43ae-8af1-c15c19b5883c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Getting quotas for project 9b9dcec2ee344669a21194366f617d15. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:50:41.937775 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-a3147399-c9f6-43ae-8af1-c15c19b5883c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Getting quotas for user b1df05dddb19478cb6d5966c027d23fb and project 9b9dcec2ee344669a21194366f617d15. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:50:41.962202 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a3147399-c9f6-43ae-8af1-c15c19b5883c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:50:41.967352 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a3147399-c9f6-43ae-8af1-c15c19b5883c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:50:42.165799 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a3147399-c9f6-43ae-8af1-c15c19b5883c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.931166 Jun 16 14:50:42.167927 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1238/2419] 10.222.0.57 () {62 vars in 1187 bytes} [Thu Jun 16 14:50:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 14:50:42.216118 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-90e45b2e-e016-4f3d-8c08-4dc5eb225ebf tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:42.226156 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-90e45b2e-e016-4f3d-8c08-4dc5eb225ebf tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:42.259006 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-90e45b2e-e016-4f3d-8c08-4dc5eb225ebf tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:42.260274 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-de0cf767-2e43-45d5-8523-b58e18c82a68 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:42.262347 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-90e45b2e-e016-4f3d-8c08-4dc5eb225ebf tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:42.264201 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-90e45b2e-e016-4f3d-8c08-4dc5eb225ebf tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:42.268654 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-90e45b2e-e016-4f3d-8c08-4dc5eb225ebf tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:42.335286 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:42.355074 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-de0cf767-2e43-45d5-8523-b58e18c82a68 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1317 microversion: 2.1 time: 2.213707 Jun 16 14:50:42.371505 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1182/2420] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:40 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1317 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:42.402808 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9b3aa81c-9ed5-4c08-b1f4-6d2cbd6d24fa tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:42.417678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9b3aa81c-9ed5-4c08-b1f4-6d2cbd6d24fa tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:42.475046 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9b3aa81c-9ed5-4c08-b1f4-6d2cbd6d24fa tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:42.475995 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9b3aa81c-9ed5-4c08-b1f4-6d2cbd6d24fa tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:42.478189 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9b3aa81c-9ed5-4c08-b1f4-6d2cbd6d24fa tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:42.479038 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9b3aa81c-9ed5-4c08-b1f4-6d2cbd6d24fa tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:42.587446 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-90e45b2e-e016-4f3d-8c08-4dc5eb225ebf tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:42.624081 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-90e45b2e-e016-4f3d-8c08-4dc5eb225ebf tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1274 microversion: 2.1 time: 0.453132 Jun 16 14:50:42.625314 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1239/2421] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:42 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1274 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:42.647197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-443530d4-4a1d-435f-892f-f1bfc66d50d6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:42.649512 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-443530d4-4a1d-435f-892f-f1bfc66d50d6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:42.868847 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9b3aa81c-9ed5-4c08-b1f4-6d2cbd6d24fa tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:42.881691 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9b3aa81c-9ed5-4c08-b1f4-6d2cbd6d24fa tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1283 microversion: 2.1 time: 0.505827 Jun 16 14:50:42.882919 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1183/2422] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:42 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1283 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:42.912739 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-db258dd4-7e2c-4d0d-b9de-e1adddd8e887 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:42.914229 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-db258dd4-7e2c-4d0d-b9de-e1adddd8e887 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:42.965273 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-db258dd4-7e2c-4d0d-b9de-e1adddd8e887 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:42.965879 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-db258dd4-7e2c-4d0d-b9de-e1adddd8e887 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:42.967422 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-db258dd4-7e2c-4d0d-b9de-e1adddd8e887 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:42.970347 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-db258dd4-7e2c-4d0d-b9de-e1adddd8e887 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:43.060519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-443530d4-4a1d-435f-892f-f1bfc66d50d6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:43.115453 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-443530d4-4a1d-435f-892f-f1bfc66d50d6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:43.123952 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-443530d4-4a1d-435f-892f-f1bfc66d50d6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:43.155958 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-443530d4-4a1d-435f-892f-f1bfc66d50d6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "PUT /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1359 microversion: 2.75 time: 0.527488 Jun 16 14:50:43.186033 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1240/2423] 10.222.0.57 () {62 vars in 1296 bytes} [Thu Jun 16 14:50:42 2022] PUT /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1359 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:43.212217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-691d0c31-9c1e-4841-97f3-cabfc2d7ebfb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:43.216396 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-691d0c31-9c1e-4841-97f3-cabfc2d7ebfb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:43.405524 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-691d0c31-9c1e-4841-97f3-cabfc2d7ebfb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:43.426307 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-691d0c31-9c1e-4841-97f3-cabfc2d7ebfb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:43.428600 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-691d0c31-9c1e-4841-97f3-cabfc2d7ebfb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:43.436006 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-691d0c31-9c1e-4841-97f3-cabfc2d7ebfb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1359 microversion: 2.75 time: 0.241790 Jun 16 14:50:43.449938 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1241/2424] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:43 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:50:43.457899 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8f815ae3-5298-4f06-9a7b-cb6cc2d08395 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:43.460279 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8f815ae3-5298-4f06-9a7b-cb6cc2d08395 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:43.493348 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f815ae3-5298-4f06-9a7b-cb6cc2d08395 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:43.493997 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f815ae3-5298-4f06-9a7b-cb6cc2d08395 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:43.495253 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f815ae3-5298-4f06-9a7b-cb6cc2d08395 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:43.495956 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f815ae3-5298-4f06-9a7b-cb6cc2d08395 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:44.240276 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8f815ae3-5298-4f06-9a7b-cb6cc2d08395 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:44.282997 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8f815ae3-5298-4f06-9a7b-cb6cc2d08395 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1317 microversion: 2.1 time: 0.830864 Jun 16 14:50:44.284132 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1242/2425] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:43 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1317 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:44.307619 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-23fb0b71-5e6d-49f3-a091-65bd6cfb0589 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:44.314281 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-23fb0b71-5e6d-49f3-a091-65bd6cfb0589 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:44.376570 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23fb0b71-5e6d-49f3-a091-65bd6cfb0589 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:44.380204 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23fb0b71-5e6d-49f3-a091-65bd6cfb0589 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:44.386641 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23fb0b71-5e6d-49f3-a091-65bd6cfb0589 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:44.388170 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23fb0b71-5e6d-49f3-a091-65bd6cfb0589 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:44.746560 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-23fb0b71-5e6d-49f3-a091-65bd6cfb0589 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:44.760732 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-23fb0b71-5e6d-49f3-a091-65bd6cfb0589 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1274 microversion: 2.1 time: 0.475150 Jun 16 14:50:44.764331 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1243/2426] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:44 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1274 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:44.780857 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a53a4ce9-7052-4e05-b1ee-49cd4d874bb5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:44.781078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a53a4ce9-7052-4e05-b1ee-49cd4d874bb5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:44.804085 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a53a4ce9-7052-4e05-b1ee-49cd4d874bb5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:44.804598 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a53a4ce9-7052-4e05-b1ee-49cd4d874bb5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:44.806537 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a53a4ce9-7052-4e05-b1ee-49cd4d874bb5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:44.807070 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a53a4ce9-7052-4e05-b1ee-49cd4d874bb5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:45.183848 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-db258dd4-7e2c-4d0d-b9de-e1adddd8e887 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:45.206112 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-db258dd4-7e2c-4d0d-b9de-e1adddd8e887 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1315 microversion: 2.1 time: 2.313830 Jun 16 14:50:45.217151 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1184/2427] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:42 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1315 bytes in 2326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:45.222301 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f1da652a-d701-47e7-80c1-294c9898772a tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:45.222971 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f1da652a-d701-47e7-80c1-294c9898772a tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:45.266735 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f1da652a-d701-47e7-80c1-294c9898772a tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:45.273615 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f1da652a-d701-47e7-80c1-294c9898772a tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:45.277496 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f1da652a-d701-47e7-80c1-294c9898772a tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:45.281391 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f1da652a-d701-47e7-80c1-294c9898772a tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:45.314698 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a53a4ce9-7052-4e05-b1ee-49cd4d874bb5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:45.346971 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a53a4ce9-7052-4e05-b1ee-49cd4d874bb5 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1351 microversion: 2.1 time: 0.581063 Jun 16 14:50:45.375674 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1244/2428] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:44 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1351 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:45.599481 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1438739883", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "6ffae750-1cee-4dc1-8b42-c4a80fc10f4d"}]}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:45.813400 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] validate_networks() for [('6ffae750-1cee-4dc1-8b42-c4a80fc10f4d', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:50:45.897124 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f1da652a-d701-47e7-80c1-294c9898772a tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:45.936812 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f1da652a-d701-47e7-80c1-294c9898772a tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:45.955388 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f1da652a-d701-47e7-80c1-294c9898772a tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:45.987691 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f1da652a-d701-47e7-80c1-294c9898772a tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1355 microversion: 2.75 time: 0.768937 Jun 16 14:50:45.989604 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1185/2429] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:45 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1355 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:46.011310 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-94659658-4f77-45b9-8dde-daa158a32be2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:46.017018 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-94659658-4f77-45b9-8dde-daa158a32be2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:46.059109 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-94659658-4f77-45b9-8dde-daa158a32be2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:46.060549 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-94659658-4f77-45b9-8dde-daa158a32be2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:46.068410 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-94659658-4f77-45b9-8dde-daa158a32be2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:46.071655 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-94659658-4f77-45b9-8dde-daa158a32be2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:47.201719 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:50:47.203084 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:50:47.204317 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:50:47.205110 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:50:47.206807 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:50:47.244827 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:47.246513 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:47.249987 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:47.249987 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:47.303619 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Getting quotas for project 2bbff7d18ca64e21844b98e9de63e354. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:50:47.322183 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Getting quotas for user f332f90c6f2849de9e5ac429ca645af5 and project 2bbff7d18ca64e21844b98e9de63e354. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:50:47.360713 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:50:47.366028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:50:47.528403 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-11d457ef-2288-4251-8d6b-892f4d73b624 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.148465 Jun 16 14:50:47.536806 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1245/2430] 10.222.0.57 () {62 vars in 1187 bytes} [Thu Jun 16 14:50:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2157 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 14:50:47.563582 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4db9dd5e-b948-4fb6-8dcf-0701ac8146cb tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:47.566850 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4db9dd5e-b948-4fb6-8dcf-0701ac8146cb tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:47.586001 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:47.596156 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4db9dd5e-b948-4fb6-8dcf-0701ac8146cb tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:47.597261 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4db9dd5e-b948-4fb6-8dcf-0701ac8146cb tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:47.600113 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4db9dd5e-b948-4fb6-8dcf-0701ac8146cb tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:47.602011 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4db9dd5e-b948-4fb6-8dcf-0701ac8146cb tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:47.756175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-4db9dd5e-b948-4fb6-8dcf-0701ac8146cb tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:47.787675 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4db9dd5e-b948-4fb6-8dcf-0701ac8146cb tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1274 microversion: 2.1 time: 0.247472 Jun 16 14:50:47.794633 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1246/2431] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:47 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1274 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:47.816984 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c64524bc-935f-4ebd-b352-3c15513cfe16 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:47.818415 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c64524bc-935f-4ebd-b352-3c15513cfe16 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:47.833385 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c64524bc-935f-4ebd-b352-3c15513cfe16 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:47.834985 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c64524bc-935f-4ebd-b352-3c15513cfe16 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:47.837786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c64524bc-935f-4ebd-b352-3c15513cfe16 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:47.838587 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c64524bc-935f-4ebd-b352-3c15513cfe16 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:48.155748 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-94659658-4f77-45b9-8dde-daa158a32be2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:48.180159 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-94659658-4f77-45b9-8dde-daa158a32be2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1317 microversion: 2.1 time: 2.183307 Jun 16 14:50:48.183787 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1186/2432] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:45 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1317 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:48.217017 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1e977f2a-0b08-4daf-9394-2f87c906f84c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:48.218257 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1e977f2a-0b08-4daf-9394-2f87c906f84c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:48.268039 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c64524bc-935f-4ebd-b352-3c15513cfe16 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:48.268755 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1e977f2a-0b08-4daf-9394-2f87c906f84c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:48.274898 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1e977f2a-0b08-4daf-9394-2f87c906f84c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:48.278008 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1e977f2a-0b08-4daf-9394-2f87c906f84c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:48.282756 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1e977f2a-0b08-4daf-9394-2f87c906f84c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:48.290800 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c64524bc-935f-4ebd-b352-3c15513cfe16 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1315 microversion: 2.1 time: 0.493221 Jun 16 14:50:48.292256 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1247/2433] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:47 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:48.297501 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-69a2ec5b-55a9-49bb-867c-d467bd61c1e0 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:48.301657 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-69a2ec5b-55a9-49bb-867c-d467bd61c1e0 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:48.316376 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-69a2ec5b-55a9-49bb-867c-d467bd61c1e0 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:48.316376 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-69a2ec5b-55a9-49bb-867c-d467bd61c1e0 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:48.331673 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-69a2ec5b-55a9-49bb-867c-d467bd61c1e0 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:48.332253 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-69a2ec5b-55a9-49bb-867c-d467bd61c1e0 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:48.832701 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-69a2ec5b-55a9-49bb-867c-d467bd61c1e0 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:48.851421 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-69a2ec5b-55a9-49bb-867c-d467bd61c1e0 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:48.865251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-69a2ec5b-55a9-49bb-867c-d467bd61c1e0 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:48.885658 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-69a2ec5b-55a9-49bb-867c-d467bd61c1e0 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1417 microversion: 2.75 time: 0.592077 Jun 16 14:50:48.888546 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1248/2434] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:48 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1417 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:48.908079 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1dc0c726-7b4e-4829-abdb-92f6e12e7af6 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:48.910417 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1dc0c726-7b4e-4829-abdb-92f6e12e7af6 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:49.041405 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1dc0c726-7b4e-4829-abdb-92f6e12e7af6 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:49.057276 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1dc0c726-7b4e-4829-abdb-92f6e12e7af6 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:49.059244 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1dc0c726-7b4e-4829-abdb-92f6e12e7af6 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:49.064168 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1dc0c726-7b4e-4829-abdb-92f6e12e7af6 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1259 microversion: 2.21 time: 0.170737 Jun 16 14:50:49.066041 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1249/2435] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:48 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:49.082550 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-03d66f0d-5847-462b-af43-cc000c0782a8 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:49.082550 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-03d66f0d-5847-462b-af43-cc000c0782a8 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:49.108517 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-03d66f0d-5847-462b-af43-cc000c0782a8 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:49.110335 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-03d66f0d-5847-462b-af43-cc000c0782a8 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:49.111342 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-03d66f0d-5847-462b-af43-cc000c0782a8 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:49.113758 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-03d66f0d-5847-462b-af43-cc000c0782a8 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:49.439612 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-03d66f0d-5847-462b-af43-cc000c0782a8 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:49.449687 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-03d66f0d-5847-462b-af43-cc000c0782a8 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1316 microversion: 2.1 time: 0.381536 Jun 16 14:50:49.450310 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1250/2436] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:49 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:49.483652 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7b1d4a46-adcb-446c-9613-aa08fbe57634 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:49.484838 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7b1d4a46-adcb-446c-9613-aa08fbe57634 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:49.494488 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b1d4a46-adcb-446c-9613-aa08fbe57634 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:49.494879 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b1d4a46-adcb-446c-9613-aa08fbe57634 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:49.495917 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b1d4a46-adcb-446c-9613-aa08fbe57634 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:49.496597 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7b1d4a46-adcb-446c-9613-aa08fbe57634 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:49.798687 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7b1d4a46-adcb-446c-9613-aa08fbe57634 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:49.811544 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7b1d4a46-adcb-446c-9613-aa08fbe57634 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1317 microversion: 2.1 time: 0.340839 Jun 16 14:50:49.822264 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1251/2437] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:49 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:49.832896 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fd88e9d6-5ad4-470c-939c-519007345404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:49.834028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fd88e9d6-5ad4-470c-939c-519007345404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:49.842489 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd88e9d6-5ad4-470c-939c-519007345404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:49.843345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd88e9d6-5ad4-470c-939c-519007345404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:49.844399 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd88e9d6-5ad4-470c-939c-519007345404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:49.845048 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd88e9d6-5ad4-470c-939c-519007345404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:50.120699 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fd88e9d6-5ad4-470c-939c-519007345404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:50.143445 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fd88e9d6-5ad4-470c-939c-519007345404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1315 microversion: 2.1 time: 0.318975 Jun 16 14:50:50.144773 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1252/2438] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:49 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:50.162945 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-57a1bb18-9abd-4916-b948-d0596f4608e5 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:50.170012 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-57a1bb18-9abd-4916-b948-d0596f4608e5 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:50.192245 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-57a1bb18-9abd-4916-b948-d0596f4608e5 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:50.193082 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-57a1bb18-9abd-4916-b948-d0596f4608e5 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:50.194275 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-57a1bb18-9abd-4916-b948-d0596f4608e5 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:50.195587 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-57a1bb18-9abd-4916-b948-d0596f4608e5 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:50.420895 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-57a1bb18-9abd-4916-b948-d0596f4608e5 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:50.454114 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-57a1bb18-9abd-4916-b948-d0596f4608e5 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:50.471457 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-57a1bb18-9abd-4916-b948-d0596f4608e5 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:50.509498 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-57a1bb18-9abd-4916-b948-d0596f4608e5 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1417 microversion: 2.75 time: 0.362747 Jun 16 14:50:50.514678 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1253/2439] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:50 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1417 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:50.519997 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9a88a283-afa4-44ee-8440-964b1d3aee29 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:50.520841 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9a88a283-afa4-44ee-8440-964b1d3aee29 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:50.552573 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a88a283-afa4-44ee-8440-964b1d3aee29 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:50.555700 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a88a283-afa4-44ee-8440-964b1d3aee29 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:50.558059 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a88a283-afa4-44ee-8440-964b1d3aee29 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:50.560526 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a88a283-afa4-44ee-8440-964b1d3aee29 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:50.767183 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9a88a283-afa4-44ee-8440-964b1d3aee29 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:50.786875 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9a88a283-afa4-44ee-8440-964b1d3aee29 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:50.792733 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9a88a283-afa4-44ee-8440-964b1d3aee29 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:50.801979 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9a88a283-afa4-44ee-8440-964b1d3aee29 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1255 microversion: 2.21 time: 0.286417 Jun 16 14:50:50.802889 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1254/2440] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:50 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1255 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:50.818477 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cec7d63c-62ee-448c-8b81-231aee3bcb97 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:50.819922 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cec7d63c-62ee-448c-8b81-231aee3bcb97 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:50.851713 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cec7d63c-62ee-448c-8b81-231aee3bcb97 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:50.853076 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cec7d63c-62ee-448c-8b81-231aee3bcb97 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:50.853985 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cec7d63c-62ee-448c-8b81-231aee3bcb97 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:50.854502 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cec7d63c-62ee-448c-8b81-231aee3bcb97 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:51.054798 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1e977f2a-0b08-4daf-9394-2f87c906f84c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:51.087732 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1e977f2a-0b08-4daf-9394-2f87c906f84c tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1351 microversion: 2.1 time: 2.901342 Jun 16 14:50:51.089256 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1187/2441] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:48 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1351 bytes in 2905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:51.109917 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-5c1601ac-dbb1-49ed-8810-9d75c445a681 req-ef04fbfa-1b1a-4889-bfd4-0e562687403b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be464d9-2abf-480e-9511-7a4ec415ce2a", "name": "network-vif-plugged", "status": "completed", "tag": "5bc6aa8b-e395-4b98-abff-087bfaa42324"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:51.163718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cec7d63c-62ee-448c-8b81-231aee3bcb97 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:51.180581 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-5c1601ac-dbb1-49ed-8810-9d75c445a681 req-ef04fbfa-1b1a-4889-bfd4-0e562687403b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:51.181449 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-5c1601ac-dbb1-49ed-8810-9d75c445a681 req-ef04fbfa-1b1a-4889-bfd4-0e562687403b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:51.198829 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cec7d63c-62ee-448c-8b81-231aee3bcb97 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1316 microversion: 2.1 time: 0.394578 Jun 16 14:50:51.201825 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-5c1601ac-dbb1-49ed-8810-9d75c445a681 req-ef04fbfa-1b1a-4889-bfd4-0e562687403b service nova] Creating event network-vif-plugged:5bc6aa8b-e395-4b98-abff-087bfaa42324 for instance 1be464d9-2abf-480e-9511-7a4ec415ce2a on n-h1-836830-4 Jun 16 14:50:51.206625 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1255/2442] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:50 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:51.215802 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9b52a91a-88bb-4ee3-9132-f20f7762d788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:51.219302 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9b52a91a-88bb-4ee3-9132-f20f7762d788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:51.225143 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-5c1601ac-dbb1-49ed-8810-9d75c445a681 req-ef04fbfa-1b1a-4889-bfd4-0e562687403b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128846 Jun 16 14:50:51.228980 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1188/2443] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:51.237238 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2fcfde40-020e-4b3d-9820-5437aa69fa6b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:51.238078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9b52a91a-88bb-4ee3-9132-f20f7762d788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:51.238546 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2fcfde40-020e-4b3d-9820-5437aa69fa6b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:51.238686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9b52a91a-88bb-4ee3-9132-f20f7762d788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:51.246807 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9b52a91a-88bb-4ee3-9132-f20f7762d788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:51.247589 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9b52a91a-88bb-4ee3-9132-f20f7762d788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:51.251481 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2fcfde40-020e-4b3d-9820-5437aa69fa6b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:51.252664 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2fcfde40-020e-4b3d-9820-5437aa69fa6b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:51.253715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2fcfde40-020e-4b3d-9820-5437aa69fa6b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:51.254179 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2fcfde40-020e-4b3d-9820-5437aa69fa6b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:51.272011 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:51.681993 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9b52a91a-88bb-4ee3-9132-f20f7762d788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:51.697482 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9b52a91a-88bb-4ee3-9132-f20f7762d788 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1317 microversion: 2.1 time: 0.488914 Jun 16 14:50:51.699338 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1256/2444] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:51 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:51.725329 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-651e7729-519b-4cb4-b9b4-1b4fbc589d4c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:51.729536 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-651e7729-519b-4cb4-b9b4-1b4fbc589d4c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:51.750729 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-651e7729-519b-4cb4-b9b4-1b4fbc589d4c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:51.752593 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-651e7729-519b-4cb4-b9b4-1b4fbc589d4c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:51.767585 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-651e7729-519b-4cb4-b9b4-1b4fbc589d4c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:51.768058 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-651e7729-519b-4cb4-b9b4-1b4fbc589d4c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:52.064441 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-651e7729-519b-4cb4-b9b4-1b4fbc589d4c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:52.127866 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-651e7729-519b-4cb4-b9b4-1b4fbc589d4c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:52.135321 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-651e7729-519b-4cb4-b9b4-1b4fbc589d4c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:52.168187 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-651e7729-519b-4cb4-b9b4-1b4fbc589d4c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1417 microversion: 2.75 time: 0.467140 Jun 16 14:50:52.173470 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1257/2445] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:51 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1417 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:52.191737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-34dd00a0-b0b1-402d-b753-bf736dd28338 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:52.202999 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-34dd00a0-b0b1-402d-b753-bf736dd28338 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:52.238618 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-34dd00a0-b0b1-402d-b753-bf736dd28338 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:52.240243 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-34dd00a0-b0b1-402d-b753-bf736dd28338 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:52.251778 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-34dd00a0-b0b1-402d-b753-bf736dd28338 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:52.252970 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-34dd00a0-b0b1-402d-b753-bf736dd28338 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:52.458804 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-34dd00a0-b0b1-402d-b753-bf736dd28338 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:52.484568 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-34dd00a0-b0b1-402d-b753-bf736dd28338 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:52.490469 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-34dd00a0-b0b1-402d-b753-bf736dd28338 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:52.493843 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-34dd00a0-b0b1-402d-b753-bf736dd28338 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1319 microversion: 2.21 time: 0.315934 Jun 16 14:50:52.510062 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1258/2446] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:52 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:52.510062 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-869b89c6-b76d-4f5a-bcc9-ace0cfb74f32 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:52.510062 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-869b89c6-b76d-4f5a-bcc9-ace0cfb74f32 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:52.523625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-869b89c6-b76d-4f5a-bcc9-ace0cfb74f32 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:52.525064 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-869b89c6-b76d-4f5a-bcc9-ace0cfb74f32 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:52.527158 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-869b89c6-b76d-4f5a-bcc9-ace0cfb74f32 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:52.528108 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-869b89c6-b76d-4f5a-bcc9-ace0cfb74f32 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:52.813219 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-869b89c6-b76d-4f5a-bcc9-ace0cfb74f32 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:52.831489 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-869b89c6-b76d-4f5a-bcc9-ace0cfb74f32 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1351 microversion: 2.1 time: 0.334155 Jun 16 14:50:52.833645 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1259/2447] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:52 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1351 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:52.854720 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-276c55d7-5274-4391-8036-881f17c7b790 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:52.856388 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-276c55d7-5274-4391-8036-881f17c7b790 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:52.875283 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-276c55d7-5274-4391-8036-881f17c7b790 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:52.876206 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-276c55d7-5274-4391-8036-881f17c7b790 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:52.877811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-276c55d7-5274-4391-8036-881f17c7b790 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:52.879026 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-276c55d7-5274-4391-8036-881f17c7b790 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:53.115128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-276c55d7-5274-4391-8036-881f17c7b790 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:53.126686 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-276c55d7-5274-4391-8036-881f17c7b790 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1316 microversion: 2.1 time: 0.287883 Jun 16 14:50:53.127520 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1260/2448] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:52 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:53.133121 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8d807aed-f436-4f13-bdff-7e474004a5aa tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:53.134090 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8d807aed-f436-4f13-bdff-7e474004a5aa tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:53.142585 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8d807aed-f436-4f13-bdff-7e474004a5aa tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:53.143819 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8d807aed-f436-4f13-bdff-7e474004a5aa tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:53.144872 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8d807aed-f436-4f13-bdff-7e474004a5aa tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:53.145388 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8d807aed-f436-4f13-bdff-7e474004a5aa tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:53.154699 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2fcfde40-020e-4b3d-9820-5437aa69fa6b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:53.172733 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2fcfde40-020e-4b3d-9820-5437aa69fa6b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1315 microversion: 2.1 time: 1.942151 Jun 16 14:50:53.179052 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1189/2449] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:51 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1315 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:53.206371 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6191313c-516a-42ac-82f8-0f574a7ee7c3 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:53.207135 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6191313c-516a-42ac-82f8-0f574a7ee7c3 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:53.214674 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6191313c-516a-42ac-82f8-0f574a7ee7c3 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:53.215131 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6191313c-516a-42ac-82f8-0f574a7ee7c3 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:53.215950 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6191313c-516a-42ac-82f8-0f574a7ee7c3 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:53.216488 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6191313c-516a-42ac-82f8-0f574a7ee7c3 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:53.424236 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8d807aed-f436-4f13-bdff-7e474004a5aa tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:53.436574 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8d807aed-f436-4f13-bdff-7e474004a5aa tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1317 microversion: 2.1 time: 0.307637 Jun 16 14:50:53.438059 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1261/2450] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:53 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:53.465684 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-22eca55e-02ab-477a-92a0-b47b724009b4 req-f32efde1-baf3-444f-ad9a-493187707e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1972ad93-7fd8-4543-8c50-9f3948d5be42", "name": "network-vif-plugged", "status": "completed", "tag": "dffb6435-1d69-4ea3-8dd2-4cd53a4fefd2"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:53.482442 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-22eca55e-02ab-477a-92a0-b47b724009b4 req-f32efde1-baf3-444f-ad9a-493187707e44 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:53.483371 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-22eca55e-02ab-477a-92a0-b47b724009b4 req-f32efde1-baf3-444f-ad9a-493187707e44 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:53.510775 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-22eca55e-02ab-477a-92a0-b47b724009b4 req-f32efde1-baf3-444f-ad9a-493187707e44 service nova] Creating event network-vif-plugged:dffb6435-1d69-4ea3-8dd2-4cd53a4fefd2 for instance 1972ad93-7fd8-4543-8c50-9f3948d5be42 on n-h1-836830-4 Jun 16 14:50:53.546233 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6191313c-516a-42ac-82f8-0f574a7ee7c3 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:53.555753 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-22eca55e-02ab-477a-92a0-b47b724009b4 req-f32efde1-baf3-444f-ad9a-493187707e44 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100561 Jun 16 14:50:53.563591 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6191313c-516a-42ac-82f8-0f574a7ee7c3 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:53.570291 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6191313c-516a-42ac-82f8-0f574a7ee7c3 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:53.570562 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1262/2451] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:53.594288 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-83f70eae-743f-4a83-b7e7-010772e95753 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:53.598047 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-83f70eae-743f-4a83-b7e7-010772e95753 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:53.606599 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6191313c-516a-42ac-82f8-0f574a7ee7c3 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1438 microversion: 2.75 time: 0.398410 Jun 16 14:50:53.607570 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1190/2452] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:53 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1438 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:53.624601 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-83f70eae-743f-4a83-b7e7-010772e95753 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:53.626288 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-83f70eae-743f-4a83-b7e7-010772e95753 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:53.627639 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-83f70eae-743f-4a83-b7e7-010772e95753 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:53.628709 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-83f70eae-743f-4a83-b7e7-010772e95753 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:53.644738 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:53.647225 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:53.667727 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:53.672877 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:53.675760 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:53.676753 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:53.923956 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-83f70eae-743f-4a83-b7e7-010772e95753 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:53.950189 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-83f70eae-743f-4a83-b7e7-010772e95753 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:53.952434 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-83f70eae-743f-4a83-b7e7-010772e95753 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:53.953683 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-83f70eae-743f-4a83-b7e7-010772e95753 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1317 microversion: 2.21 time: 0.380953 Jun 16 14:50:53.954285 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1263/2453] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:53 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:53.977461 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:50:53.978795 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:50:53.979954 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:50:53.981252 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:50:53.983716 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:50:53.986854 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d17f72e9-b161-4a34-8a1e-97e75d4a4c98 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:53.987647 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d17f72e9-b161-4a34-8a1e-97e75d4a4c98 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:54.020630 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d17f72e9-b161-4a34-8a1e-97e75d4a4c98 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:54.021110 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d17f72e9-b161-4a34-8a1e-97e75d4a4c98 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:54.033833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d17f72e9-b161-4a34-8a1e-97e75d4a4c98 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:54.033833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d17f72e9-b161-4a34-8a1e-97e75d4a4c98 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:54.170323 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:54.189910 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:54.191186 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:54.196789 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:54.198695 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:54.372890 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d17f72e9-b161-4a34-8a1e-97e75d4a4c98 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:54.384258 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d17f72e9-b161-4a34-8a1e-97e75d4a4c98 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1351 microversion: 2.1 time: 0.425792 Jun 16 14:50:54.386247 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1264/2454] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:53 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1351 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:54.391869 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f8780ddc-201b-43e1-8691-871e34456ff5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:54.392697 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f8780ddc-201b-43e1-8691-871e34456ff5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:54.413456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f8780ddc-201b-43e1-8691-871e34456ff5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:54.414527 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f8780ddc-201b-43e1-8691-871e34456ff5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:54.416179 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f8780ddc-201b-43e1-8691-871e34456ff5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:54.417697 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f8780ddc-201b-43e1-8691-871e34456ff5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:54.661924 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f8780ddc-201b-43e1-8691-871e34456ff5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:54.674905 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f8780ddc-201b-43e1-8691-871e34456ff5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1316 microversion: 2.1 time: 0.287071 Jun 16 14:50:54.688699 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1265/2455] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:54 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:54.695592 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8273fcce-a1e8-4274-924c-30eb7bdf261d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:54.697405 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8273fcce-a1e8-4274-924c-30eb7bdf261d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:54.707248 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8273fcce-a1e8-4274-924c-30eb7bdf261d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:54.707871 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8273fcce-a1e8-4274-924c-30eb7bdf261d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:54.709217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8273fcce-a1e8-4274-924c-30eb7bdf261d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:54.710000 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8273fcce-a1e8-4274-924c-30eb7bdf261d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:54.895837 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8273fcce-a1e8-4274-924c-30eb7bdf261d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:54.905020 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:54.909685 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8273fcce-a1e8-4274-924c-30eb7bdf261d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1315 microversion: 2.1 time: 0.218740 Jun 16 14:50:54.911518 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1266/2456] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:54 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:54.919694 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f76d0ad0-c3cb-4cd6-bcbc-13973a562965 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:54.920729 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f76d0ad0-c3cb-4cd6-bcbc-13973a562965 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:54.927527 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:54.931342 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:54.932887 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f76d0ad0-c3cb-4cd6-bcbc-13973a562965 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:54.934206 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f76d0ad0-c3cb-4cd6-bcbc-13973a562965 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:54.934474 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:54.937705 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f76d0ad0-c3cb-4cd6-bcbc-13973a562965 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:54.939268 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f76d0ad0-c3cb-4cd6-bcbc-13973a562965 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:54.939894 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-affa9d0d-c5a4-4b11-a286-aa17e7cfca3b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "POST /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb/action" status: 202 len: 1495 microversion: 2.75 time: 1.299763 Jun 16 14:50:54.941148 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1191/2457] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jun 16 14:50:53 2022] POST /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb/action => generated 1495 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 16 14:50:54.959268 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-14b336f2-8eae-4d22-b9aa-49ab89e04339 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:54.960475 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-14b336f2-8eae-4d22-b9aa-49ab89e04339 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:54.968112 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14b336f2-8eae-4d22-b9aa-49ab89e04339 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:54.969023 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14b336f2-8eae-4d22-b9aa-49ab89e04339 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:54.969938 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14b336f2-8eae-4d22-b9aa-49ab89e04339 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:54.970451 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-14b336f2-8eae-4d22-b9aa-49ab89e04339 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:55.190329 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f76d0ad0-c3cb-4cd6-bcbc-13973a562965 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:55.211090 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f76d0ad0-c3cb-4cd6-bcbc-13973a562965 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 200 len: 1504 microversion: 2.1 time: 0.297539 Jun 16 14:50:55.213339 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-14b336f2-8eae-4d22-b9aa-49ab89e04339 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:55.232896 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1267/2458] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:54 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 1504 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:55.251924 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-16b3ac59-a282-4860-a2b0-c29f3883a107 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:55.252816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-16b3ac59-a282-4860-a2b0-c29f3883a107 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:55.261230 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-14b336f2-8eae-4d22-b9aa-49ab89e04339 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:55.265045 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-14b336f2-8eae-4d22-b9aa-49ab89e04339 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:55.270015 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-16b3ac59-a282-4860-a2b0-c29f3883a107 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:55.271915 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-16b3ac59-a282-4860-a2b0-c29f3883a107 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:55.272887 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-16b3ac59-a282-4860-a2b0-c29f3883a107 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:55.273354 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-16b3ac59-a282-4860-a2b0-c29f3883a107 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:55.282838 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-14b336f2-8eae-4d22-b9aa-49ab89e04339 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1447 microversion: 2.75 time: 0.326955 Jun 16 14:50:55.297069 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1192/2459] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:54 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1447 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:50:55.298910 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ef1d06a6-1764-411e-bb22-845e91b8c697 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:55.300309 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ef1d06a6-1764-411e-bb22-845e91b8c697 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1972ad93-7fd8-4543-8c50-9f3948d5be42] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:55.317570 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef1d06a6-1764-411e-bb22-845e91b8c697 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:55.319672 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef1d06a6-1764-411e-bb22-845e91b8c697 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:55.323224 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef1d06a6-1764-411e-bb22-845e91b8c697 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:55.324142 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ef1d06a6-1764-411e-bb22-845e91b8c697 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:55.386917 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-16b3ac59-a282-4860-a2b0-c29f3883a107 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:55.409278 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-16b3ac59-a282-4860-a2b0-c29f3883a107 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:55.411023 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-16b3ac59-a282-4860-a2b0-c29f3883a107 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:55.413848 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-16b3ac59-a282-4860-a2b0-c29f3883a107 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1317 microversion: 2.21 time: 0.176306 Jun 16 14:50:55.414707 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1268/2460] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:55 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:55.420776 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f145f950-c7fc-4ab8-b737-f99bf8d89289 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:55.421418 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f145f950-c7fc-4ab8-b737-f99bf8d89289 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:55.428803 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f145f950-c7fc-4ab8-b737-f99bf8d89289 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:55.429266 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f145f950-c7fc-4ab8-b737-f99bf8d89289 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:55.430097 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f145f950-c7fc-4ab8-b737-f99bf8d89289 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:55.430584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f145f950-c7fc-4ab8-b737-f99bf8d89289 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:55.717907 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f145f950-c7fc-4ab8-b737-f99bf8d89289 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:55.732022 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f145f950-c7fc-4ab8-b737-f99bf8d89289 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1351 microversion: 2.1 time: 0.315932 Jun 16 14:50:55.733195 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1269/2461] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:55 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1351 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:55.738879 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-12b7d81f-8216-485a-8484-79d1496a81ab tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:55.739840 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-12b7d81f-8216-485a-8484-79d1496a81ab tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:55.760118 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-12b7d81f-8216-485a-8484-79d1496a81ab tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:55.760963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-12b7d81f-8216-485a-8484-79d1496a81ab tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:55.762565 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-12b7d81f-8216-485a-8484-79d1496a81ab tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:55.763887 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-12b7d81f-8216-485a-8484-79d1496a81ab tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:56.053219 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-12b7d81f-8216-485a-8484-79d1496a81ab tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:56.067727 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-12b7d81f-8216-485a-8484-79d1496a81ab tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1316 microversion: 2.1 time: 0.332793 Jun 16 14:50:56.068738 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1270/2462] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:55 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:56.077793 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ded9e7e7-7e52-48d5-ae38-0ff5200e3034 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:56.077975 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ded9e7e7-7e52-48d5-ae38-0ff5200e3034 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:56.085659 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ded9e7e7-7e52-48d5-ae38-0ff5200e3034 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:56.086679 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ded9e7e7-7e52-48d5-ae38-0ff5200e3034 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:56.087963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ded9e7e7-7e52-48d5-ae38-0ff5200e3034 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:56.088657 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ded9e7e7-7e52-48d5-ae38-0ff5200e3034 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:56.216950 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ef1d06a6-1764-411e-bb22-845e91b8c697 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:56.232138 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ef1d06a6-1764-411e-bb22-845e91b8c697 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1972ad93-7fd8-4543-8c50-9f3948d5be42" status: 200 len: 1317 microversion: 2.1 time: 0.944554 Jun 16 14:50:56.232748 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1193/2463] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:55 2022] GET /compute/v2.1/servers/1972ad93-7fd8-4543-8c50-9f3948d5be42 => generated 1317 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:56.241642 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-c6cb32e8-c35b-4155-8581-0ba0754be831 req-282ddfa7-f3ad-4b31-b1ab-ee6b5ad434cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2d6585-b3a9-46a5-b43d-d9eb61f41d23", "tag": "54d05d80-f4ed-4a22-8cbf-201e2d4efe15"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:56.257794 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-c6cb32e8-c35b-4155-8581-0ba0754be831 req-282ddfa7-f3ad-4b31-b1ab-ee6b5ad434cd service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:56.258491 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-c6cb32e8-c35b-4155-8581-0ba0754be831 req-282ddfa7-f3ad-4b31-b1ab-ee6b5ad434cd service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:56.274003 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-c6cb32e8-c35b-4155-8581-0ba0754be831 req-282ddfa7-f3ad-4b31-b1ab-ee6b5ad434cd service nova] Creating event network-changed:54d05d80-f4ed-4a22-8cbf-201e2d4efe15 for instance 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 on n-h2-836830-4 Jun 16 14:50:56.285587 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-c6cb32e8-c35b-4155-8581-0ba0754be831 req-282ddfa7-f3ad-4b31-b1ab-ee6b5ad434cd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050114 Jun 16 14:50:56.286719 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1194/2464] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:56.330364 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ec3fbba4-cc17-41d2-a2ac-2f353ded18c4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:56.332530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ec3fbba4-cc17-41d2-a2ac-2f353ded18c4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:56.343459 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ec3fbba4-cc17-41d2-a2ac-2f353ded18c4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:56.344270 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ec3fbba4-cc17-41d2-a2ac-2f353ded18c4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:56.345396 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ec3fbba4-cc17-41d2-a2ac-2f353ded18c4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:56.346053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ec3fbba4-cc17-41d2-a2ac-2f353ded18c4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:56.436894 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ded9e7e7-7e52-48d5-ae38-0ff5200e3034 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:56.452932 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ded9e7e7-7e52-48d5-ae38-0ff5200e3034 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1315 microversion: 2.1 time: 0.382167 Jun 16 14:50:56.466577 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1271/2465] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:56 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:56.475780 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b9703c7d-7a2f-41d7-b06e-f343a48005f3 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:56.483835 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b9703c7d-7a2f-41d7-b06e-f343a48005f3 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:56.500567 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b9703c7d-7a2f-41d7-b06e-f343a48005f3 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:56.501982 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b9703c7d-7a2f-41d7-b06e-f343a48005f3 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:56.503564 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b9703c7d-7a2f-41d7-b06e-f343a48005f3 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:56.504362 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b9703c7d-7a2f-41d7-b06e-f343a48005f3 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:56.623610 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ec3fbba4-cc17-41d2-a2ac-2f353ded18c4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:56.643262 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ec3fbba4-cc17-41d2-a2ac-2f353ded18c4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:56.646474 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ec3fbba4-cc17-41d2-a2ac-2f353ded18c4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:56.656761 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ec3fbba4-cc17-41d2-a2ac-2f353ded18c4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1447 microversion: 2.75 time: 0.338812 Jun 16 14:50:56.656761 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1195/2466] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:56 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1447 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:56.673488 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b9703c7d-7a2f-41d7-b06e-f343a48005f3 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:56.697653 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b9703c7d-7a2f-41d7-b06e-f343a48005f3 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:56.703182 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b9703c7d-7a2f-41d7-b06e-f343a48005f3 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:56.705573 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b9703c7d-7a2f-41d7-b06e-f343a48005f3 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1317 microversion: 2.21 time: 0.237466 Jun 16 14:50:56.719576 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1272/2467] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:56 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:56.765509 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-caeab8e7-b84a-46ec-83ed-5712207d66ea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:56.766692 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-caeab8e7-b84a-46ec-83ed-5712207d66ea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:56.790471 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-caeab8e7-b84a-46ec-83ed-5712207d66ea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:56.792156 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-caeab8e7-b84a-46ec-83ed-5712207d66ea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:56.793903 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-caeab8e7-b84a-46ec-83ed-5712207d66ea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:56.795328 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-caeab8e7-b84a-46ec-83ed-5712207d66ea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:57.095512 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3650422f-9e8a-4e33-b7d5-977b63057e78 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:57.097417 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3650422f-9e8a-4e33-b7d5-977b63057e78 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:57.117149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3650422f-9e8a-4e33-b7d5-977b63057e78 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:57.117898 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3650422f-9e8a-4e33-b7d5-977b63057e78 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:57.118965 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3650422f-9e8a-4e33-b7d5-977b63057e78 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:57.119581 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3650422f-9e8a-4e33-b7d5-977b63057e78 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:57.205676 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:57.282170 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:57.458132 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3650422f-9e8a-4e33-b7d5-977b63057e78 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:57.473600 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3650422f-9e8a-4e33-b7d5-977b63057e78 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1316 microversion: 2.1 time: 0.385274 Jun 16 14:50:57.486263 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1273/2468] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:57 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:57.488512 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2af480ff-fe13-4c3b-892d-537889687578 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:57.489910 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2af480ff-fe13-4c3b-892d-537889687578 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1972ad93-7fd8-4543-8c50-9f3948d5be42] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:57.508449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2af480ff-fe13-4c3b-892d-537889687578 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:57.509447 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2af480ff-fe13-4c3b-892d-537889687578 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:57.511416 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2af480ff-fe13-4c3b-892d-537889687578 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:57.513014 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2af480ff-fe13-4c3b-892d-537889687578 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:57.684164 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-caeab8e7-b84a-46ec-83ed-5712207d66ea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:57.692512 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-caeab8e7-b84a-46ec-83ed-5712207d66ea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1351 microversion: 2.1 time: 0.934512 Jun 16 14:50:57.693117 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1196/2469] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:56 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1351 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:57.837203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2af480ff-fe13-4c3b-892d-537889687578 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:57.848016 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2af480ff-fe13-4c3b-892d-537889687578 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1972ad93-7fd8-4543-8c50-9f3948d5be42" status: 200 len: 1504 microversion: 2.1 time: 0.369932 Jun 16 14:50:57.849025 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1274/2470] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:57 2022] GET /compute/v2.1/servers/1972ad93-7fd8-4543-8c50-9f3948d5be42 => generated 1504 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:57.860461 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0cf1fb27-37da-4649-8780-1e2620df3212 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:57.861499 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0cf1fb27-37da-4649-8780-1e2620df3212 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:57.874346 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0cf1fb27-37da-4649-8780-1e2620df3212 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:57.875288 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0cf1fb27-37da-4649-8780-1e2620df3212 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:57.876713 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0cf1fb27-37da-4649-8780-1e2620df3212 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:57.877099 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5eace457-9a6b-4010-a47a-adee96dad848 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] Action: 'create', calling method: .version_select at 0x7fdf10ffd700>, body: {"pool": null} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:57.877626 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0cf1fb27-37da-4649-8780-1e2620df3212 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:58.112322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0cf1fb27-37da-4649-8780-1e2620df3212 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:58.123866 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0cf1fb27-37da-4649-8780-1e2620df3212 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1315 microversion: 2.1 time: 0.273516 Jun 16 14:50:58.130444 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1275/2471] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:57 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:58.144036 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f359d69e-62ed-469a-81b6-88770345428d tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:58.146049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f359d69e-62ed-469a-81b6-88770345428d tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:58.154638 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f359d69e-62ed-469a-81b6-88770345428d tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:58.155756 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f359d69e-62ed-469a-81b6-88770345428d tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:58.158121 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f359d69e-62ed-469a-81b6-88770345428d tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:58.159265 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f359d69e-62ed-469a-81b6-88770345428d tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:58.262780 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f359d69e-62ed-469a-81b6-88770345428d tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:58.291779 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f359d69e-62ed-469a-81b6-88770345428d tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:58.296663 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f359d69e-62ed-469a-81b6-88770345428d tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:58.305182 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f359d69e-62ed-469a-81b6-88770345428d tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1447 microversion: 2.75 time: 0.178798 Jun 16 14:50:58.306579 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1276/2472] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:58 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1447 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:58.312183 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fd7f5934-68ba-4044-b719-e277516c58d8 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:58.312943 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-fd7f5934-68ba-4044-b719-e277516c58d8 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:58.321242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd7f5934-68ba-4044-b719-e277516c58d8 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:58.322327 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd7f5934-68ba-4044-b719-e277516c58d8 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:58.323691 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd7f5934-68ba-4044-b719-e277516c58d8 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:58.324458 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-fd7f5934-68ba-4044-b719-e277516c58d8 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:58.441203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fd7f5934-68ba-4044-b719-e277516c58d8 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:58.453681 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fd7f5934-68ba-4044-b719-e277516c58d8 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:58.455457 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-fd7f5934-68ba-4044-b719-e277516c58d8 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:58.456683 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fd7f5934-68ba-4044-b719-e277516c58d8 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1317 microversion: 2.21 time: 0.148799 Jun 16 14:50:58.457291 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1277/2473] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:50:58 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:58.475848 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c6db9b01-d5de-4480-a379-859d945c87d5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:58.476669 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c6db9b01-d5de-4480-a379-859d945c87d5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1972ad93-7fd8-4543-8c50-9f3948d5be42] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:58.486201 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c6db9b01-d5de-4480-a379-859d945c87d5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:58.486851 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c6db9b01-d5de-4480-a379-859d945c87d5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:58.489389 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c6db9b01-d5de-4480-a379-859d945c87d5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:58.489389 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c6db9b01-d5de-4480-a379-859d945c87d5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:58.524813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c6db9b01-d5de-4480-a379-859d945c87d5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1972ad93-7fd8-4543-8c50-9f3948d5be42] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:50:58.722000 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c6db9b01-d5de-4480-a379-859d945c87d5 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1972ad93-7fd8-4543-8c50-9f3948d5be42" status: 204 len: 0 microversion: 2.1 time: 0.263272 Jun 16 14:50:58.723346 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1278/2474] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:50:58 2022] DELETE /compute/v2.1/servers/1972ad93-7fd8-4543-8c50-9f3948d5be42 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:50:58.753414 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-26e79327-1366-4cfb-889b-f9a99225e554 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:58.754349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-26e79327-1366-4cfb-889b-f9a99225e554 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:58.805320 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-26e79327-1366-4cfb-889b-f9a99225e554 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:58.806274 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-26e79327-1366-4cfb-889b-f9a99225e554 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:58.811559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-26e79327-1366-4cfb-889b-f9a99225e554 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:58.813069 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-26e79327-1366-4cfb-889b-f9a99225e554 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:59.050517 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=36 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:59.174767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-26e79327-1366-4cfb-889b-f9a99225e554 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:59.190067 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-26e79327-1366-4cfb-889b-f9a99225e554 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1316 microversion: 2.1 time: 0.458742 Jun 16 14:50:59.201562 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1279/2475] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:58 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1316 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:59.208748 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-ea57b29b-d1be-4023-b03e-ce23850d4920 req-caa019a9-4fdf-4bdf-8513-908445204fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "081012fa-36f8-40a2-8057-e774e847f716", "tag": "8e2b4cfe-00ec-474a-856c-901541361bf0"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:59.220118 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-ea57b29b-d1be-4023-b03e-ce23850d4920 req-caa019a9-4fdf-4bdf-8513-908445204fc2 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:59.220878 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-ea57b29b-d1be-4023-b03e-ce23850d4920 req-caa019a9-4fdf-4bdf-8513-908445204fc2 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:59.238417 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-ea57b29b-d1be-4023-b03e-ce23850d4920 req-caa019a9-4fdf-4bdf-8513-908445204fc2 service nova] Creating event network-changed:8e2b4cfe-00ec-474a-856c-901541361bf0 for instance 081012fa-36f8-40a2-8057-e774e847f716 on n-h2-836830-4 Jun 16 14:50:59.245689 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-ea57b29b-d1be-4023-b03e-ce23850d4920 req-caa019a9-4fdf-4bdf-8513-908445204fc2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042282 Jun 16 14:50:59.246419 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1280/2476] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:59.252199 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-00a8550d-819b-4e92-8397-838737255fea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:59.253290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-00a8550d-819b-4e92-8397-838737255fea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:59.261900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00a8550d-819b-4e92-8397-838737255fea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:59.262410 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00a8550d-819b-4e92-8397-838737255fea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:59.263469 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00a8550d-819b-4e92-8397-838737255fea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:59.264306 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-00a8550d-819b-4e92-8397-838737255fea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:59.605166 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-00a8550d-819b-4e92-8397-838737255fea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:50:59.641503 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-00a8550d-819b-4e92-8397-838737255fea tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1351 microversion: 2.1 time: 0.383255 Jun 16 14:50:59.646337 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1281/2477] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:50:59 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1351 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:59.669114 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-afd905f6-0480-4530-969c-6275b11d5553 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:59.672371 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-afd905f6-0480-4530-969c-6275b11d5553 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:50:59.714826 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-afd905f6-0480-4530-969c-6275b11d5553 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:59.716170 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-afd905f6-0480-4530-969c-6275b11d5553 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:59.727233 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-afd905f6-0480-4530-969c-6275b11d5553 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:50:59.728124 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-afd905f6-0480-4530-969c-6275b11d5553 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:50:59.826198 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-afd905f6-0480-4530-969c-6275b11d5553 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:51:00.000109 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-afd905f6-0480-4530-969c-6275b11d5553 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 204 len: 0 microversion: 2.1 time: 0.350614 Jun 16 14:51:00.001960 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1282/2478] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:50:59 2022] DELETE /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:51:00.013730 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1bd4cbcc-e622-48e3-80a5-75681ec44521 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:00.015018 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1bd4cbcc-e622-48e3-80a5-75681ec44521 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:00.025121 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1bd4cbcc-e622-48e3-80a5-75681ec44521 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:00.025947 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1bd4cbcc-e622-48e3-80a5-75681ec44521 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:00.027179 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1bd4cbcc-e622-48e3-80a5-75681ec44521 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:00.028344 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1bd4cbcc-e622-48e3-80a5-75681ec44521 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:00.508743 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1bd4cbcc-e622-48e3-80a5-75681ec44521 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:00.560223 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1bd4cbcc-e622-48e3-80a5-75681ec44521 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1315 microversion: 2.1 time: 0.553672 Jun 16 14:51:00.560223 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1283/2479] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:00 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:00.570033 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e7f39267-29c9-4509-80d4-3e79c6ba703f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:00.577514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e7f39267-29c9-4509-80d4-3e79c6ba703f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:00.591506 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e7f39267-29c9-4509-80d4-3e79c6ba703f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:00.592007 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e7f39267-29c9-4509-80d4-3e79c6ba703f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:00.593412 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e7f39267-29c9-4509-80d4-3e79c6ba703f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:00.594200 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e7f39267-29c9-4509-80d4-3e79c6ba703f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:00.779404 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e7f39267-29c9-4509-80d4-3e79c6ba703f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:00.810329 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e7f39267-29c9-4509-80d4-3e79c6ba703f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:00.813771 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e7f39267-29c9-4509-80d4-3e79c6ba703f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:00.821472 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:00.827730 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e7f39267-29c9-4509-80d4-3e79c6ba703f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1447 microversion: 2.75 time: 0.263825 Jun 16 14:51:00.829516 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1284/2480] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:00 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1447 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:00.861876 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9a6d7bbb-9e31-437a-b9a7-9f64662a60ba tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:00.862977 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9a6d7bbb-9e31-437a-b9a7-9f64662a60ba tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:00.880547 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a6d7bbb-9e31-437a-b9a7-9f64662a60ba tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:00.882064 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a6d7bbb-9e31-437a-b9a7-9f64662a60ba tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:00.883995 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a6d7bbb-9e31-437a-b9a7-9f64662a60ba tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:00.884792 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9a6d7bbb-9e31-437a-b9a7-9f64662a60ba tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:01.183487 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9a6d7bbb-9e31-437a-b9a7-9f64662a60ba tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:01.205469 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9a6d7bbb-9e31-437a-b9a7-9f64662a60ba tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:01.208564 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9a6d7bbb-9e31-437a-b9a7-9f64662a60ba tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:01.229995 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9a6d7bbb-9e31-437a-b9a7-9f64662a60ba tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1359 microversion: 2.21 time: 0.366881 Jun 16 14:51:01.242880 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1285/2481] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:00 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1359 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:01.248010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e30c61e2-d902-48ab-a773-1a3de84f38a2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:01.248809 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e30c61e2-d902-48ab-a773-1a3de84f38a2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1972ad93-7fd8-4543-8c50-9f3948d5be42] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:01.255914 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e30c61e2-d902-48ab-a773-1a3de84f38a2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:01.256857 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e30c61e2-d902-48ab-a773-1a3de84f38a2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:01.258021 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e30c61e2-d902-48ab-a773-1a3de84f38a2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:01.259876 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e30c61e2-d902-48ab-a773-1a3de84f38a2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:01.624554 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e30c61e2-d902-48ab-a773-1a3de84f38a2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:01.638190 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e30c61e2-d902-48ab-a773-1a3de84f38a2 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1972ad93-7fd8-4543-8c50-9f3948d5be42" status: 200 len: 1510 microversion: 2.1 time: 0.394140 Jun 16 14:51:01.641117 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1286/2482] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:01 2022] GET /compute/v2.1/servers/1972ad93-7fd8-4543-8c50-9f3948d5be42 => generated 1510 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:01.647231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-70b506e8-c3da-42d4-8965-aac693685a74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:01.648276 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-70b506e8-c3da-42d4-8965-aac693685a74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:01.670792 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-70b506e8-c3da-42d4-8965-aac693685a74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:01.671655 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-70b506e8-c3da-42d4-8965-aac693685a74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:01.672630 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-70b506e8-c3da-42d4-8965-aac693685a74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:01.675231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-70b506e8-c3da-42d4-8965-aac693685a74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:01.727677 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:02.332382 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-70b506e8-c3da-42d4-8965-aac693685a74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:02.358670 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-70b506e8-c3da-42d4-8965-aac693685a74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1316 microversion: 2.1 time: 0.716244 Jun 16 14:51:02.369014 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1287/2483] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:01 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1316 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:02.391027 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-17980ff1-13cb-45cf-8b3c-ff33d937554f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:02.392554 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-17980ff1-13cb-45cf-8b3c-ff33d937554f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:02.430955 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-17980ff1-13cb-45cf-8b3c-ff33d937554f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:02.436090 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-17980ff1-13cb-45cf-8b3c-ff33d937554f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:02.437951 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-17980ff1-13cb-45cf-8b3c-ff33d937554f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:02.441000 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-17980ff1-13cb-45cf-8b3c-ff33d937554f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:02.930897 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-17980ff1-13cb-45cf-8b3c-ff33d937554f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:02.954905 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-17980ff1-13cb-45cf-8b3c-ff33d937554f tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1351 microversion: 2.1 time: 0.589117 Jun 16 14:51:02.960676 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1288/2484] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:02 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1351 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:02.973562 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-a90700e4-4ead-41f5-94ae-05a53f17b820 req-4a09476f-2c3d-4a50-8ddd-18fecb9f1b95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa828bec-416c-496b-9290-60892a56a452", "tag": "50551314-0d91-4b89-ae9d-7adae8fcf3a6"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:03.018207 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-a90700e4-4ead-41f5-94ae-05a53f17b820 req-4a09476f-2c3d-4a50-8ddd-18fecb9f1b95 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:03.023070 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-a90700e4-4ead-41f5-94ae-05a53f17b820 req-4a09476f-2c3d-4a50-8ddd-18fecb9f1b95 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:03.060404 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-a90700e4-4ead-41f5-94ae-05a53f17b820 req-4a09476f-2c3d-4a50-8ddd-18fecb9f1b95 service nova] Creating event network-changed:50551314-0d91-4b89-ae9d-7adae8fcf3a6 for instance aa828bec-416c-496b-9290-60892a56a452 on n-h2-836830-4 Jun 16 14:51:03.081586 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-a90700e4-4ead-41f5-94ae-05a53f17b820 req-4a09476f-2c3d-4a50-8ddd-18fecb9f1b95 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116421 Jun 16 14:51:03.086589 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1289/2485] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:03.134832 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-41095dd3-0e50-4285-9a41-bf8e7311c1a4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:03.139003 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-41095dd3-0e50-4285-9a41-bf8e7311c1a4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:03.185329 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-41095dd3-0e50-4285-9a41-bf8e7311c1a4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:03.186588 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-41095dd3-0e50-4285-9a41-bf8e7311c1a4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:03.188385 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-41095dd3-0e50-4285-9a41-bf8e7311c1a4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:03.191023 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-41095dd3-0e50-4285-9a41-bf8e7311c1a4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:03.770679 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-41095dd3-0e50-4285-9a41-bf8e7311c1a4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:03.781176 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-41095dd3-0e50-4285-9a41-bf8e7311c1a4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1315 microversion: 2.1 time: 0.692111 Jun 16 14:51:03.782184 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1290/2486] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:03 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1315 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:03.790011 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8891d8b9-df36-444d-bc6c-48ff7928e9fd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:03.791053 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8891d8b9-df36-444d-bc6c-48ff7928e9fd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:03.810260 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8891d8b9-df36-444d-bc6c-48ff7928e9fd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:03.814157 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8891d8b9-df36-444d-bc6c-48ff7928e9fd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:03.815591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8891d8b9-df36-444d-bc6c-48ff7928e9fd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:03.816611 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8891d8b9-df36-444d-bc6c-48ff7928e9fd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:03.941177 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8891d8b9-df36-444d-bc6c-48ff7928e9fd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:03.954000 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8891d8b9-df36-444d-bc6c-48ff7928e9fd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:03.955919 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8891d8b9-df36-444d-bc6c-48ff7928e9fd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:03.967228 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8891d8b9-df36-444d-bc6c-48ff7928e9fd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1447 microversion: 2.75 time: 0.182160 Jun 16 14:51:03.972810 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1291/2487] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:03 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1447 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:03.980498 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1fe41915-6693-4466-b13f-967d4a6e6f9a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:03.987740 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1fe41915-6693-4466-b13f-967d4a6e6f9a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:03.999858 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1fe41915-6693-4466-b13f-967d4a6e6f9a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:04.000327 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1fe41915-6693-4466-b13f-967d4a6e6f9a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:04.001168 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1fe41915-6693-4466-b13f-967d4a6e6f9a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:04.002832 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1fe41915-6693-4466-b13f-967d4a6e6f9a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:04.358287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1fe41915-6693-4466-b13f-967d4a6e6f9a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:04.376764 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1fe41915-6693-4466-b13f-967d4a6e6f9a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:04.379916 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1fe41915-6693-4466-b13f-967d4a6e6f9a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:04.389322 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1fe41915-6693-4466-b13f-967d4a6e6f9a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1359 microversion: 2.21 time: 0.412590 Jun 16 14:51:04.390894 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1292/2488] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:03 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1359 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:04.403524 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-099a5d37-48aa-43df-b2ca-fe4b6b56feb1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:04.404416 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-099a5d37-48aa-43df-b2ca-fe4b6b56feb1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1972ad93-7fd8-4543-8c50-9f3948d5be42] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:04.421275 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-099a5d37-48aa-43df-b2ca-fe4b6b56feb1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:04.421842 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-099a5d37-48aa-43df-b2ca-fe4b6b56feb1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:04.428497 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-099a5d37-48aa-43df-b2ca-fe4b6b56feb1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:04.429140 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-099a5d37-48aa-43df-b2ca-fe4b6b56feb1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:04.630359 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5eace457-9a6b-4010-a47a-adee96dad848 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.930137 Jun 16 14:51:04.649043 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1197/2489] 10.222.0.57 () {60 vars in 1169 bytes} [Thu Jun 16 14:50:57 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:04.661351 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-70d80fac-04a9-40a8-9d55-c54be864508e tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:04.663666 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-70d80fac-04a9-40a8-9d55-c54be864508e tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:04.675822 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-70d80fac-04a9-40a8-9d55-c54be864508e tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:04.677321 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-70d80fac-04a9-40a8-9d55-c54be864508e tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:04.680288 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-70d80fac-04a9-40a8-9d55-c54be864508e tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:04.681527 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-70d80fac-04a9-40a8-9d55-c54be864508e tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:04.773358 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-099a5d37-48aa-43df-b2ca-fe4b6b56feb1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1e4996a4ab47be9bafdd07293277d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4268b504d13415f9d0e23844936bf25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:04.782252 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-099a5d37-48aa-43df-b2ca-fe4b6b56feb1 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1972ad93-7fd8-4543-8c50-9f3948d5be42" status: 200 len: 1510 microversion: 2.1 time: 0.389731 Jun 16 14:51:04.795223 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1293/2490] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:04 2022] GET /compute/v2.1/servers/1972ad93-7fd8-4543-8c50-9f3948d5be42 => generated 1510 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:04.801290 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c0d8a957-9979-4a17-843d-e1142fe0f6d2 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:04.801892 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c0d8a957-9979-4a17-843d-e1142fe0f6d2 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:04.812721 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c0d8a957-9979-4a17-843d-e1142fe0f6d2 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:04.814109 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c0d8a957-9979-4a17-843d-e1142fe0f6d2 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:04.818509 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c0d8a957-9979-4a17-843d-e1142fe0f6d2 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:04.820424 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c0d8a957-9979-4a17-843d-e1142fe0f6d2 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:05.336119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c0d8a957-9979-4a17-843d-e1142fe0f6d2 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:05.389720 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c0d8a957-9979-4a17-843d-e1142fe0f6d2 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1351 microversion: 2.1 time: 0.592561 Jun 16 14:51:05.393033 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1294/2491] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:04 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1351 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:05.402286 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-97d81bc1-8e92-407b-958a-ca9394ae0126 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] Action: 'create', calling method: .version_select at 0x7fdf0c6a1f70>, body: {"pool": null} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:05.581507 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-70d80fac-04a9-40a8-9d55-c54be864508e tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:05.612126 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-70d80fac-04a9-40a8-9d55-c54be864508e tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1316 microversion: 2.1 time: 0.960887 Jun 16 14:51:05.617390 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1198/2492] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:04 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1316 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:05.628100 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-dc3e4b93-a267-4cc9-83d4-e47be4e6396d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:05.633737 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-dc3e4b93-a267-4cc9-83d4-e47be4e6396d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:05.649026 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dc3e4b93-a267-4cc9-83d4-e47be4e6396d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:05.649610 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dc3e4b93-a267-4cc9-83d4-e47be4e6396d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:05.653312 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dc3e4b93-a267-4cc9-83d4-e47be4e6396d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:05.653942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dc3e4b93-a267-4cc9-83d4-e47be4e6396d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:05.720969 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:07.052327 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-dc3e4b93-a267-4cc9-83d4-e47be4e6396d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:07.076233 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-dc3e4b93-a267-4cc9-83d4-e47be4e6396d tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1315 microversion: 2.1 time: 1.457288 Jun 16 14:51:07.097773 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1199/2493] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:05 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1315 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:07.117224 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-3de1e362-64d2-41ed-a97a-c8dadd5ff7ed req-d069e011-e9eb-4774-88a6-0e46db73704b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "081012fa-36f8-40a2-8057-e774e847f716", "name": "network-vif-plugged", "status": "completed", "tag": "8e2b4cfe-00ec-474a-856c-901541361bf0"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:07.147138 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-3de1e362-64d2-41ed-a97a-c8dadd5ff7ed req-d069e011-e9eb-4774-88a6-0e46db73704b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:07.150721 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-3de1e362-64d2-41ed-a97a-c8dadd5ff7ed req-d069e011-e9eb-4774-88a6-0e46db73704b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:07.193282 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-3de1e362-64d2-41ed-a97a-c8dadd5ff7ed req-d069e011-e9eb-4774-88a6-0e46db73704b service nova] Creating event network-vif-plugged:8e2b4cfe-00ec-474a-856c-901541361bf0 for instance 081012fa-36f8-40a2-8057-e774e847f716 on n-h2-836830-4 Jun 16 14:51:07.210165 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-3de1e362-64d2-41ed-a97a-c8dadd5ff7ed req-d069e011-e9eb-4774-88a6-0e46db73704b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109571 Jun 16 14:51:07.213150 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1200/2494] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:07.232597 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-41ce9706-d77e-4f79-81ee-87a4c7893ccd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:07.234443 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-41ce9706-d77e-4f79-81ee-87a4c7893ccd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:07.260457 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-41ce9706-d77e-4f79-81ee-87a4c7893ccd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:07.262564 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-41ce9706-d77e-4f79-81ee-87a4c7893ccd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:07.263937 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-41ce9706-d77e-4f79-81ee-87a4c7893ccd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:07.266115 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-41ce9706-d77e-4f79-81ee-87a4c7893ccd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:07.842661 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-41ce9706-d77e-4f79-81ee-87a4c7893ccd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:07.868568 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-41ce9706-d77e-4f79-81ee-87a4c7893ccd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:07.876236 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-41ce9706-d77e-4f79-81ee-87a4c7893ccd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:07.903384 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-41ce9706-d77e-4f79-81ee-87a4c7893ccd tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1447 microversion: 2.75 time: 0.686860 Jun 16 14:51:07.906108 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1201/2495] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:07 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1447 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:07.938518 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c58c0e13-1e4b-40fe-a55b-093c6b03d1cb tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:07.940224 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c58c0e13-1e4b-40fe-a55b-093c6b03d1cb tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:07.957667 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c58c0e13-1e4b-40fe-a55b-093c6b03d1cb tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:07.982639 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c58c0e13-1e4b-40fe-a55b-093c6b03d1cb tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:07.989004 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c58c0e13-1e4b-40fe-a55b-093c6b03d1cb tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:07.998702 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c58c0e13-1e4b-40fe-a55b-093c6b03d1cb tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:08.870604 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c58c0e13-1e4b-40fe-a55b-093c6b03d1cb tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:08.890576 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c58c0e13-1e4b-40fe-a55b-093c6b03d1cb tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:08.893402 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c58c0e13-1e4b-40fe-a55b-093c6b03d1cb tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:08.897496 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c58c0e13-1e4b-40fe-a55b-093c6b03d1cb tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1359 microversion: 2.21 time: 0.985445 Jun 16 14:51:08.898723 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1202/2496] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:07 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1359 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:08.905145 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4050986d-15de-4ff3-ae34-21e5032ec609 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:08.906095 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4050986d-15de-4ff3-ae34-21e5032ec609 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1972ad93-7fd8-4543-8c50-9f3948d5be42] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:08.936715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4050986d-15de-4ff3-ae34-21e5032ec609 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:08.937616 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4050986d-15de-4ff3-ae34-21e5032ec609 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:08.941225 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4050986d-15de-4ff3-ae34-21e5032ec609 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:08.944938 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4050986d-15de-4ff3-ae34-21e5032ec609 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:08.973124 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-4050986d-15de-4ff3-ae34-21e5032ec609 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] HTTP exception thrown: Instance 1972ad93-7fd8-4543-8c50-9f3948d5be42 could not be found. Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4050986d-15de-4ff3-ae34-21e5032ec609 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Request method failure captured: Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/1972ad93-7fd8-4543-8c50-9f3948d5be42 HTTP/1.1 Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0Lm9WYUZXO7DMycMw67wukE2fJSRNCUHg0wp6gVkCoip8bvewVnCEWACZGYKvHcWmJBrXfaxrMDAazMXuXrkBzrznxalFCWV5xS_Ze9JH_QDPPyew1IPc9_6IH9GqGY16XI204GEVc2JQNvXrdRT5FP4D9eDxgWkeJu-teSTxRkpws Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: c4268b504d13415f9d0e23844936bf25 Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-MultipleCreateTestJSON-1094059181 Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c4268b504d13415f9d0e23844936bf25", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c4268b504d13415f9d0e23844936bf25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c4268b504d13415f9d0e23844936bf25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c4268b504d13415f9d0e23844936bf25"}]}] Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-MultipleCreateTestJSON-1094059181 Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: c4268b504d13415f9d0e23844936bf25 Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1094059181 Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-MultipleCreateTestJSON-1094059181-project Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: be1e4996a4ab47be9bafdd07293277d0 Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-MultipleCreateTestJSON-1094059181-project Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 1972ad93-7fd8-4543-8c50-9f3948d5be42 could not be found. Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '1972ad93-7fd8-4543-8c50-9f3948d5be42'} Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1972ad93-7fd8-4543-8c50-9f3948d5be42 could not be found. Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1972ad93-7fd8-4543-8c50-9f3948d5be42 could not be found. Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:51:08.976828 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:51:08.981202 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:08.981202 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:51:08.981202 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:51:08.981202 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:51:08.981202 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:51:08.981202 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1972ad93-7fd8-4543-8c50-9f3948d5be42 could not be found. Jun 16 14:51:08.981202 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:51:08.983395 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4050986d-15de-4ff3-ae34-21e5032ec609 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Returning 404 to user: Instance 1972ad93-7fd8-4543-8c50-9f3948d5be42 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:51:08.984469 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4050986d-15de-4ff3-ae34-21e5032ec609 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1972ad93-7fd8-4543-8c50-9f3948d5be42" status: 404 len: 111 microversion: 2.1 time: 0.084397 Jun 16 14:51:08.988983 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1203/2497] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:08 2022] GET /compute/v2.1/servers/1972ad93-7fd8-4543-8c50-9f3948d5be42 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:51:08.995872 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8fc13f0a-3f98-4d2a-bffe-2f4a31b938b1 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:08.996963 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8fc13f0a-3f98-4d2a-bffe-2f4a31b938b1 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:09.053276 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8fc13f0a-3f98-4d2a-bffe-2f4a31b938b1 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:09.054019 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8fc13f0a-3f98-4d2a-bffe-2f4a31b938b1 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:09.060247 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8fc13f0a-3f98-4d2a-bffe-2f4a31b938b1 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:09.063303 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8fc13f0a-3f98-4d2a-bffe-2f4a31b938b1 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:09.701167 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8fc13f0a-3f98-4d2a-bffe-2f4a31b938b1 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:09.727984 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8fc13f0a-3f98-4d2a-bffe-2f4a31b938b1 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1351 microversion: 2.1 time: 0.735875 Jun 16 14:51:09.729991 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1204/2498] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:08 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1351 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:09.742215 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b192b68c-a776-48b6-ad65-89cffcee1455 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:09.750624 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b192b68c-a776-48b6-ad65-89cffcee1455 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:09.768616 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b192b68c-a776-48b6-ad65-89cffcee1455 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:09.769368 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b192b68c-a776-48b6-ad65-89cffcee1455 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:09.770466 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b192b68c-a776-48b6-ad65-89cffcee1455 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:09.771207 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b192b68c-a776-48b6-ad65-89cffcee1455 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:10.148202 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b192b68c-a776-48b6-ad65-89cffcee1455 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:10.163358 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b192b68c-a776-48b6-ad65-89cffcee1455 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1316 microversion: 2.1 time: 0.431468 Jun 16 14:51:10.164449 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1205/2499] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:09 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:10.191153 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-611fd497-93eb-40e7-87dd-79e816a89938 req-2d09311a-d86b-4765-821f-ff8adaaed339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1972ad93-7fd8-4543-8c50-9f3948d5be42", "name": "network-vif-deleted", "tag": "dffb6435-1d69-4ea3-8dd2-4cd53a4fefd2"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:10.207195 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-611fd497-93eb-40e7-87dd-79e816a89938 req-2d09311a-d86b-4765-821f-ff8adaaed339 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:10.208332 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-611fd497-93eb-40e7-87dd-79e816a89938 req-2d09311a-d86b-4765-821f-ff8adaaed339 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:10.231480 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-611fd497-93eb-40e7-87dd-79e816a89938 req-2d09311a-d86b-4765-821f-ff8adaaed339 service nova] Creating event network-vif-deleted:dffb6435-1d69-4ea3-8dd2-4cd53a4fefd2 for instance 1972ad93-7fd8-4543-8c50-9f3948d5be42 on n-h1-836830-4 Jun 16 14:51:10.242056 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-611fd497-93eb-40e7-87dd-79e816a89938 req-2d09311a-d86b-4765-821f-ff8adaaed339 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061194 Jun 16 14:51:10.243531 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1206/2500] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:10.251009 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-32535dd8-7493-4e6c-9ab7-a780cc1ff404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:10.251950 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-32535dd8-7493-4e6c-9ab7-a780cc1ff404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:10.260545 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-32535dd8-7493-4e6c-9ab7-a780cc1ff404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:10.260997 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-32535dd8-7493-4e6c-9ab7-a780cc1ff404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:10.262001 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-32535dd8-7493-4e6c-9ab7-a780cc1ff404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:10.262635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-32535dd8-7493-4e6c-9ab7-a780cc1ff404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:10.357670 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-97d81bc1-8e92-407b-958a-ca9394ae0126 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 4.962931 Jun 16 14:51:10.366153 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1295/2501] 10.222.0.57 () {60 vars in 1169 bytes} [Thu Jun 16 14:51:05 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:10.381942 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2f9a7340-23bb-49ba-ba3c-b4d9125a67c8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Action: 'create', calling method: .version_select at 0x7fdf0c188ee0>, body: {"keypair": {"name": "tempest-keypair-961955622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw4RS/8s4udLlQsOSd9i0sLgfaYvxGf/HNVLxmUtLyXz46KZgcN/zw36btcmpDrvHb6a1Bha/FufAgwYaDXHmfdY0NPE/MBge6U2kMYFPChW+6R2JC32kDckjEUOjzYrQ=="}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:10.419951 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-2f9a7340-23bb-49ba-ba3c-b4d9125a67c8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Getting quotas for project abae3327830f4896a0897723567e2374. Resources: {'key_pairs'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:51:10.437147 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-2f9a7340-23bb-49ba-ba3c-b4d9125a67c8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Getting quotas for user da61853d328c45e0866fadeaf3835430 and project abae3327830f4896a0897723567e2374. Resources: {'key_pairs'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:51:10.490960 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2f9a7340-23bb-49ba-ba3c-b4d9125a67c8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.118985 Jun 16 14:51:10.493351 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1296/2502] 10.222.0.57 () {62 vars in 1199 bytes} [Thu Jun 16 14:51:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 14:51:10.499775 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d19924bb-fe8c-455b-a798-2db9259f4137 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:10.502893 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d19924bb-fe8c-455b-a798-2db9259f4137 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:10.507268 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-32535dd8-7493-4e6c-9ab7-a780cc1ff404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:10.516248 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d19924bb-fe8c-455b-a798-2db9259f4137 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:10.517505 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d19924bb-fe8c-455b-a798-2db9259f4137 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:10.519325 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d19924bb-fe8c-455b-a798-2db9259f4137 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:10.520013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d19924bb-fe8c-455b-a798-2db9259f4137 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:10.523895 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-32535dd8-7493-4e6c-9ab7-a780cc1ff404 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1503 microversion: 2.1 time: 0.277240 Jun 16 14:51:10.537196 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1207/2503] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:10 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1503 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:10.537315 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c001f7ee-2dcd-4222-9d44-1e269a16e600 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:10.538586 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c001f7ee-2dcd-4222-9d44-1e269a16e600 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] [instance: 1be464d9-2abf-480e-9511-7a4ec415ce2a] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:10.550938 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c001f7ee-2dcd-4222-9d44-1e269a16e600 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:10.551703 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c001f7ee-2dcd-4222-9d44-1e269a16e600 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:10.553772 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c001f7ee-2dcd-4222-9d44-1e269a16e600 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:10.554597 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c001f7ee-2dcd-4222-9d44-1e269a16e600 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:10.587498 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-c001f7ee-2dcd-4222-9d44-1e269a16e600 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] HTTP exception thrown: Instance 1be464d9-2abf-480e-9511-7a4ec415ce2a could not be found. Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c001f7ee-2dcd-4222-9d44-1e269a16e600 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Request method failure captured: Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a HTTP/1.1 Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0Lm9WYUZXO7DMycMw67wukE2fJSRNCUHg0wp6gVkCoip8bvewVnCEWACZGYKvHcWmJBrXfaxrMDAazMXuXrkBzrznxalFCWV5xS_Ze9JH_QDPPyew1IPc9_6IH9GqGY16XI204GEVc2JQNvXrdRT5FP4D9eDxgWkeJu-teSTxRkpws Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: c4268b504d13415f9d0e23844936bf25 Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-MultipleCreateTestJSON-1094059181 Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c4268b504d13415f9d0e23844936bf25", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c4268b504d13415f9d0e23844936bf25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c4268b504d13415f9d0e23844936bf25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c4268b504d13415f9d0e23844936bf25"}]}] Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-MultipleCreateTestJSON-1094059181 Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: c4268b504d13415f9d0e23844936bf25 Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1094059181 Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-MultipleCreateTestJSON-1094059181-project Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: be1e4996a4ab47be9bafdd07293277d0 Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-MultipleCreateTestJSON-1094059181-project Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 1be464d9-2abf-480e-9511-7a4ec415ce2a could not be found. Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '1be464d9-2abf-480e-9511-7a4ec415ce2a'} Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1be464d9-2abf-480e-9511-7a4ec415ce2a could not be found. Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1be464d9-2abf-480e-9511-7a4ec415ce2a could not be found. Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:51:10.590904 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:51:10.600041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:10.600041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:51:10.600041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:51:10.600041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:51:10.600041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:51:10.600041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1be464d9-2abf-480e-9511-7a4ec415ce2a could not be found. Jun 16 14:51:10.600041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:51:10.600041 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c001f7ee-2dcd-4222-9d44-1e269a16e600 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] Returning 404 to user: Instance 1be464d9-2abf-480e-9511-7a4ec415ce2a could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:51:10.600041 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c001f7ee-2dcd-4222-9d44-1e269a16e600 tempest-MultipleCreateTestJSON-1094059181 tempest-MultipleCreateTestJSON-1094059181-project] 10.222.0.57 "GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a" status: 404 len: 111 microversion: 2.1 time: 0.066267 Jun 16 14:51:10.602077 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1208/2504] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:10 2022] GET /compute/v2.1/servers/1be464d9-2abf-480e-9511-7a4ec415ce2a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:51:10.612938 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-55fb8bf5-66dd-43d6-9679-4c1d8f10b4c5 req-edf2a0f9-3920-4fa5-aa19-974ca45ed870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2d6585-b3a9-46a5-b43d-d9eb61f41d23", "name": "network-vif-plugged", "status": "completed", "tag": "54d05d80-f4ed-4a22-8cbf-201e2d4efe15"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:10.629940 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-55fb8bf5-66dd-43d6-9679-4c1d8f10b4c5 req-edf2a0f9-3920-4fa5-aa19-974ca45ed870 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:10.630791 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-55fb8bf5-66dd-43d6-9679-4c1d8f10b4c5 req-edf2a0f9-3920-4fa5-aa19-974ca45ed870 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:10.658280 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-55fb8bf5-66dd-43d6-9679-4c1d8f10b4c5 req-edf2a0f9-3920-4fa5-aa19-974ca45ed870 service nova] Creating event network-vif-plugged:54d05d80-f4ed-4a22-8cbf-201e2d4efe15 for instance 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 on n-h2-836830-4 Jun 16 14:51:10.668183 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-55fb8bf5-66dd-43d6-9679-4c1d8f10b4c5 req-edf2a0f9-3920-4fa5-aa19-974ca45ed870 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064504 Jun 16 14:51:10.669050 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1209/2505] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:10.677214 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-48815322-460a-4001-bf50-e676b37bf157 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:10.679237 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-48815322-460a-4001-bf50-e676b37bf157 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:10.692575 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-48815322-460a-4001-bf50-e676b37bf157 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:10.694616 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-48815322-460a-4001-bf50-e676b37bf157 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:10.696419 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-48815322-460a-4001-bf50-e676b37bf157 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:10.697603 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-48815322-460a-4001-bf50-e676b37bf157 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:10.729799 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d19924bb-fe8c-455b-a798-2db9259f4137 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:10.749466 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d19924bb-fe8c-455b-a798-2db9259f4137 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:10.753857 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d19924bb-fe8c-455b-a798-2db9259f4137 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:10.768469 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d19924bb-fe8c-455b-a798-2db9259f4137 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1447 microversion: 2.75 time: 0.274010 Jun 16 14:51:10.771732 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1297/2506] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:10 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1447 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:10.785920 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-230e9ffd-2224-4b69-9ce3-504ba8551c56 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] Action: 'create', calling method: .version_select at 0x7fdf0c267790>, body: {"pool": null} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:11.778311 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-48815322-460a-4001-bf50-e676b37bf157 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:11.796003 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-48815322-460a-4001-bf50-e676b37bf157 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:11.799638 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-48815322-460a-4001-bf50-e676b37bf157 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:11.802155 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-48815322-460a-4001-bf50-e676b37bf157 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1359 microversion: 2.21 time: 1.131001 Jun 16 14:51:11.804515 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1210/2507] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:10 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1359 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:11.813462 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5872d116-5ce0-4565-aec5-10455b76bd60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:11.814942 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5872d116-5ce0-4565-aec5-10455b76bd60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:11.827013 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5872d116-5ce0-4565-aec5-10455b76bd60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:11.828310 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5872d116-5ce0-4565-aec5-10455b76bd60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:11.830060 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5872d116-5ce0-4565-aec5-10455b76bd60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:11.831536 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5872d116-5ce0-4565-aec5-10455b76bd60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:11.899583 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5872d116-5ce0-4565-aec5-10455b76bd60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:51:12.057499 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5872d116-5ce0-4565-aec5-10455b76bd60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "DELETE /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 204 len: 0 microversion: 2.1 time: 0.250561 Jun 16 14:51:12.058396 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1211/2508] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:51:11 2022] DELETE /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:51:12.065495 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7f9878b8-aab0-4f7d-aec6-b07317187fe8 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:12.066236 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7f9878b8-aab0-4f7d-aec6-b07317187fe8 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:12.074225 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7f9878b8-aab0-4f7d-aec6-b07317187fe8 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:12.074705 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7f9878b8-aab0-4f7d-aec6-b07317187fe8 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:12.075757 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7f9878b8-aab0-4f7d-aec6-b07317187fe8 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:12.076379 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7f9878b8-aab0-4f7d-aec6-b07317187fe8 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:12.499659 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7f9878b8-aab0-4f7d-aec6-b07317187fe8 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:12.513673 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7f9878b8-aab0-4f7d-aec6-b07317187fe8 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1351 microversion: 2.1 time: 0.453679 Jun 16 14:51:12.514443 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1212/2509] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:12 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1351 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:12.527148 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-df917a45-a468-422c-a2b7-accffcb0a279 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:12.528000 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-df917a45-a468-422c-a2b7-accffcb0a279 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:12.535535 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-df917a45-a468-422c-a2b7-accffcb0a279 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:12.536096 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-df917a45-a468-422c-a2b7-accffcb0a279 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:12.538931 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-df917a45-a468-422c-a2b7-accffcb0a279 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:12.539387 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-df917a45-a468-422c-a2b7-accffcb0a279 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:12.920189 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-df917a45-a468-422c-a2b7-accffcb0a279 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:12.950642 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-df917a45-a468-422c-a2b7-accffcb0a279 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1316 microversion: 2.1 time: 0.433063 Jun 16 14:51:12.960442 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1213/2510] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:12 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:12.970459 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fa1bcf3d-b405-44c2-ac17-c7a55fe1417e tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:12.971664 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fa1bcf3d-b405-44c2-ac17-c7a55fe1417e tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:12.984181 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fa1bcf3d-b405-44c2-ac17-c7a55fe1417e tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:12.985634 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fa1bcf3d-b405-44c2-ac17-c7a55fe1417e tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:12.987639 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fa1bcf3d-b405-44c2-ac17-c7a55fe1417e tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:12.988902 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fa1bcf3d-b405-44c2-ac17-c7a55fe1417e tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:13.141401 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fa1bcf3d-b405-44c2-ac17-c7a55fe1417e tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:13.160225 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fa1bcf3d-b405-44c2-ac17-c7a55fe1417e tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:13.164196 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fa1bcf3d-b405-44c2-ac17-c7a55fe1417e tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:13.181922 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fa1bcf3d-b405-44c2-ac17-c7a55fe1417e tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1447 microversion: 2.75 time: 0.217299 Jun 16 14:51:13.186980 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1214/2511] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:12 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1447 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:13.200130 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-973671f4-963a-400e-9998-e9e5d24ad278 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:13.201833 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-973671f4-963a-400e-9998-e9e5d24ad278 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:13.214665 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-973671f4-963a-400e-9998-e9e5d24ad278 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:13.215891 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-973671f4-963a-400e-9998-e9e5d24ad278 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:13.217697 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-973671f4-963a-400e-9998-e9e5d24ad278 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:13.218895 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-973671f4-963a-400e-9998-e9e5d24ad278 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:13.590423 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-973671f4-963a-400e-9998-e9e5d24ad278 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:13.610645 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-973671f4-963a-400e-9998-e9e5d24ad278 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1509 microversion: 2.1 time: 0.420905 Jun 16 14:51:13.611900 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1215/2512] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:13 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1509 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:13.622697 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-4bfa1003-0874-44db-8a3b-84f602b18c0d req-7ccb749f-9cdf-479e-aac2-45c44382dc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be464d9-2abf-480e-9511-7a4ec415ce2a", "name": "network-vif-deleted", "tag": "5bc6aa8b-e395-4b98-abff-087bfaa42324"}, {"name": "network-changed", "server_uuid": "d41f1557-357b-4a04-9556-a542c790ad08", "tag": "8284b8a1-5b84-445d-8a6f-ed3c56cc1772"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:13.642319 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-4bfa1003-0874-44db-8a3b-84f602b18c0d req-7ccb749f-9cdf-479e-aac2-45c44382dc51 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:13.643844 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-4bfa1003-0874-44db-8a3b-84f602b18c0d req-7ccb749f-9cdf-479e-aac2-45c44382dc51 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:13.681112 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-4bfa1003-0874-44db-8a3b-84f602b18c0d req-7ccb749f-9cdf-479e-aac2-45c44382dc51 service nova] Creating event network-vif-deleted:5bc6aa8b-e395-4b98-abff-087bfaa42324 for instance 1be464d9-2abf-480e-9511-7a4ec415ce2a on n-h1-836830-4 Jun 16 14:51:13.682040 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-4bfa1003-0874-44db-8a3b-84f602b18c0d req-7ccb749f-9cdf-479e-aac2-45c44382dc51 service nova] Creating event network-changed:8284b8a1-5b84-445d-8a6f-ed3c56cc1772 for instance d41f1557-357b-4a04-9556-a542c790ad08 on n-h1-836830-4 Jun 16 14:51:13.698689 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-4bfa1003-0874-44db-8a3b-84f602b18c0d req-7ccb749f-9cdf-479e-aac2-45c44382dc51 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.083718 Jun 16 14:51:13.700225 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1216/2513] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:13.721518 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1c120a8d-7dcb-4a03-8f64-9f3aeb6c79ed tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:13.724011 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1c120a8d-7dcb-4a03-8f64-9f3aeb6c79ed tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:13.740752 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1c120a8d-7dcb-4a03-8f64-9f3aeb6c79ed tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:13.742423 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1c120a8d-7dcb-4a03-8f64-9f3aeb6c79ed tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:13.743704 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1c120a8d-7dcb-4a03-8f64-9f3aeb6c79ed tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:13.744594 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1c120a8d-7dcb-4a03-8f64-9f3aeb6c79ed tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:13.968180 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-230e9ffd-2224-4b69-9ce3-504ba8551c56 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.194420 Jun 16 14:51:13.971306 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1298/2514] 10.222.0.57 () {60 vars in 1169 bytes} [Thu Jun 16 14:51:10 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:13.986663 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-a372310c-45dc-4f82-a284-f9f548d08629 req-ee56d545-808b-4fc3-891d-00019fd80bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa828bec-416c-496b-9290-60892a56a452", "name": "network-vif-plugged", "status": "completed", "tag": "50551314-0d91-4b89-ae9d-7adae8fcf3a6"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:14.010610 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-a372310c-45dc-4f82-a284-f9f548d08629 req-ee56d545-808b-4fc3-891d-00019fd80bd2 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:14.012170 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-a372310c-45dc-4f82-a284-f9f548d08629 req-ee56d545-808b-4fc3-891d-00019fd80bd2 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:14.064668 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-a372310c-45dc-4f82-a284-f9f548d08629 req-ee56d545-808b-4fc3-891d-00019fd80bd2 service nova] Creating event network-vif-plugged:50551314-0d91-4b89-ae9d-7adae8fcf3a6 for instance aa828bec-416c-496b-9290-60892a56a452 on n-h2-836830-4 Jun 16 14:51:14.075710 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-a372310c-45dc-4f82-a284-f9f548d08629 req-ee56d545-808b-4fc3-891d-00019fd80bd2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101463 Jun 16 14:51:14.077178 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1299/2515] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:14.088046 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2629f739-756b-40fa-83f2-0128b410fe63 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:14.090037 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2629f739-756b-40fa-83f2-0128b410fe63 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:14.107629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2629f739-756b-40fa-83f2-0128b410fe63 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:14.109308 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2629f739-756b-40fa-83f2-0128b410fe63 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:14.111135 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2629f739-756b-40fa-83f2-0128b410fe63 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:14.111959 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2629f739-756b-40fa-83f2-0128b410fe63 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:14.524591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2629f739-756b-40fa-83f2-0128b410fe63 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:14.544604 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2629f739-756b-40fa-83f2-0128b410fe63 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1542 microversion: 2.1 time: 0.464366 Jun 16 14:51:14.547412 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1300/2516] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:14 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1542 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:14.561806 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1c120a8d-7dcb-4a03-8f64-9f3aeb6c79ed tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:14.573980 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-929b6496-44a9-4d81-95ee-f6a6919efab9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:14.575657 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-929b6496-44a9-4d81-95ee-f6a6919efab9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:14.584325 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1c120a8d-7dcb-4a03-8f64-9f3aeb6c79ed tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:14.588051 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1c120a8d-7dcb-4a03-8f64-9f3aeb6c79ed tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:14.590179 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1c120a8d-7dcb-4a03-8f64-9f3aeb6c79ed tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1359 microversion: 2.21 time: 0.887837 Jun 16 14:51:14.591192 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-929b6496-44a9-4d81-95ee-f6a6919efab9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:14.592274 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-929b6496-44a9-4d81-95ee-f6a6919efab9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:14.594621 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-929b6496-44a9-4d81-95ee-f6a6919efab9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:14.595888 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-929b6496-44a9-4d81-95ee-f6a6919efab9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:14.604288 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1217/2517] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:13 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1359 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:14.626980 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0c918830-25f9-45be-ad57-885de440ff55 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] Action: 'create', calling method: .version_select at 0x7fdeffb31790>, body: {"pool": null} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:15.146254 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-929b6496-44a9-4d81-95ee-f6a6919efab9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:15.155134 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-929b6496-44a9-4d81-95ee-f6a6919efab9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1316 microversion: 2.1 time: 0.605579 Jun 16 14:51:15.155742 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1301/2518] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:14 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1316 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:15.160669 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cca2a55d-a2fb-4e73-84a7-487dfc4113bb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:15.161814 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cca2a55d-a2fb-4e73-84a7-487dfc4113bb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:15.169167 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cca2a55d-a2fb-4e73-84a7-487dfc4113bb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:15.169703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cca2a55d-a2fb-4e73-84a7-487dfc4113bb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:15.170555 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cca2a55d-a2fb-4e73-84a7-487dfc4113bb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:15.171007 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cca2a55d-a2fb-4e73-84a7-487dfc4113bb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:15.256230 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cca2a55d-a2fb-4e73-84a7-487dfc4113bb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:15.266116 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cca2a55d-a2fb-4e73-84a7-487dfc4113bb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:15.267854 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cca2a55d-a2fb-4e73-84a7-487dfc4113bb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:15.274629 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cca2a55d-a2fb-4e73-84a7-487dfc4113bb tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1447 microversion: 2.75 time: 0.117744 Jun 16 14:51:15.280142 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1302/2519] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:15 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:15.281704 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-601c516e-de5d-4925-93e1-69d83ec04d5e tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:15.282319 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-601c516e-de5d-4925-93e1-69d83ec04d5e tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:15.292750 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-601c516e-de5d-4925-93e1-69d83ec04d5e tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:15.293212 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-601c516e-de5d-4925-93e1-69d83ec04d5e tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:15.294214 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-601c516e-de5d-4925-93e1-69d83ec04d5e tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:15.294709 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-601c516e-de5d-4925-93e1-69d83ec04d5e tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:15.391669 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-601c516e-de5d-4925-93e1-69d83ec04d5e tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115149 Jun 16 14:51:15.392557 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1303/2520] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 16 14:51:15 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:15.408038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e746bc6d-786c-4df1-891c-93785b5753cd tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:15.408898 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e746bc6d-786c-4df1-891c-93785b5753cd tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:15.422366 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e746bc6d-786c-4df1-891c-93785b5753cd tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:15.422366 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e746bc6d-786c-4df1-891c-93785b5753cd tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:15.424351 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e746bc6d-786c-4df1-891c-93785b5753cd tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:15.425044 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e746bc6d-786c-4df1-891c-93785b5753cd tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:15.591449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e746bc6d-786c-4df1-891c-93785b5753cd tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:15.613273 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e746bc6d-786c-4df1-891c-93785b5753cd tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 200 len: 1467 microversion: 2.1 time: 0.218063 Jun 16 14:51:15.627303 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1304/2521] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:15 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 1467 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:15.639287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-793073076", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "09edbafd-ab57-40cc-8b7c-3cd8718eb1cf"}, {"port": "59329a00-c78e-4af9-81f7-04ede23e4f24", "tag": "port-1"}, {"port": "59215472-4985-4b78-b577-83b9797bacb4", "tag": "port-2"}, {"uuid": "9393f18d-1283-495d-aa48-1f9aa1146687", "tag": "net-1"}, {"uuid": "9393f18d-1283-495d-aa48-1f9aa1146687"}, {"uuid": "556a53ea-6ade-41aa-a1ba-25693e0f5427", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "556a53ea-6ade-41aa-a1ba-25693e0f5427", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f7664da4-9189-4bd7-8b43-61c0552d9e04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f921befa-d694-4ca9-81c8-67e134b56b8b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2e765972-e93c-4840-869a-1d9f7a0d83a8", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1208610931"}], "key_name": "tempest-keypair-961955622", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:15.993071 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] validate_networks() for [('09edbafd-ab57-40cc-8b7c-3cd8718eb1cf', None, None, None, None, None), (None, None, '59329a00-c78e-4af9-81f7-04ede23e4f24', None, None, None), (None, None, '59215472-4985-4b78-b577-83b9797bacb4', None, None, None), ('9393f18d-1283-495d-aa48-1f9aa1146687', None, None, None, None, None), ('9393f18d-1283-495d-aa48-1f9aa1146687', None, None, None, None, None), ('556a53ea-6ade-41aa-a1ba-25693e0f5427', '10.2.2.100', None, None, None, None), ('556a53ea-6ade-41aa-a1ba-25693e0f5427', '10.2.2.200', None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:51:18.189030 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0c918830-25f9-45be-ad57-885de440ff55 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.582940 Jun 16 14:51:18.190040 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1218/2522] 10.222.0.57 () {60 vars in 1169 bytes} [Thu Jun 16 14:51:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:18.197668 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-10e0994c-aff5-42d5-bcf0-a0fb3854e0bd tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:18.198552 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-10e0994c-aff5-42d5-bcf0-a0fb3854e0bd tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:18.207519 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-10e0994c-aff5-42d5-bcf0-a0fb3854e0bd tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:18.208862 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-10e0994c-aff5-42d5-bcf0-a0fb3854e0bd tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:18.209994 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-10e0994c-aff5-42d5-bcf0-a0fb3854e0bd tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:18.210870 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-10e0994c-aff5-42d5-bcf0-a0fb3854e0bd tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:18.232168 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:18.384380 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-10e0994c-aff5-42d5-bcf0-a0fb3854e0bd tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:18.396928 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-10e0994c-aff5-42d5-bcf0-a0fb3854e0bd tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:18.398945 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-10e0994c-aff5-42d5-bcf0-a0fb3854e0bd tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:18.400154 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-10e0994c-aff5-42d5-bcf0-a0fb3854e0bd tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1359 microversion: 2.21 time: 0.208817 Jun 16 14:51:18.400738 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1219/2523] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:18 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:18.406023 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-1f82ec45-18ea-4a85-b2d4-e90b559d7de2 req-9699e342-8e47-4f67-9599-8ff721484388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "081012fa-36f8-40a2-8057-e774e847f716", "name": "network-vif-deleted", "tag": "8e2b4cfe-00ec-474a-856c-901541361bf0"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:18.421194 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-1f82ec45-18ea-4a85-b2d4-e90b559d7de2 req-9699e342-8e47-4f67-9599-8ff721484388 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:18.422467 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-1f82ec45-18ea-4a85-b2d4-e90b559d7de2 req-9699e342-8e47-4f67-9599-8ff721484388 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:18.439603 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-1f82ec45-18ea-4a85-b2d4-e90b559d7de2 req-9699e342-8e47-4f67-9599-8ff721484388 service nova] Creating event network-vif-deleted:8e2b4cfe-00ec-474a-856c-901541361bf0 for instance 081012fa-36f8-40a2-8057-e774e847f716 on n-h2-836830-4 Jun 16 14:51:18.445528 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-1f82ec45-18ea-4a85-b2d4-e90b559d7de2 req-9699e342-8e47-4f67-9599-8ff721484388 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043117 Jun 16 14:51:18.446182 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1220/2524] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:18.457026 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-51a71440-e88e-4882-b5b1-9a36411133f5 req-370e2a73-b046-4eee-a567-be20c54f4dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d41f1557-357b-4a04-9556-a542c790ad08", "name": "network-vif-plugged", "status": "completed", "tag": "8284b8a1-5b84-445d-8a6f-ed3c56cc1772"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:18.471424 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-51a71440-e88e-4882-b5b1-9a36411133f5 req-370e2a73-b046-4eee-a567-be20c54f4dc9 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:18.472244 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-51a71440-e88e-4882-b5b1-9a36411133f5 req-370e2a73-b046-4eee-a567-be20c54f4dc9 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:18.488095 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-51a71440-e88e-4882-b5b1-9a36411133f5 req-370e2a73-b046-4eee-a567-be20c54f4dc9 service nova] Creating event network-vif-plugged:8284b8a1-5b84-445d-8a6f-ed3c56cc1772 for instance d41f1557-357b-4a04-9556-a542c790ad08 on n-h1-836830-4 Jun 16 14:51:18.494314 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-51a71440-e88e-4882-b5b1-9a36411133f5 req-370e2a73-b046-4eee-a567-be20c54f4dc9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044077 Jun 16 14:51:18.495346 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1221/2525] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:18.500832 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fbc6ca78-cd47-4e68-8e3d-67078df60b50 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:18.501563 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fbc6ca78-cd47-4e68-8e3d-67078df60b50 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:18.508896 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fbc6ca78-cd47-4e68-8e3d-67078df60b50 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:18.509628 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fbc6ca78-cd47-4e68-8e3d-67078df60b50 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:18.510532 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fbc6ca78-cd47-4e68-8e3d-67078df60b50 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:18.510931 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fbc6ca78-cd47-4e68-8e3d-67078df60b50 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:18.761760 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fbc6ca78-cd47-4e68-8e3d-67078df60b50 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:18.778470 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fbc6ca78-cd47-4e68-8e3d-67078df60b50 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1465 microversion: 2.1 time: 0.281337 Jun 16 14:51:18.795500 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1222/2526] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:18 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1465 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:18.808555 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7a22e108-d16a-4f27-94a1-3d6260bfbdb7 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:18.808885 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7a22e108-d16a-4f27-94a1-3d6260bfbdb7 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:18.821031 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a22e108-d16a-4f27-94a1-3d6260bfbdb7 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:18.823303 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a22e108-d16a-4f27-94a1-3d6260bfbdb7 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:18.825293 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a22e108-d16a-4f27-94a1-3d6260bfbdb7 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:18.829453 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a22e108-d16a-4f27-94a1-3d6260bfbdb7 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:18.946752 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7a22e108-d16a-4f27-94a1-3d6260bfbdb7 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:18.963856 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7a22e108-d16a-4f27-94a1-3d6260bfbdb7 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:18.968307 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7a22e108-d16a-4f27-94a1-3d6260bfbdb7 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:18.979477 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7a22e108-d16a-4f27-94a1-3d6260bfbdb7 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1447 microversion: 2.75 time: 0.181683 Jun 16 14:51:18.980793 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1223/2527] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:18 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1447 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:18.991421 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-58efa184-b6d0-4770-8680-c2617ea02dcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:18.993184 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-58efa184-b6d0-4770-8680-c2617ea02dcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 081012fa-36f8-40a2-8057-e774e847f716] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:19.006275 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-58efa184-b6d0-4770-8680-c2617ea02dcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:19.007403 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-58efa184-b6d0-4770-8680-c2617ea02dcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:19.007614 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-58efa184-b6d0-4770-8680-c2617ea02dcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:19.008061 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-58efa184-b6d0-4770-8680-c2617ea02dcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:19.026422 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-58efa184-b6d0-4770-8680-c2617ea02dcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] HTTP exception thrown: Instance 081012fa-36f8-40a2-8057-e774e847f716 could not be found. Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-58efa184-b6d0-4770-8680-c2617ea02dcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Request method failure captured: Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 HTTP/1.1 Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0MvJ0R4NIFXfn4T9DdbY1PJWoesK-5nib9YvBtnFG9uywU3lbfvtjVN5oqZqx8_RnrO9BysZ0WqJt6XkJRYQmBGZAEbj8GVndngKni5KcW6-DH7CCdrUkWO5n5WzNi_C8qSq70U7P3qWrgvqNpu5Hzg9LouNmytvjJk_TvR4-o3m0Y Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: aa616e014da1416aa7369181bd1518e5 Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-DeleteServersTestJSON-31158303 Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa616e014da1416aa7369181bd1518e5", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa616e014da1416aa7369181bd1518e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa616e014da1416aa7369181bd1518e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa616e014da1416aa7369181bd1518e5"}]}] Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-DeleteServersTestJSON-31158303 Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: aa616e014da1416aa7369181bd1518e5 Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-DeleteServersTestJSON-31158303 Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-DeleteServersTestJSON-31158303-project Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 4e78da3d7a6f45d7abe04bc447f7c870 Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-DeleteServersTestJSON-31158303-project Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 081012fa-36f8-40a2-8057-e774e847f716 could not be found. Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '081012fa-36f8-40a2-8057-e774e847f716'} Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 081012fa-36f8-40a2-8057-e774e847f716 could not be found. Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 081012fa-36f8-40a2-8057-e774e847f716 could not be found. Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:51:19.028189 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:51:19.055874 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:19.055874 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:51:19.055874 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:51:19.055874 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:51:19.055874 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:51:19.055874 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 081012fa-36f8-40a2-8057-e774e847f716 could not be found. Jun 16 14:51:19.055874 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:51:19.055874 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-58efa184-b6d0-4770-8680-c2617ea02dcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Returning 404 to user: Instance 081012fa-36f8-40a2-8057-e774e847f716 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:51:19.055874 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-58efa184-b6d0-4770-8680-c2617ea02dcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716" status: 404 len: 111 microversion: 2.1 time: 0.047328 Jun 16 14:51:19.055874 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1224/2528] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:18 2022] GET /compute/v2.1/servers/081012fa-36f8-40a2-8057-e774e847f716 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:51:19.055874 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bf1fab54-9327-48ca-bf5b-32801d82a749 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] Calling method '.version_select at 0x7fdeffcd4310>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:19.362938 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bf1fab54-9327-48ca-bf5b-32801d82a749 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ips/55672881-4f10-4beb-952a-e9c35376c70c" status: 200 len: 142 microversion: 2.1 time: 0.330703 Jun 16 14:51:19.367140 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1225/2529] 10.222.0.57 () {58 vars in 1259 bytes} [Thu Jun 16 14:51:19 2022] GET /compute/v2.1/os-floating-ips/55672881-4f10-4beb-952a-e9c35376c70c => generated 142 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:19.377451 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-56611cc7-46d5-483b-8b3c-dc8e82077f3d tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-876052762", "metadata": {"image_type": "test"}}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:19.380457 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-56611cc7-46d5-483b-8b3c-dc8e82077f3d tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:19.395110 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-56611cc7-46d5-483b-8b3c-dc8e82077f3d tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:19.396671 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-56611cc7-46d5-483b-8b3c-dc8e82077f3d tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:19.398236 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-56611cc7-46d5-483b-8b3c-dc8e82077f3d tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:19.399525 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-56611cc7-46d5-483b-8b3c-dc8e82077f3d tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:19.490894 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-56611cc7-46d5-483b-8b3c-dc8e82077f3d tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Getting quotas for project 516446d68e6b452c83140a9cf4625619. Resources: dict_keys(['metadata_items']) {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:51:19.497399 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-56611cc7-46d5-483b-8b3c-dc8e82077f3d tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Getting quotas for user 00c2308f7caf47369c442b63533253de and project 516446d68e6b452c83140a9cf4625619. Resources: dict_keys(['metadata_items']) {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:51:20.104901 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-56611cc7-46d5-483b-8b3c-dc8e82077f3d tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "POST /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452/action" status: 202 len: 0 microversion: 2.1 time: 0.734364 Jun 16 14:51:20.118616 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1226/2530] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:51:19 2022] POST /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452/action => generated 0 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 14:51:20.133928 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-60738b0d-e167-4372-a5ba-36b62ac1f9b0 req-2a48df15-1204-48d0-a204-a4f434adda0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2d6585-b3a9-46a5-b43d-d9eb61f41d23", "tag": "54d05d80-f4ed-4a22-8cbf-201e2d4efe15"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:20.155109 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-60738b0d-e167-4372-a5ba-36b62ac1f9b0 req-2a48df15-1204-48d0-a204-a4f434adda0a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:20.155916 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-60738b0d-e167-4372-a5ba-36b62ac1f9b0 req-2a48df15-1204-48d0-a204-a4f434adda0a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:20.183384 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-60738b0d-e167-4372-a5ba-36b62ac1f9b0 req-2a48df15-1204-48d0-a204-a4f434adda0a service nova] Creating event network-changed:54d05d80-f4ed-4a22-8cbf-201e2d4efe15 for instance 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 on n-h2-836830-4 Jun 16 14:51:20.197244 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-60738b0d-e167-4372-a5ba-36b62ac1f9b0 req-2a48df15-1204-48d0-a204-a4f434adda0a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075647 Jun 16 14:51:20.198670 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1227/2531] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:20.206900 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-195410454", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "8f2bdb2a-89e7-4760-bf67-a768c01f1b49"}]}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:20.393789 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] validate_networks() for [('8f2bdb2a-89e7-4760-bf67-a768c01f1b49', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:51:20.455619 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:21.792525 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:51:21.793535 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:51:21.794068 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:51:21.794836 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:51:21.795404 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:51:21.806768 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:21.807393 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:21.808308 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:21.808850 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:21.829813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Getting quotas for project abae3327830f4896a0897723567e2374. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:51:21.837285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Getting quotas for user da61853d328c45e0866fadeaf3835430 and project abae3327830f4896a0897723567e2374. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:51:22.031668 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:51:22.031668 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f7664da4-9189-4bd7-8b43-61c0552d9e04',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f921befa-d694-4ca9-81c8-67e134b56b8b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e765972-e93c-4840-869a-1d9f7a0d83a8',volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:51:22.452305 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:51:22.453220 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:51:22.453977 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:51:22.454736 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:51:22.455505 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:51:22.500076 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:22.501317 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:22.502882 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:22.503840 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:22.577554 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0a8c2588-4a6f-48fb-9bdb-e9b746cd8234 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.948572 Jun 16 14:51:22.579067 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1305/2532] 10.222.0.57 () {62 vars in 1188 bytes} [Thu Jun 16 14:51:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 6951 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 14:51:22.591086 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b7b0912e-47b9-4d1d-854b-2a203b02822c tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] Calling method '.version_select at 0x7fdf0c2baaf0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:22.641587 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Getting quotas for project aa616e014da1416aa7369181bd1518e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:51:22.710222 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Getting quotas for user 4e78da3d7a6f45d7abe04bc447f7c870 and project aa616e014da1416aa7369181bd1518e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:51:22.725703 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:22.762685 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:51:22.767542 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:51:22.856872 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7ec99cb3-89f9-4cfc-ba5f-4cfe74935ec6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.656163 Jun 16 14:51:22.861214 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1228/2533] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:51:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:51:22.883988 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-eccb9a6a-45d4-4b52-a07f-a1b832057c0b tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:22.885027 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-eccb9a6a-45d4-4b52-a07f-a1b832057c0b tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:22.917767 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eccb9a6a-45d4-4b52-a07f-a1b832057c0b tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:22.918539 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eccb9a6a-45d4-4b52-a07f-a1b832057c0b tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:22.919867 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eccb9a6a-45d4-4b52-a07f-a1b832057c0b tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:22.922823 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eccb9a6a-45d4-4b52-a07f-a1b832057c0b tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:23.270678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-eccb9a6a-45d4-4b52-a07f-a1b832057c0b tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:23.295746 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-eccb9a6a-45d4-4b52-a07f-a1b832057c0b tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:23.299067 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-eccb9a6a-45d4-4b52-a07f-a1b832057c0b tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:23.301365 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-eccb9a6a-45d4-4b52-a07f-a1b832057c0b tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1552 microversion: 2.21 time: 0.438313 Jun 16 14:51:23.302796 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1229/2534] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:22 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1552 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:23.330595 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-00f99341-7401-4935-a031-47f89f53d00c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:23.331697 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-00f99341-7401-4935-a031-47f89f53d00c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:23.347054 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-00f99341-7401-4935-a031-47f89f53d00c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:23.347835 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-00f99341-7401-4935-a031-47f89f53d00c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:23.349862 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-00f99341-7401-4935-a031-47f89f53d00c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:23.355278 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-00f99341-7401-4935-a031-47f89f53d00c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:23.530470 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-00f99341-7401-4935-a031-47f89f53d00c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:23.567468 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-00f99341-7401-4935-a031-47f89f53d00c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:23.573240 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-00f99341-7401-4935-a031-47f89f53d00c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:23.604000 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-00f99341-7401-4935-a031-47f89f53d00c tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1453 microversion: 2.75 time: 0.287936 Jun 16 14:51:23.613207 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1230/2535] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:23 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1453 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:23.625436 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a9283eef-b826-407c-aa1a-b0ef950ee6e2 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeff371dc0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:23.730679 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a9283eef-b826-407c-aa1a-b0ef950ee6e2 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.114516 Jun 16 14:51:23.740246 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1231/2536] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:23 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:23.776439 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3cf8360d-e467-42dc-ba15-99f1d4d3eea0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:23.797944 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3cf8360d-e467-42dc-ba15-99f1d4d3eea0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:23.948746 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3cf8360d-e467-42dc-ba15-99f1d4d3eea0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:23.966473 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3cf8360d-e467-42dc-ba15-99f1d4d3eea0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:23.968129 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3cf8360d-e467-42dc-ba15-99f1d4d3eea0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:23.977425 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3cf8360d-e467-42dc-ba15-99f1d4d3eea0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1284 microversion: 2.32 time: 0.233956 Jun 16 14:51:23.978608 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1232/2537] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:23 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1284 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:23.984174 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f00b16eb-9d9a-4f30-a410-efe0e293b113 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:23.984872 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f00b16eb-9d9a-4f30-a410-efe0e293b113 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:24.013987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f00b16eb-9d9a-4f30-a410-efe0e293b113 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:24.014549 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f00b16eb-9d9a-4f30-a410-efe0e293b113 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:24.015258 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f00b16eb-9d9a-4f30-a410-efe0e293b113 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:24.016492 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f00b16eb-9d9a-4f30-a410-efe0e293b113 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:24.200827 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f00b16eb-9d9a-4f30-a410-efe0e293b113 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:24.226012 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f00b16eb-9d9a-4f30-a410-efe0e293b113 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1218 microversion: 2.1 time: 0.245826 Jun 16 14:51:24.233011 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1233/2538] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:23 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1218 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:24.280324 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8105c900-3fa5-4ae4-a9b2-5015ad42bc9c tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:24.285602 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8105c900-3fa5-4ae4-a9b2-5015ad42bc9c tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:24.315526 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8105c900-3fa5-4ae4-a9b2-5015ad42bc9c tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:24.327464 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8105c900-3fa5-4ae4-a9b2-5015ad42bc9c tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:24.328932 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8105c900-3fa5-4ae4-a9b2-5015ad42bc9c tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:24.329671 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8105c900-3fa5-4ae4-a9b2-5015ad42bc9c tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:24.469229 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8105c900-3fa5-4ae4-a9b2-5015ad42bc9c tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:51:24.752222 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8105c900-3fa5-4ae4-a9b2-5015ad42bc9c tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 204 len: 0 microversion: 2.21 time: 0.510989 Jun 16 14:51:24.755038 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1234/2539] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 16 14:51:24 2022] DELETE /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 14:51:24.769706 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c67ecbdc-cda0-4054-87de-70a152cd2581 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:24.772857 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c67ecbdc-cda0-4054-87de-70a152cd2581 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:24.791708 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c67ecbdc-cda0-4054-87de-70a152cd2581 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:24.792970 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c67ecbdc-cda0-4054-87de-70a152cd2581 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:24.794890 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c67ecbdc-cda0-4054-87de-70a152cd2581 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:24.821485 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c67ecbdc-cda0-4054-87de-70a152cd2581 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:25.016620 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c67ecbdc-cda0-4054-87de-70a152cd2581 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:25.038025 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c67ecbdc-cda0-4054-87de-70a152cd2581 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:25.043777 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c67ecbdc-cda0-4054-87de-70a152cd2581 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:25.073804 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c67ecbdc-cda0-4054-87de-70a152cd2581 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1453 microversion: 2.75 time: 0.315469 Jun 16 14:51:25.074894 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1235/2540] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:24 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1453 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:25.100594 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1948706f-e51b-4893-b855-1cabffecfe46 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeff3683a0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:25.127802 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b7b0912e-47b9-4d1d-854b-2a203b02822c tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/55672881-4f10-4beb-952a-e9c35376c70c" status: 202 len: 0 microversion: 2.1 time: 2.545938 Jun 16 14:51:25.130929 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1306/2541] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jun 16 14:51:22 2022] DELETE /compute/v2.1/os-floating-ips/55672881-4f10-4beb-952a-e9c35376c70c => generated 0 bytes in 2551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:51:25.143665 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-589c2047-9143-4a03-aff5-f354b5cfc24e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:25.147032 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-589c2047-9143-4a03-aff5-f354b5cfc24e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:25.178176 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1948706f-e51b-4893-b855-1cabffecfe46 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.101405 Jun 16 14:51:25.179514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-589c2047-9143-4a03-aff5-f354b5cfc24e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:25.180863 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-589c2047-9143-4a03-aff5-f354b5cfc24e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:25.182999 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-589c2047-9143-4a03-aff5-f354b5cfc24e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:25.184730 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-589c2047-9143-4a03-aff5-f354b5cfc24e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:25.189575 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1236/2542] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:25 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:25.204042 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-dfcdc606-4f08-4869-994d-9a7f02ebc48e req-5cbb2424-23e9-4a8b-8d20-a5a2e913537f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa828bec-416c-496b-9290-60892a56a452", "name": "network-vif-plugged", "status": "completed", "tag": "50551314-0d91-4b89-ae9d-7adae8fcf3a6"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:25.224164 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-dfcdc606-4f08-4869-994d-9a7f02ebc48e req-5cbb2424-23e9-4a8b-8d20-a5a2e913537f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:25.225691 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-dfcdc606-4f08-4869-994d-9a7f02ebc48e req-5cbb2424-23e9-4a8b-8d20-a5a2e913537f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:25.251686 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-dfcdc606-4f08-4869-994d-9a7f02ebc48e req-5cbb2424-23e9-4a8b-8d20-a5a2e913537f service nova] Creating event network-vif-plugged:50551314-0d91-4b89-ae9d-7adae8fcf3a6 for instance aa828bec-416c-496b-9290-60892a56a452 on n-h2-836830-4 Jun 16 14:51:25.269295 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-dfcdc606-4f08-4869-994d-9a7f02ebc48e req-5cbb2424-23e9-4a8b-8d20-a5a2e913537f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077355 Jun 16 14:51:25.269647 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1237/2543] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:25.302206 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bf10b348-9318-4c91-95a8-0a66e1804048 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:25.304563 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bf10b348-9318-4c91-95a8-0a66e1804048 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:25.334068 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bf10b348-9318-4c91-95a8-0a66e1804048 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:25.334891 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bf10b348-9318-4c91-95a8-0a66e1804048 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:25.336481 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bf10b348-9318-4c91-95a8-0a66e1804048 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:25.338841 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bf10b348-9318-4c91-95a8-0a66e1804048 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:25.500481 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-589c2047-9143-4a03-aff5-f354b5cfc24e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:25.512749 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-589c2047-9143-4a03-aff5-f354b5cfc24e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:25.514830 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-589c2047-9143-4a03-aff5-f354b5cfc24e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:25.516997 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-589c2047-9143-4a03-aff5-f354b5cfc24e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1558 microversion: 2.21 time: 0.383101 Jun 16 14:51:25.531967 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1307/2544] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:25 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1558 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:25.559107 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1f93eb96-97f8-442f-b13e-53a853e7be15 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] Calling method '.version_select at 0x7fdf0c243b80>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:25.617574 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bf10b348-9318-4c91-95a8-0a66e1804048 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:25.648869 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bf10b348-9318-4c91-95a8-0a66e1804048 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:25.652610 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bf10b348-9318-4c91-95a8-0a66e1804048 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:25.666207 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bf10b348-9318-4c91-95a8-0a66e1804048 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1526 microversion: 2.32 time: 0.389574 Jun 16 14:51:25.667369 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1238/2545] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:25 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1526 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:25.677451 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-257da22a-8689-488f-976d-f65553a6e7ac tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:25.687969 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-257da22a-8689-488f-976d-f65553a6e7ac tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:25.711486 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-257da22a-8689-488f-976d-f65553a6e7ac tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:25.716471 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-257da22a-8689-488f-976d-f65553a6e7ac tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:25.717968 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-257da22a-8689-488f-976d-f65553a6e7ac tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:25.718811 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-257da22a-8689-488f-976d-f65553a6e7ac tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:25.914393 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-257da22a-8689-488f-976d-f65553a6e7ac tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:25.960828 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-257da22a-8689-488f-976d-f65553a6e7ac tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1210 microversion: 2.1 time: 0.291066 Jun 16 14:51:25.973715 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1239/2546] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:25 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1210 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:26.031670 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1f93eb96-97f8-442f-b13e-53a853e7be15 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.491281 Jun 16 14:51:26.031670 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1308/2547] 10.222.0.57 () {58 vars in 1163 bytes} [Thu Jun 16 14:51:25 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:51:26.049037 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-14d9ced2-ec6d-463d-87a0-df8be0384471 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] Calling method '.version_select at 0x7fdeffb5e310>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:26.104114 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-75699468-877e-44b7-8954-417bd87a724b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:26.106510 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-75699468-877e-44b7-8954-417bd87a724b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:26.146209 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-75699468-877e-44b7-8954-417bd87a724b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:26.148221 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-75699468-877e-44b7-8954-417bd87a724b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:26.150091 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-75699468-877e-44b7-8954-417bd87a724b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:26.152804 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-75699468-877e-44b7-8954-417bd87a724b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:26.318689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-75699468-877e-44b7-8954-417bd87a724b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:26.347422 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-75699468-877e-44b7-8954-417bd87a724b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:26.352038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-75699468-877e-44b7-8954-417bd87a724b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:26.360629 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-75699468-877e-44b7-8954-417bd87a724b tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1453 microversion: 2.75 time: 0.268438 Jun 16 14:51:26.361602 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1309/2548] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:26 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1453 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:26.403121 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c7b99af1-fa84-4fec-8717-3566f781ad9c tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdefffe80d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:26.469380 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-14d9ced2-ec6d-463d-87a0-df8be0384471 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] 10.222.0.57 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.427786 Jun 16 14:51:26.469987 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1240/2549] 10.222.0.57 () {58 vars in 1148 bytes} [Thu Jun 16 14:51:26 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:51:26.484454 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-48e5d573-b9ee-4166-b640-e262d0f6b7d7 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] Calling method '.version_select at 0x7fdeff4b7160>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:26.526588 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c7b99af1-fa84-4fec-8717-3566f781ad9c tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.162884 Jun 16 14:51:26.528489 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1310/2550] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:26 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:26.569203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7f6efdb4-80e1-4936-84e8-f5e91de634b9 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:26.573905 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7f6efdb4-80e1-4936-84e8-f5e91de634b9 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:26.612252 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f6efdb4-80e1-4936-84e8-f5e91de634b9 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:26.613152 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f6efdb4-80e1-4936-84e8-f5e91de634b9 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:26.614692 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f6efdb4-80e1-4936-84e8-f5e91de634b9 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:26.620162 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7f6efdb4-80e1-4936-84e8-f5e91de634b9 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:26.967034 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7f6efdb4-80e1-4936-84e8-f5e91de634b9 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:26.978303 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7f6efdb4-80e1-4936-84e8-f5e91de634b9 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:26.980331 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7f6efdb4-80e1-4936-84e8-f5e91de634b9 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:26.981849 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7f6efdb4-80e1-4936-84e8-f5e91de634b9 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1558 microversion: 2.21 time: 0.436707 Jun 16 14:51:26.983133 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1311/2551] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:26 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1558 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:26.988541 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c60d18c4-d871-452f-8ead-61091bd1c059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:26.990000 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c60d18c4-d871-452f-8ead-61091bd1c059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:26.998160 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c60d18c4-d871-452f-8ead-61091bd1c059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:26.998997 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c60d18c4-d871-452f-8ead-61091bd1c059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:27.000178 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c60d18c4-d871-452f-8ead-61091bd1c059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:27.000826 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c60d18c4-d871-452f-8ead-61091bd1c059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:27.121730 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:27.267149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c60d18c4-d871-452f-8ead-61091bd1c059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:27.294809 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c60d18c4-d871-452f-8ead-61091bd1c059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:27.300267 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c60d18c4-d871-452f-8ead-61091bd1c059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:27.304920 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c60d18c4-d871-452f-8ead-61091bd1c059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1518 microversion: 2.32 time: 0.319828 Jun 16 14:51:27.307431 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1312/2552] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:26 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1518 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:27.320100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a5a7c3db-9922-4100-964f-722c181df7c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:27.321800 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a5a7c3db-9922-4100-964f-722c181df7c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:27.345111 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5a7c3db-9922-4100-964f-722c181df7c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:27.345950 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5a7c3db-9922-4100-964f-722c181df7c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:27.349664 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5a7c3db-9922-4100-964f-722c181df7c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:27.355242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5a7c3db-9922-4100-964f-722c181df7c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:27.503557 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a5a7c3db-9922-4100-964f-722c181df7c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:27.515674 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a5a7c3db-9922-4100-964f-722c181df7c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1266 microversion: 2.1 time: 0.205340 Jun 16 14:51:27.526770 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1313/2553] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:27 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:27.534543 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a5134d63-ad5d-4a70-b9b3-17ed9584541f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:27.536806 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a5134d63-ad5d-4a70-b9b3-17ed9584541f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:27.548944 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5134d63-ad5d-4a70-b9b3-17ed9584541f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:27.549670 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5134d63-ad5d-4a70-b9b3-17ed9584541f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:27.550764 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5134d63-ad5d-4a70-b9b3-17ed9584541f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:27.552667 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a5134d63-ad5d-4a70-b9b3-17ed9584541f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:27.726043 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a5134d63-ad5d-4a70-b9b3-17ed9584541f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:27.748208 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a5134d63-ad5d-4a70-b9b3-17ed9584541f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:27.750448 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a5134d63-ad5d-4a70-b9b3-17ed9584541f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:27.757699 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a5134d63-ad5d-4a70-b9b3-17ed9584541f tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1453 microversion: 2.75 time: 0.229083 Jun 16 14:51:27.764493 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1314/2554] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:27 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1453 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:27.786632 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-14c997d5-5ef6-48a6-bf39-421db98d10c6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf0c6a1a60>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:27.889458 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-14c997d5-5ef6-48a6-bf39-421db98d10c6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.123385 Jun 16 14:51:27.895556 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1315/2555] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:27 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:28.015276 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-28b63c10-3b10-4881-b087-9dc5f4b50538 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:28.016463 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-28b63c10-3b10-4881-b087-9dc5f4b50538 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:28.032809 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-28b63c10-3b10-4881-b087-9dc5f4b50538 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:28.033464 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-28b63c10-3b10-4881-b087-9dc5f4b50538 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:28.034626 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-28b63c10-3b10-4881-b087-9dc5f4b50538 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:28.036484 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-28b63c10-3b10-4881-b087-9dc5f4b50538 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:28.467830 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-28b63c10-3b10-4881-b087-9dc5f4b50538 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:28.483841 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-28b63c10-3b10-4881-b087-9dc5f4b50538 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:28.485939 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-28b63c10-3b10-4881-b087-9dc5f4b50538 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:28.487581 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-28b63c10-3b10-4881-b087-9dc5f4b50538 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1558 microversion: 2.21 time: 0.480925 Jun 16 14:51:28.488926 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1316/2556] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:28 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1558 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:51:28.514071 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a8971e8f-75c8-48c6-9d39-113874fa2741 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:28.514738 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a8971e8f-75c8-48c6-9d39-113874fa2741 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:28.523014 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a8971e8f-75c8-48c6-9d39-113874fa2741 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:28.523481 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a8971e8f-75c8-48c6-9d39-113874fa2741 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:28.524307 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a8971e8f-75c8-48c6-9d39-113874fa2741 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:28.524793 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a8971e8f-75c8-48c6-9d39-113874fa2741 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:28.654206 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a8971e8f-75c8-48c6-9d39-113874fa2741 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:28.668825 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a8971e8f-75c8-48c6-9d39-113874fa2741 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:28.675692 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a8971e8f-75c8-48c6-9d39-113874fa2741 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:28.680170 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a8971e8f-75c8-48c6-9d39-113874fa2741 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1582 microversion: 2.32 time: 0.171357 Jun 16 14:51:28.684074 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1317/2557] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:28 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1582 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:28.704112 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a957ffa7-3274-4561-8e43-4f4a4e5e82c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:28.710902 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a957ffa7-3274-4561-8e43-4f4a4e5e82c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:28.729538 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a957ffa7-3274-4561-8e43-4f4a4e5e82c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:28.731233 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a957ffa7-3274-4561-8e43-4f4a4e5e82c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:28.732549 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a957ffa7-3274-4561-8e43-4f4a4e5e82c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:28.734295 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a957ffa7-3274-4561-8e43-4f4a4e5e82c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:28.969932 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a957ffa7-3274-4561-8e43-4f4a4e5e82c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:28.987606 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a957ffa7-3274-4561-8e43-4f4a4e5e82c8 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1272 microversion: 2.1 time: 0.301928 Jun 16 14:51:28.988252 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1318/2558] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:28 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:29.004617 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-94c04b15-cbd1-4021-9ded-bce56714f557 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:29.005039 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-94c04b15-cbd1-4021-9ded-bce56714f557 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:29.064923 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-94c04b15-cbd1-4021-9ded-bce56714f557 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:29.065882 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-94c04b15-cbd1-4021-9ded-bce56714f557 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:29.067991 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-94c04b15-cbd1-4021-9ded-bce56714f557 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:29.083197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-94c04b15-cbd1-4021-9ded-bce56714f557 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:29.258970 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-94c04b15-cbd1-4021-9ded-bce56714f557 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:29.279770 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-94c04b15-cbd1-4021-9ded-bce56714f557 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:29.283393 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-94c04b15-cbd1-4021-9ded-bce56714f557 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:29.294202 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-94c04b15-cbd1-4021-9ded-bce56714f557 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1438 microversion: 2.75 time: 0.303904 Jun 16 14:51:29.295917 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1319/2559] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:28 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1438 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:29.305197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-423c859a-e54c-48ac-9f89-a7ca9adb9794 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf0c0d6f70>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:29.460867 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-423c859a-e54c-48ac-9f89-a7ca9adb9794 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.162770 Jun 16 14:51:29.471421 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1320/2560] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:29 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:29.969888 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:29.975505 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:29.994034 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:29.994876 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:29.996307 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:29.997073 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:30.304799 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:30.324931 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:51:30.325670 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:51:30.333500 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:51:30.335733 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:51:30.336557 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:51:30.531560 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:30.557048 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:30.560192 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:30.561421 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:30.563538 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:30.880852 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:51:30.997866 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d80dc97a-4e18-4a49-a069-7edece5eb40b tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "POST /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb/action" status: 202 len: 1942 microversion: 2.75 time: 1.524807 Jun 16 14:51:31.007106 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1321/2561] 10.222.0.57 () {62 vars in 1318 bytes} [Thu Jun 16 14:51:29 2022] POST /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb/action => generated 1942 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 16 14:51:31.016911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-10e9e8b4-ff3e-42c0-b99b-3698c0c64f8a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:31.018265 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-10e9e8b4-ff3e-42c0-b99b-3698c0c64f8a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:31.039922 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10e9e8b4-ff3e-42c0-b99b-3698c0c64f8a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:31.041190 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10e9e8b4-ff3e-42c0-b99b-3698c0c64f8a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:31.043361 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10e9e8b4-ff3e-42c0-b99b-3698c0c64f8a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:31.043755 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-10e9e8b4-ff3e-42c0-b99b-3698c0c64f8a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:31.580222 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-10e9e8b4-ff3e-42c0-b99b-3698c0c64f8a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:31.646243 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-10e9e8b4-ff3e-42c0-b99b-3698c0c64f8a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:31.657834 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-10e9e8b4-ff3e-42c0-b99b-3698c0c64f8a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:31.661103 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-10e9e8b4-ff3e-42c0-b99b-3698c0c64f8a tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1558 microversion: 2.21 time: 0.650908 Jun 16 14:51:31.665801 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1322/2562] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:31 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1558 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:31.685923 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ceb418ff-13f9-42b0-95e9-76204ffa2baa tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:31.687309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ceb418ff-13f9-42b0-95e9-76204ffa2baa tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:31.717689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ceb418ff-13f9-42b0-95e9-76204ffa2baa tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:31.718503 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ceb418ff-13f9-42b0-95e9-76204ffa2baa tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:31.720585 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ceb418ff-13f9-42b0-95e9-76204ffa2baa tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:31.720854 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ceb418ff-13f9-42b0-95e9-76204ffa2baa tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:31.831229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:31.855093 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=6 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:31.930123 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ceb418ff-13f9-42b0-95e9-76204ffa2baa tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:31.946305 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ceb418ff-13f9-42b0-95e9-76204ffa2baa tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:31.949190 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ceb418ff-13f9-42b0-95e9-76204ffa2baa tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:31.950574 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ceb418ff-13f9-42b0-95e9-76204ffa2baa tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1592 microversion: 2.32 time: 0.279444 Jun 16 14:51:31.970423 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1323/2563] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:31 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1592 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:31.970423 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-295000f1-df19-426b-8f23-cc5bde57065a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:31.970423 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-295000f1-df19-426b-8f23-cc5bde57065a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:31.992518 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-295000f1-df19-426b-8f23-cc5bde57065a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:31.993447 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-295000f1-df19-426b-8f23-cc5bde57065a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:31.998262 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-295000f1-df19-426b-8f23-cc5bde57065a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:31.998765 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-295000f1-df19-426b-8f23-cc5bde57065a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:32.112836 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-48e5d573-b9ee-4166-b640-e262d0f6b7d7 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/286e120c-4a5e-4cfb-bde2-070ce66788a4" status: 202 len: 0 microversion: 2.1 time: 5.631916 Jun 16 14:51:32.117173 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1241/2564] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jun 16 14:51:26 2022] DELETE /compute/v2.1/os-floating-ips/286e120c-4a5e-4cfb-bde2-070ce66788a4 => generated 0 bytes in 5637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:51:32.126530 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8f38fca2-c569-4f41-a879-63087a9cb92f tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf0c060670>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:32.192931 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-295000f1-df19-426b-8f23-cc5bde57065a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:32.210309 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-295000f1-df19-426b-8f23-cc5bde57065a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1272 microversion: 2.1 time: 0.254898 Jun 16 14:51:32.223141 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1324/2565] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:31 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:32.231766 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-6f4e9636-e8a1-490a-b8b5-b5f623dc00b6 req-504887ba-d898-45a8-958b-75a2eb36e96d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d41f1557-357b-4a04-9556-a542c790ad08", "name": "network-vif-unplugged", "status": "completed", "tag": "8284b8a1-5b84-445d-8a6f-ed3c56cc1772"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:32.254522 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-6f4e9636-e8a1-490a-b8b5-b5f623dc00b6 req-504887ba-d898-45a8-958b-75a2eb36e96d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:32.255259 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-6f4e9636-e8a1-490a-b8b5-b5f623dc00b6 req-504887ba-d898-45a8-958b-75a2eb36e96d service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:32.255757 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8f38fca2-c569-4f41-a879-63087a9cb92f tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.136025 Jun 16 14:51:32.256246 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1242/2566] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:32 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:32.292457 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f8fda1ca-1f00-4ee4-93ee-bb73174972bf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:32.297222 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f8fda1ca-1f00-4ee4-93ee-bb73174972bf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:32.306532 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-6f4e9636-e8a1-490a-b8b5-b5f623dc00b6 req-504887ba-d898-45a8-958b-75a2eb36e96d service nova] Creating event network-vif-unplugged:8284b8a1-5b84-445d-8a6f-ed3c56cc1772 for instance d41f1557-357b-4a04-9556-a542c790ad08 on n-h1-836830-4 Jun 16 14:51:32.317929 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-6f4e9636-e8a1-490a-b8b5-b5f623dc00b6 req-504887ba-d898-45a8-958b-75a2eb36e96d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102944 Jun 16 14:51:32.319301 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f8fda1ca-1f00-4ee4-93ee-bb73174972bf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:32.319771 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f8fda1ca-1f00-4ee4-93ee-bb73174972bf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:32.320899 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f8fda1ca-1f00-4ee4-93ee-bb73174972bf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:32.321348 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f8fda1ca-1f00-4ee4-93ee-bb73174972bf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:32.321561 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1325/2567] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:32.335889 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b1fa5d05-1c4c-43c8-9718-c3143697b550 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] Calling method '.version_select at 0x7fdf0c0ecd30>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:32.530650 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:32.560857 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:32.790303 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-f8fda1ca-1f00-4ee4-93ee-bb73174972bf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:51:32.845435 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f8fda1ca-1f00-4ee4-93ee-bb73174972bf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1929 microversion: 2.75 time: 0.576425 Jun 16 14:51:32.847258 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1243/2568] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:32 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1929 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:32.859616 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-996ef3c0-b8de-4e5d-a450-7a7b1667e0e1 req-b274486c-acb1-44c8-bbec-06e59b4139d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d41f1557-357b-4a04-9556-a542c790ad08", "name": "network-vif-deleted", "tag": "8284b8a1-5b84-445d-8a6f-ed3c56cc1772"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:32.901451 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-996ef3c0-b8de-4e5d-a450-7a7b1667e0e1 req-b274486c-acb1-44c8-bbec-06e59b4139d7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:32.902447 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-996ef3c0-b8de-4e5d-a450-7a7b1667e0e1 req-b274486c-acb1-44c8-bbec-06e59b4139d7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:32.919547 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-996ef3c0-b8de-4e5d-a450-7a7b1667e0e1 req-b274486c-acb1-44c8-bbec-06e59b4139d7 service nova] Creating event network-vif-deleted:8284b8a1-5b84-445d-8a6f-ed3c56cc1772 for instance d41f1557-357b-4a04-9556-a542c790ad08 on n-h1-836830-4 Jun 16 14:51:32.928293 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-996ef3c0-b8de-4e5d-a450-7a7b1667e0e1 req-b274486c-acb1-44c8-bbec-06e59b4139d7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078412 Jun 16 14:51:32.929720 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1244/2569] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:32.937742 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fdbd1e33-4b8c-4ac9-86d2-749140b0a811 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:32.938974 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fdbd1e33-4b8c-4ac9-86d2-749140b0a811 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:32.955721 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fdbd1e33-4b8c-4ac9-86d2-749140b0a811 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:32.957078 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fdbd1e33-4b8c-4ac9-86d2-749140b0a811 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:32.960602 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fdbd1e33-4b8c-4ac9-86d2-749140b0a811 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:32.962805 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fdbd1e33-4b8c-4ac9-86d2-749140b0a811 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:33.089769 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fdbd1e33-4b8c-4ac9-86d2-749140b0a811 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:33.091364 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fdbd1e33-4b8c-4ac9-86d2-749140b0a811 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:33.097334 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-fdbd1e33-4b8c-4ac9-86d2-749140b0a811 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lazy-loading 'fault' on Instance uuid d41f1557-357b-4a04-9556-a542c790ad08 {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:51:33.544329 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fdbd1e33-4b8c-4ac9-86d2-749140b0a811 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:33.558926 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fdbd1e33-4b8c-4ac9-86d2-749140b0a811 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:33.560663 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fdbd1e33-4b8c-4ac9-86d2-749140b0a811 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f332f90c6f2849de9e5ac429ca645af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bbff7d18ca64e21844b98e9de63e354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:33.562560 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fdbd1e33-4b8c-4ac9-86d2-749140b0a811 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 200 len: 1349 microversion: 2.21 time: 0.630465 Jun 16 14:51:33.563168 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1245/2570] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:32 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 1349 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:33.569584 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2805221c-4963-40a5-ac30-1b816a33be01 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:33.570238 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2805221c-4963-40a5-ac30-1b816a33be01 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:33.588657 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2805221c-4963-40a5-ac30-1b816a33be01 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:33.589627 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2805221c-4963-40a5-ac30-1b816a33be01 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:33.590501 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2805221c-4963-40a5-ac30-1b816a33be01 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:33.591603 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2805221c-4963-40a5-ac30-1b816a33be01 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:33.824074 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2805221c-4963-40a5-ac30-1b816a33be01 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:33.865477 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2805221c-4963-40a5-ac30-1b816a33be01 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:33.877564 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2805221c-4963-40a5-ac30-1b816a33be01 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:33.880342 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2805221c-4963-40a5-ac30-1b816a33be01 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1592 microversion: 2.32 time: 0.315761 Jun 16 14:51:33.885204 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1246/2571] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:33 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1592 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:33.895076 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b6e5b9f9-dbb0-436b-8682-9f73e922d59f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:33.908015 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b6e5b9f9-dbb0-436b-8682-9f73e922d59f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:33.927762 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b6e5b9f9-dbb0-436b-8682-9f73e922d59f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:33.931502 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b6e5b9f9-dbb0-436b-8682-9f73e922d59f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:33.936182 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b6e5b9f9-dbb0-436b-8682-9f73e922d59f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:33.937281 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b6e5b9f9-dbb0-436b-8682-9f73e922d59f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:33.969401 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=8 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:34.151018 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b6e5b9f9-dbb0-436b-8682-9f73e922d59f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:34.174015 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b6e5b9f9-dbb0-436b-8682-9f73e922d59f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1272 microversion: 2.1 time: 0.286166 Jun 16 14:51:34.181367 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1247/2572] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:33 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1272 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:34.204550 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-551f80bf-936d-4fa2-8c09-3e27d857013d tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf0c38e8b0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:34.219902 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b1fa5d05-1c4c-43c8-9718-c3143697b550 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/a560f2ba-0976-4165-9ee0-4187df13ee0c" status: 202 len: 0 microversion: 2.1 time: 1.896289 Jun 16 14:51:34.225134 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1326/2573] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jun 16 14:51:32 2022] DELETE /compute/v2.1/os-floating-ips/a560f2ba-0976-4165-9ee0-4187df13ee0c => generated 0 bytes in 1898 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:51:34.227141 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-37de63d5-ae18-45cc-886d-10a7b0a638b3 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:34.228086 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-37de63d5-ae18-45cc-886d-10a7b0a638b3 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:34.256317 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-37de63d5-ae18-45cc-886d-10a7b0a638b3 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:34.258107 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-37de63d5-ae18-45cc-886d-10a7b0a638b3 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:34.261678 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-37de63d5-ae18-45cc-886d-10a7b0a638b3 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:34.262497 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-37de63d5-ae18-45cc-886d-10a7b0a638b3 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:34.313506 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-551f80bf-936d-4fa2-8c09-3e27d857013d tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.130181 Jun 16 14:51:34.314484 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1248/2574] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:34 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:34.327217 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4bd7f226-aad0-45ff-a60a-ad2e596eb986 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] Calling method '.version_select at 0x7fdeff371ee0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:34.423030 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-37de63d5-ae18-45cc-886d-10a7b0a638b3 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:51:34.457695 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-37de63d5-ae18-45cc-886d-10a7b0a638b3 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1929 microversion: 2.75 time: 0.235177 Jun 16 14:51:34.459032 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1327/2575] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:34 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1929 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:34.602420 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c663ddb5-e5ef-4d73-ba24-9a7f4b232094 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:34.603439 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c663ddb5-e5ef-4d73-ba24-9a7f4b232094 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:34.620217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c663ddb5-e5ef-4d73-ba24-9a7f4b232094 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:34.624219 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c663ddb5-e5ef-4d73-ba24-9a7f4b232094 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:34.627375 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c663ddb5-e5ef-4d73-ba24-9a7f4b232094 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:34.628136 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c663ddb5-e5ef-4d73-ba24-9a7f4b232094 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:34.648437 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-c663ddb5-e5ef-4d73-ba24-9a7f4b232094 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] HTTP exception thrown: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c663ddb5-e5ef-4d73-ba24-9a7f4b232094 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Request method failure captured: Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 HTTP/1.1 Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0NEPSzJ07lL4_2JOXkIjyI3tklXLLqj1Cw0GcGgtM5Uac-dTTxx1YxN9DYS7zIb0nUn_o1nrXC9q_tCc8X3y3RLPKzFdLtB-siAA4twXb5WYFQ_8VZE2bFT61GHkYGcqP4qdEeyVcsIRdFYVJkRm0iuld9kqW1HQUgQHsXhQpxyOG0 Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Openstack-Nova-Api-Version: 2.21 Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 2bbff7d18ca64e21844b98e9de63e354 Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1305787442 Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2bbff7d18ca64e21844b98e9de63e354", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2bbff7d18ca64e21844b98e9de63e354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2bbff7d18ca64e21844b98e9de63e354"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2bbff7d18ca64e21844b98e9de63e354"}]}] Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-InstanceActionsV221TestJSON-1305787442 Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 2bbff7d18ca64e21844b98e9de63e354 Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1305787442 Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-InstanceActionsV221TestJSON-1305787442-project Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: f332f90c6f2849de9e5ac429ca645af5 Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-InstanceActionsV221TestJSON-1305787442-project Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'd41f1557-357b-4a04-9556-a542c790ad08'} Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:51:34.650341 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:51:34.655205 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:51:34.655205 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:34.655205 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:51:34.655205 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:51:34.655205 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:51:34.655205 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:51:34.655205 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. Jun 16 14:51:34.655205 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:51:34.656292 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c663ddb5-e5ef-4d73-ba24-9a7f4b232094 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Returning 404 to user: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:51:34.657341 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c663ddb5-e5ef-4d73-ba24-9a7f4b232094 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 404 len: 111 microversion: 2.21 time: 0.061990 Jun 16 14:51:34.661817 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1328/2576] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:34 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:51:34.670117 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c243cae1-d97b-43e2-b529-a0af9751fb24 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '.version_select at 0x7fdf0c4bbd30>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:34.671378 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c243cae1-d97b-43e2-b529-a0af9751fb24 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:34.684228 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c243cae1-d97b-43e2-b529-a0af9751fb24 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:34.684722 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c243cae1-d97b-43e2-b529-a0af9751fb24 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:34.688077 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c243cae1-d97b-43e2-b529-a0af9751fb24 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:34.688077 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c243cae1-d97b-43e2-b529-a0af9751fb24 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:34.939450 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c243cae1-d97b-43e2-b529-a0af9751fb24 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.274614 Jun 16 14:51:34.940421 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1329/2577] 10.222.0.57 () {60 vars in 1336 bytes} [Thu Jun 16 14:51:34 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08/os-instance-actions => generated 611 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:51:34.971862 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-515481dc-34aa-4a2f-94b2-666bea7f2ea2 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:34.974211 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-515481dc-34aa-4a2f-94b2-666bea7f2ea2 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:35.015049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-515481dc-34aa-4a2f-94b2-666bea7f2ea2 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:35.015867 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-515481dc-34aa-4a2f-94b2-666bea7f2ea2 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:35.017332 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-515481dc-34aa-4a2f-94b2-666bea7f2ea2 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:35.018041 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-515481dc-34aa-4a2f-94b2-666bea7f2ea2 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:35.107273 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:35.228186 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-515481dc-34aa-4a2f-94b2-666bea7f2ea2 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:35.241345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-515481dc-34aa-4a2f-94b2-666bea7f2ea2 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:35.243752 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-515481dc-34aa-4a2f-94b2-666bea7f2ea2 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:35.245078 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-515481dc-34aa-4a2f-94b2-666bea7f2ea2 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1592 microversion: 2.32 time: 0.301352 Jun 16 14:51:35.246226 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1330/2578] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:34 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1592 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:35.258871 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d7af9cd6-7ad8-4eb1-87ba-fcafed1b590e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:35.259682 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d7af9cd6-7ad8-4eb1-87ba-fcafed1b590e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:35.267701 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d7af9cd6-7ad8-4eb1-87ba-fcafed1b590e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:35.269234 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d7af9cd6-7ad8-4eb1-87ba-fcafed1b590e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:35.270555 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d7af9cd6-7ad8-4eb1-87ba-fcafed1b590e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:35.271074 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d7af9cd6-7ad8-4eb1-87ba-fcafed1b590e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:35.296456 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-d7af9cd6-7ad8-4eb1-87ba-fcafed1b590e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] HTTP exception thrown: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d7af9cd6-7ad8-4eb1-87ba-fcafed1b590e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Request method failure captured: Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 HTTP/1.1 Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0NEPSzJ07lL4_2JOXkIjyI3tklXLLqj1Cw0GcGgtM5Uac-dTTxx1YxN9DYS7zIb0nUn_o1nrXC9q_tCc8X3y3RLPKzFdLtB-siAA4twXb5WYFQ_8VZE2bFT61GHkYGcqP4qdEeyVcsIRdFYVJkRm0iuld9kqW1HQUgQHsXhQpxyOG0 Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Openstack-Nova-Api-Version: 2.21 Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 2bbff7d18ca64e21844b98e9de63e354 Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1305787442 Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2bbff7d18ca64e21844b98e9de63e354", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2bbff7d18ca64e21844b98e9de63e354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2bbff7d18ca64e21844b98e9de63e354"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2bbff7d18ca64e21844b98e9de63e354"}]}] Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-InstanceActionsV221TestJSON-1305787442 Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 2bbff7d18ca64e21844b98e9de63e354 Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1305787442 Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-InstanceActionsV221TestJSON-1305787442-project Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: f332f90c6f2849de9e5ac429ca645af5 Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-InstanceActionsV221TestJSON-1305787442-project Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'd41f1557-357b-4a04-9556-a542c790ad08'} Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:51:35.298087 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d7af9cd6-7ad8-4eb1-87ba-fcafed1b590e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Returning 404 to user: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d7af9cd6-7ad8-4eb1-87ba-fcafed1b590e tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 404 len: 111 microversion: 2.21 time: 0.052470 Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1331/2579] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 16 14:51:35 2022] DELETE /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-12888dba-13a9-4a31-859b-5f4e126cba0a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:35.312265 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-12888dba-13a9-4a31-859b-5f4e126cba0a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:35.318047 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-12888dba-13a9-4a31-859b-5f4e126cba0a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:35.319943 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-12888dba-13a9-4a31-859b-5f4e126cba0a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:35.319943 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-12888dba-13a9-4a31-859b-5f4e126cba0a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:35.323081 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-12888dba-13a9-4a31-859b-5f4e126cba0a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:35.759138 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-12888dba-13a9-4a31-859b-5f4e126cba0a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:35.770166 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-12888dba-13a9-4a31-859b-5f4e126cba0a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1314 microversion: 2.1 time: 0.465357 Jun 16 14:51:35.781487 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1332/2580] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:35 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:35.793650 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0580b4cd-de0f-44d7-b592-585786db4398 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:35.799214 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0580b4cd-de0f-44d7-b592-585786db4398 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] [instance: d41f1557-357b-4a04-9556-a542c790ad08] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:35.830598 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0580b4cd-de0f-44d7-b592-585786db4398 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:35.833614 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0580b4cd-de0f-44d7-b592-585786db4398 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:35.841495 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0580b4cd-de0f-44d7-b592-585786db4398 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:35.843568 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0580b4cd-de0f-44d7-b592-585786db4398 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:35.901332 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-0580b4cd-de0f-44d7-b592-585786db4398 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] HTTP exception thrown: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0580b4cd-de0f-44d7-b592-585786db4398 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Request method failure captured: Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 HTTP/1.1 Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0NEPSzJ07lL4_2JOXkIjyI3tklXLLqj1Cw0GcGgtM5Uac-dTTxx1YxN9DYS7zIb0nUn_o1nrXC9q_tCc8X3y3RLPKzFdLtB-siAA4twXb5WYFQ_8VZE2bFT61GHkYGcqP4qdEeyVcsIRdFYVJkRm0iuld9kqW1HQUgQHsXhQpxyOG0 Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Openstack-Nova-Api-Version: 2.21 Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 2bbff7d18ca64e21844b98e9de63e354 Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1305787442 Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2bbff7d18ca64e21844b98e9de63e354", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2bbff7d18ca64e21844b98e9de63e354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2bbff7d18ca64e21844b98e9de63e354"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2bbff7d18ca64e21844b98e9de63e354"}]}] Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-InstanceActionsV221TestJSON-1305787442 Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 2bbff7d18ca64e21844b98e9de63e354 Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1305787442 Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-InstanceActionsV221TestJSON-1305787442-project Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: f332f90c6f2849de9e5ac429ca645af5 Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-InstanceActionsV221TestJSON-1305787442-project Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'd41f1557-357b-4a04-9556-a542c790ad08'} Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:51:35.903419 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:51:35.918268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:51:35.918268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:51:35.918268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:51:35.918268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:51:35.918268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:51:35.918268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:51:35.918268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. Jun 16 14:51:35.918268 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:51:35.918268 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0580b4cd-de0f-44d7-b592-585786db4398 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] Returning 404 to user: Instance d41f1557-357b-4a04-9556-a542c790ad08 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:51:35.918268 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0580b4cd-de0f-44d7-b592-585786db4398 tempest-InstanceActionsV221TestJSON-1305787442 tempest-InstanceActionsV221TestJSON-1305787442-project] 10.222.0.57 "GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08" status: 404 len: 111 microversion: 2.21 time: 0.124566 Jun 16 14:51:35.918268 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1333/2581] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:35 2022] GET /compute/v2.1/servers/d41f1557-357b-4a04-9556-a542c790ad08 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:51:35.947941 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-029992ff-cf4e-4344-9e58-d03ad47a28dc tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf0c0ec9d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:36.068120 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-029992ff-cf4e-4344-9e58-d03ad47a28dc tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.151988 Jun 16 14:51:36.074109 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1334/2582] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:35 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:36.084533 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-63658504-1d45-44d2-98c1-9dc6f08b1b6e tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:36.085184 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-63658504-1d45-44d2-98c1-9dc6f08b1b6e tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:36.111704 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-63658504-1d45-44d2-98c1-9dc6f08b1b6e tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:36.112089 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-63658504-1d45-44d2-98c1-9dc6f08b1b6e tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:36.112960 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-63658504-1d45-44d2-98c1-9dc6f08b1b6e tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:36.113457 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-63658504-1d45-44d2-98c1-9dc6f08b1b6e tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:37.895322 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-63658504-1d45-44d2-98c1-9dc6f08b1b6e tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:51:37.965987 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-63658504-1d45-44d2-98c1-9dc6f08b1b6e tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1929 microversion: 2.75 time: 1.894600 Jun 16 14:51:37.973151 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1335/2583] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:36 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1929 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:37.985720 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-01e6aa00-acec-4a73-aad4-be37f79888c1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:37.989465 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-01e6aa00-acec-4a73-aad4-be37f79888c1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:38.004036 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01e6aa00-acec-4a73-aad4-be37f79888c1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:38.005453 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01e6aa00-acec-4a73-aad4-be37f79888c1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:38.010125 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01e6aa00-acec-4a73-aad4-be37f79888c1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:38.011508 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01e6aa00-acec-4a73-aad4-be37f79888c1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:39.012624 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-01e6aa00-acec-4a73-aad4-be37f79888c1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:39.025188 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-01e6aa00-acec-4a73-aad4-be37f79888c1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:39.035934 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-01e6aa00-acec-4a73-aad4-be37f79888c1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:39.039475 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-01e6aa00-acec-4a73-aad4-be37f79888c1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1660 microversion: 2.32 time: 1.061526 Jun 16 14:51:39.049504 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1336/2584] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:37 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1660 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:39.063998 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-50ce6957-e43d-4329-a55d-8c05c7bac361 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:39.063998 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-50ce6957-e43d-4329-a55d-8c05c7bac361 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:39.086674 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50ce6957-e43d-4329-a55d-8c05c7bac361 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:39.087518 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50ce6957-e43d-4329-a55d-8c05c7bac361 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:39.097092 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50ce6957-e43d-4329-a55d-8c05c7bac361 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:39.098358 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-50ce6957-e43d-4329-a55d-8c05c7bac361 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:39.502972 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-50ce6957-e43d-4329-a55d-8c05c7bac361 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:39.515221 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-50ce6957-e43d-4329-a55d-8c05c7bac361 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1314 microversion: 2.1 time: 0.463731 Jun 16 14:51:39.516190 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1337/2585] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:39 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:39.528938 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d333a253-2666-4a1c-886a-2801c8d7cff8 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf0c6e3ca0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:39.625234 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d333a253-2666-4a1c-886a-2801c8d7cff8 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.107743 Jun 16 14:51:39.627961 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1338/2586] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:39 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:39.639623 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cd6e85fc-0ef5-46d5-b020-43f1dd978dda tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:39.647957 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cd6e85fc-0ef5-46d5-b020-43f1dd978dda tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:39.666684 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd6e85fc-0ef5-46d5-b020-43f1dd978dda tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:39.667627 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd6e85fc-0ef5-46d5-b020-43f1dd978dda tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:39.668701 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd6e85fc-0ef5-46d5-b020-43f1dd978dda tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:39.670493 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd6e85fc-0ef5-46d5-b020-43f1dd978dda tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:40.414512 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-cd6e85fc-0ef5-46d5-b020-43f1dd978dda tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:51:40.476933 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cd6e85fc-0ef5-46d5-b020-43f1dd978dda tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1929 microversion: 2.75 time: 0.842612 Jun 16 14:51:40.484322 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1339/2587] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:39 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1929 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:40.499856 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ce829465-edc2-4ddd-98e1-9f62e022168b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:40.500829 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ce829465-edc2-4ddd-98e1-9f62e022168b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:40.519584 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ce829465-edc2-4ddd-98e1-9f62e022168b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:40.521856 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ce829465-edc2-4ddd-98e1-9f62e022168b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:40.523699 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ce829465-edc2-4ddd-98e1-9f62e022168b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:40.526283 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ce829465-edc2-4ddd-98e1-9f62e022168b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:40.917398 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4bd7f226-aad0-45ff-a60a-ad2e596eb986 tempest-FloatingIPDetailsTestJSON-433257531 tempest-FloatingIPDetailsTestJSON-433257531-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/acc12235-1289-41c3-9cc8-796f29b6dd8f" status: 202 len: 0 microversion: 2.1 time: 6.601516 Jun 16 14:51:40.918277 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1249/2588] 10.222.0.57 () {58 vars in 1262 bytes} [Thu Jun 16 14:51:34 2022] DELETE /compute/v2.1/os-floating-ips/acc12235-1289-41c3-9cc8-796f29b6dd8f => generated 0 bytes in 6603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:51:40.927598 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-ef9d0949-1508-4b76-90aa-e5a02b0af2f4 req-f144be79-7fdd-46d7-9e9f-c6996ab92d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c6aba7d-22a7-4711-89b6-bee152b1ac6b", "tag": "629943a5-6275-4c33-83f7-75df70f84598"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:40.968356 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-ef9d0949-1508-4b76-90aa-e5a02b0af2f4 req-f144be79-7fdd-46d7-9e9f-c6996ab92d8c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:40.968817 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-ef9d0949-1508-4b76-90aa-e5a02b0af2f4 req-f144be79-7fdd-46d7-9e9f-c6996ab92d8c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:41.029138 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-ef9d0949-1508-4b76-90aa-e5a02b0af2f4 req-f144be79-7fdd-46d7-9e9f-c6996ab92d8c service nova] Creating event network-changed:629943a5-6275-4c33-83f7-75df70f84598 for instance 8c6aba7d-22a7-4711-89b6-bee152b1ac6b on n-h1-836830-4 Jun 16 14:51:41.049159 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-ef9d0949-1508-4b76-90aa-e5a02b0af2f4 req-f144be79-7fdd-46d7-9e9f-c6996ab92d8c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123319 Jun 16 14:51:41.052087 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1250/2589] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:41.075113 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-79ace31a-8e34-4d47-a81f-3190c3a0e61b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:41.083243 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-79ace31a-8e34-4d47-a81f-3190c3a0e61b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:41.136204 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-79ace31a-8e34-4d47-a81f-3190c3a0e61b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:41.138815 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-79ace31a-8e34-4d47-a81f-3190c3a0e61b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:41.145544 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-79ace31a-8e34-4d47-a81f-3190c3a0e61b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:41.154809 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-79ace31a-8e34-4d47-a81f-3190c3a0e61b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:42.560225 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ce829465-edc2-4ddd-98e1-9f62e022168b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:42.611100 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ce829465-edc2-4ddd-98e1-9f62e022168b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:42.632068 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ce829465-edc2-4ddd-98e1-9f62e022168b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:42.642692 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ce829465-edc2-4ddd-98e1-9f62e022168b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1660 microversion: 2.32 time: 2.156467 Jun 16 14:51:42.662971 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1340/2590] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:40 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1660 bytes in 2177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:42.693667 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ff382282-213c-4983-bb23-3efbfdf8da65 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf0c0ec0d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:42.871073 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ff382282-213c-4983-bb23-3efbfdf8da65 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.205720 Jun 16 14:51:42.871730 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1341/2591] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:42 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:42.904984 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cd7e1a27-923c-45a0-acd0-ae2c72811ed5 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:42.905993 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cd7e1a27-923c-45a0-acd0-ae2c72811ed5 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:42.953240 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd7e1a27-923c-45a0-acd0-ae2c72811ed5 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:42.954049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd7e1a27-923c-45a0-acd0-ae2c72811ed5 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:42.955611 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd7e1a27-923c-45a0-acd0-ae2c72811ed5 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:42.973580 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cd7e1a27-923c-45a0-acd0-ae2c72811ed5 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:43.320971 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-cd7e1a27-923c-45a0-acd0-ae2c72811ed5 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:51:43.399153 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cd7e1a27-923c-45a0-acd0-ae2c72811ed5 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1929 microversion: 2.75 time: 0.507893 Jun 16 14:51:43.400356 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1342/2592] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:42 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1929 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:43.681600 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-61ddc0c0-334d-437f-9cc0-d6ace47d8046 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:43.683146 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-61ddc0c0-334d-437f-9cc0-d6ace47d8046 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:43.696954 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-61ddc0c0-334d-437f-9cc0-d6ace47d8046 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:43.697717 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-61ddc0c0-334d-437f-9cc0-d6ace47d8046 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:43.698923 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-61ddc0c0-334d-437f-9cc0-d6ace47d8046 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:43.699615 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-61ddc0c0-334d-437f-9cc0-d6ace47d8046 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:44.063743 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-79ace31a-8e34-4d47-a81f-3190c3a0e61b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:44.102060 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-79ace31a-8e34-4d47-a81f-3190c3a0e61b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1314 microversion: 2.1 time: 3.045850 Jun 16 14:51:44.132343 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1251/2593] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:41 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1314 bytes in 3077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:44.162000 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-624dc2c4-34d4-4e5a-8341-31431b1cd873 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeff24f3a0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:44.379312 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-624dc2c4-34d4-4e5a-8341-31431b1cd873 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.244878 Jun 16 14:51:44.380361 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1252/2594] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:44 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:44.444635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d7e91b24-1467-46b1-8d21-5d2e0859ddad tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:44.447089 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d7e91b24-1467-46b1-8d21-5d2e0859ddad tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:44.485194 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d7e91b24-1467-46b1-8d21-5d2e0859ddad tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:44.486337 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d7e91b24-1467-46b1-8d21-5d2e0859ddad tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:44.488520 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d7e91b24-1467-46b1-8d21-5d2e0859ddad tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:44.489428 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d7e91b24-1467-46b1-8d21-5d2e0859ddad tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:44.912172 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-d7e91b24-1467-46b1-8d21-5d2e0859ddad tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:51:44.986855 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d7e91b24-1467-46b1-8d21-5d2e0859ddad tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1929 microversion: 2.75 time: 0.550080 Jun 16 14:51:45.002794 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1253/2595] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:44 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1929 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:45.131181 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-61ddc0c0-334d-437f-9cc0-d6ace47d8046 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:45.192647 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4d3d044c-8f63-4c22-8986-51ba9cdf3fcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:45.199603 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4d3d044c-8f63-4c22-8986-51ba9cdf3fcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:45.265981 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d3d044c-8f63-4c22-8986-51ba9cdf3fcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:45.272415 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-61ddc0c0-334d-437f-9cc0-d6ace47d8046 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:45.274864 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d3d044c-8f63-4c22-8986-51ba9cdf3fcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:45.279435 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d3d044c-8f63-4c22-8986-51ba9cdf3fcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:45.282983 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-61ddc0c0-334d-437f-9cc0-d6ace47d8046 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:45.285300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4d3d044c-8f63-4c22-8986-51ba9cdf3fcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:45.292900 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-61ddc0c0-334d-437f-9cc0-d6ace47d8046 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1707 microversion: 2.32 time: 1.614759 Jun 16 14:51:45.306878 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1343/2596] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:43 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1707 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:51:45.412022 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-43824dad-261d-4b04-b311-941a1d1a6487 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffe629d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:45.624314 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-43824dad-261d-4b04-b311-941a1d1a6487 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.227653 Jun 16 14:51:45.625352 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1344/2597] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:45 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:46.012103 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c1fabc16-c330-44f9-974d-0d82c0294dd7 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:46.012624 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c1fabc16-c330-44f9-974d-0d82c0294dd7 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:46.020920 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c1fabc16-c330-44f9-974d-0d82c0294dd7 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:46.021385 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c1fabc16-c330-44f9-974d-0d82c0294dd7 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:46.022202 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c1fabc16-c330-44f9-974d-0d82c0294dd7 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:46.034948 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c1fabc16-c330-44f9-974d-0d82c0294dd7 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:46.035886 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4d3d044c-8f63-4c22-8986-51ba9cdf3fcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:46.047503 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4d3d044c-8f63-4c22-8986-51ba9cdf3fcf tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1314 microversion: 2.1 time: 0.898000 Jun 16 14:51:46.057044 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1254/2598] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:45 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1314 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:46.340639 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d938efa5-2933-4193-bf2f-4ecf3f81f15d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:46.341763 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-d938efa5-2933-4193-bf2f-4ecf3f81f15d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:46.367316 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d938efa5-2933-4193-bf2f-4ecf3f81f15d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:46.368872 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d938efa5-2933-4193-bf2f-4ecf3f81f15d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:46.370022 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d938efa5-2933-4193-bf2f-4ecf3f81f15d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:46.370527 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-d938efa5-2933-4193-bf2f-4ecf3f81f15d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:46.591857 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-c1fabc16-c330-44f9-974d-0d82c0294dd7 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:51:46.638704 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c1fabc16-c330-44f9-974d-0d82c0294dd7 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1929 microversion: 2.75 time: 0.631437 Jun 16 14:51:46.639967 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1345/2599] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:46 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1929 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:46.654872 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-50a31b55-22ee-482d-9728-541469fb5e92 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf0c0ece50>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:46.791737 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-50a31b55-22ee-482d-9728-541469fb5e92 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.150182 Jun 16 14:51:46.793777 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1346/2600] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:46 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:47.096085 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-440594d9-19be-4add-bc23-8c032094947f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:47.096790 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-440594d9-19be-4add-bc23-8c032094947f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:47.114345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-440594d9-19be-4add-bc23-8c032094947f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:47.114869 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-440594d9-19be-4add-bc23-8c032094947f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:47.117049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-440594d9-19be-4add-bc23-8c032094947f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:47.117872 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-440594d9-19be-4add-bc23-8c032094947f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:47.350070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d938efa5-2933-4193-bf2f-4ecf3f81f15d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:47.368208 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d938efa5-2933-4193-bf2f-4ecf3f81f15d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:47.371943 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-d938efa5-2933-4193-bf2f-4ecf3f81f15d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:47.377601 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d938efa5-2933-4193-bf2f-4ecf3f81f15d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1707 microversion: 2.32 time: 1.045928 Jun 16 14:51:47.380914 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1255/2601] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:46 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1707 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:47.554425 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-440594d9-19be-4add-bc23-8c032094947f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:47.576601 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-440594d9-19be-4add-bc23-8c032094947f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1314 microversion: 2.1 time: 0.487963 Jun 16 14:51:47.590048 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1347/2602] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:47 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:47.685836 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-28bc3ef9-7f5d-4e74-8b6b-57999ffb2b62 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:47.686790 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-28bc3ef9-7f5d-4e74-8b6b-57999ffb2b62 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:47.705713 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28bc3ef9-7f5d-4e74-8b6b-57999ffb2b62 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:47.707359 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28bc3ef9-7f5d-4e74-8b6b-57999ffb2b62 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:47.722784 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28bc3ef9-7f5d-4e74-8b6b-57999ffb2b62 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:47.744001 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-28bc3ef9-7f5d-4e74-8b6b-57999ffb2b62 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:47.807622 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9bfc4eb7-b745-4407-a90d-60f0d392fdf4 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffe86dc0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:47.881038 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9bfc4eb7-b745-4407-a90d-60f0d392fdf4 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.078400 Jun 16 14:51:47.881900 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1348/2603] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:47 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:51:48.402009 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e5a00de6-e972-4ec6-ae45-5782bbeb9de0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:48.403199 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e5a00de6-e972-4ec6-ae45-5782bbeb9de0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:48.440203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e5a00de6-e972-4ec6-ae45-5782bbeb9de0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:48.441606 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e5a00de6-e972-4ec6-ae45-5782bbeb9de0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:48.443207 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e5a00de6-e972-4ec6-ae45-5782bbeb9de0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:48.452979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e5a00de6-e972-4ec6-ae45-5782bbeb9de0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:48.516886 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-28bc3ef9-7f5d-4e74-8b6b-57999ffb2b62 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:51:48.576802 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-28bc3ef9-7f5d-4e74-8b6b-57999ffb2b62 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1929 microversion: 2.75 time: 0.895432 Jun 16 14:51:48.578013 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1256/2604] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:47 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1929 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:48.599622 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6a9d32c4-961d-45c4-865b-7a976ce9d3fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:48.600752 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6a9d32c4-961d-45c4-865b-7a976ce9d3fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:48.619233 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6a9d32c4-961d-45c4-865b-7a976ce9d3fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:48.620117 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6a9d32c4-961d-45c4-865b-7a976ce9d3fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:48.621194 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6a9d32c4-961d-45c4-865b-7a976ce9d3fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:48.626539 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6a9d32c4-961d-45c4-865b-7a976ce9d3fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:48.911727 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e5a00de6-e972-4ec6-ae45-5782bbeb9de0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:48.990489 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e5a00de6-e972-4ec6-ae45-5782bbeb9de0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:48.995781 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e5a00de6-e972-4ec6-ae45-5782bbeb9de0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:48.997955 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e5a00de6-e972-4ec6-ae45-5782bbeb9de0 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1754 microversion: 2.32 time: 0.601256 Jun 16 14:51:49.001799 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1349/2605] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:48 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1754 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:51:49.010959 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3cd3468c-211b-4189-a7e0-f1f3b46a1643 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf0c0d6430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:49.123262 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3cd3468c-211b-4189-a7e0-f1f3b46a1643 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.116972 Jun 16 14:51:49.125147 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1350/2606] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:49 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:49.652963 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f4d4a7c7-f0fd-42f8-86a8-95edd527bfbf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:49.654080 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f4d4a7c7-f0fd-42f8-86a8-95edd527bfbf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:49.724051 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f4d4a7c7-f0fd-42f8-86a8-95edd527bfbf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:49.726985 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f4d4a7c7-f0fd-42f8-86a8-95edd527bfbf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:49.735094 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f4d4a7c7-f0fd-42f8-86a8-95edd527bfbf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:49.736369 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f4d4a7c7-f0fd-42f8-86a8-95edd527bfbf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:50.010492 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-f4d4a7c7-f0fd-42f8-86a8-95edd527bfbf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:51:50.053053 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6a9d32c4-961d-45c4-865b-7a976ce9d3fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:50.071572 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6a9d32c4-961d-45c4-865b-7a976ce9d3fe tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1314 microversion: 2.1 time: 1.477422 Jun 16 14:51:50.090175 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1257/2607] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:48 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1314 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:51:50.099593 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f490a674-77b9-4e55-8f0d-19244fff79cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:50.118875 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f490a674-77b9-4e55-8f0d-19244fff79cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:50.151504 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f490a674-77b9-4e55-8f0d-19244fff79cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:50.152320 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f490a674-77b9-4e55-8f0d-19244fff79cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:50.156923 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f490a674-77b9-4e55-8f0d-19244fff79cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:50.158223 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f4d4a7c7-f0fd-42f8-86a8-95edd527bfbf tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1929 microversion: 2.75 time: 0.537676 Jun 16 14:51:50.161642 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f490a674-77b9-4e55-8f0d-19244fff79cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:50.162859 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1351/2608] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:49 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1929 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:50.198200 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-718c07e1-8a9e-4c40-86e2-614f1734281c tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf0c2671f0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:50.342215 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-718c07e1-8a9e-4c40-86e2-614f1734281c tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.177239 Jun 16 14:51:50.343247 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1352/2609] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:50 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:51.101695 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2e1ee226-892e-45c0-b2c1-81c33d76ed05 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:51.102774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2e1ee226-892e-45c0-b2c1-81c33d76ed05 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:51.126629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2e1ee226-892e-45c0-b2c1-81c33d76ed05 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:51.127139 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2e1ee226-892e-45c0-b2c1-81c33d76ed05 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:51.128136 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2e1ee226-892e-45c0-b2c1-81c33d76ed05 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:51.128923 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2e1ee226-892e-45c0-b2c1-81c33d76ed05 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:51.653843 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2e1ee226-892e-45c0-b2c1-81c33d76ed05 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:51.669880 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2e1ee226-892e-45c0-b2c1-81c33d76ed05 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1314 microversion: 2.1 time: 0.575393 Jun 16 14:51:51.684008 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1353/2610] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:51 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:51.696292 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4990c547-ed0e-4197-b9d1-51086b48bcbb tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:51.708043 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4990c547-ed0e-4197-b9d1-51086b48bcbb tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:51.747243 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4990c547-ed0e-4197-b9d1-51086b48bcbb tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:51.748124 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4990c547-ed0e-4197-b9d1-51086b48bcbb tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:51.749796 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4990c547-ed0e-4197-b9d1-51086b48bcbb tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:51.751204 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4990c547-ed0e-4197-b9d1-51086b48bcbb tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:52.040219 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:52.086702 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-4990c547-ed0e-4197-b9d1-51086b48bcbb tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:51:52.154518 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4990c547-ed0e-4197-b9d1-51086b48bcbb tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1929 microversion: 2.75 time: 0.468969 Jun 16 14:51:52.155330 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1354/2611] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:51 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1929 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:52.177416 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-228e639e-658e-4349-ae9f-3dfbc7eb61ae req-06c9fde5-1010-4681-be4c-981d9178989c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6aba7d-22a7-4711-89b6-bee152b1ac6b", "name": "network-vif-plugged", "status": "completed", "tag": "629943a5-6275-4c33-83f7-75df70f84598"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:52.193464 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-228e639e-658e-4349-ae9f-3dfbc7eb61ae req-06c9fde5-1010-4681-be4c-981d9178989c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:52.194421 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-228e639e-658e-4349-ae9f-3dfbc7eb61ae req-06c9fde5-1010-4681-be4c-981d9178989c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:52.211993 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-228e639e-658e-4349-ae9f-3dfbc7eb61ae req-06c9fde5-1010-4681-be4c-981d9178989c service nova] Creating event network-vif-plugged:629943a5-6275-4c33-83f7-75df70f84598 for instance 8c6aba7d-22a7-4711-89b6-bee152b1ac6b on n-h1-836830-4 Jun 16 14:51:52.232591 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-228e639e-658e-4349-ae9f-3dfbc7eb61ae req-06c9fde5-1010-4681-be4c-981d9178989c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059960 Jun 16 14:51:52.241621 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1355/2612] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:52.287490 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-393399ac-e453-43f9-99d4-00cfa84b7713 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdefff94430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:52.363820 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f490a674-77b9-4e55-8f0d-19244fff79cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:52.395982 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-393399ac-e453-43f9-99d4-00cfa84b7713 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.145206 Jun 16 14:51:52.398584 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1356/2613] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:52 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:52.406668 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f490a674-77b9-4e55-8f0d-19244fff79cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:52.410434 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f490a674-77b9-4e55-8f0d-19244fff79cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:52.412774 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f490a674-77b9-4e55-8f0d-19244fff79cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1754 microversion: 2.32 time: 2.321151 Jun 16 14:51:52.413830 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1258/2614] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:50 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1754 bytes in 2323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:52.694185 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-151b9685-9ef2-4cad-ab34-a62a0064b221 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:52.695121 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-151b9685-9ef2-4cad-ab34-a62a0064b221 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:52.716147 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-151b9685-9ef2-4cad-ab34-a62a0064b221 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:52.716744 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-151b9685-9ef2-4cad-ab34-a62a0064b221 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:52.717616 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-151b9685-9ef2-4cad-ab34-a62a0064b221 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:52.718076 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-151b9685-9ef2-4cad-ab34-a62a0064b221 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:53.186074 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f50bd689-3a98-46ff-8188-e751d3756ad8 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:53.192224 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f50bd689-3a98-46ff-8188-e751d3756ad8 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:53.198532 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:53.238762 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f50bd689-3a98-46ff-8188-e751d3756ad8 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:53.240200 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f50bd689-3a98-46ff-8188-e751d3756ad8 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:53.249179 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f50bd689-3a98-46ff-8188-e751d3756ad8 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:53.258798 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f50bd689-3a98-46ff-8188-e751d3756ad8 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:53.485347 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-f50bd689-3a98-46ff-8188-e751d3756ad8 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:51:53.564990 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f50bd689-3a98-46ff-8188-e751d3756ad8 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1929 microversion: 2.75 time: 0.391036 Jun 16 14:51:53.579677 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1259/2615] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:53 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1929 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:53.589050 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4f2266ff-cf7a-4b3a-ab8e-651786716234 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeff2d30d0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:53.724063 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4f2266ff-cf7a-4b3a-ab8e-651786716234 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1421 microversion: 2.1 time: 0.141490 Jun 16 14:51:53.725640 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1260/2616] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:53 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1421 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:53.749504 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0ee08f0f-56a1-47d2-bf50-536f01e6c135 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:53.751376 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0ee08f0f-56a1-47d2-bf50-536f01e6c135 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:53.777026 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0ee08f0f-56a1-47d2-bf50-536f01e6c135 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:53.783146 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0ee08f0f-56a1-47d2-bf50-536f01e6c135 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:53.785839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0ee08f0f-56a1-47d2-bf50-536f01e6c135 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:53.787112 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0ee08f0f-56a1-47d2-bf50-536f01e6c135 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:54.023300 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-151b9685-9ef2-4cad-ab34-a62a0064b221 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:54.094218 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-151b9685-9ef2-4cad-ab34-a62a0064b221 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1314 microversion: 2.1 time: 1.383505 Jun 16 14:51:54.098474 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1357/2617] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:52 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1314 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:54.120294 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a7784265-37c1-42ce-9816-5fc292593242 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:54.121472 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a7784265-37c1-42ce-9816-5fc292593242 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:54.146831 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a7784265-37c1-42ce-9816-5fc292593242 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:54.149383 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a7784265-37c1-42ce-9816-5fc292593242 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:54.154541 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a7784265-37c1-42ce-9816-5fc292593242 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:54.166038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a7784265-37c1-42ce-9816-5fc292593242 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:54.289329 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a7784265-37c1-42ce-9816-5fc292593242 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:51:54.586687 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a7784265-37c1-42ce-9816-5fc292593242 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 204 len: 0 microversion: 2.1 time: 0.474052 Jun 16 14:51:54.588894 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1358/2618] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:51:54 2022] DELETE /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:51:54.616987 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-84565c05-ad09-43b3-ab3d-0d9ed4bb5dd9 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:54.619494 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-84565c05-ad09-43b3-ab3d-0d9ed4bb5dd9 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:54.634987 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-84565c05-ad09-43b3-ab3d-0d9ed4bb5dd9 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:54.639642 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-84565c05-ad09-43b3-ab3d-0d9ed4bb5dd9 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:54.644700 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-84565c05-ad09-43b3-ab3d-0d9ed4bb5dd9 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:54.646039 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-84565c05-ad09-43b3-ab3d-0d9ed4bb5dd9 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:55.004148 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0ee08f0f-56a1-47d2-bf50-536f01e6c135 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:55.056657 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0ee08f0f-56a1-47d2-bf50-536f01e6c135 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:55.074728 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0ee08f0f-56a1-47d2-bf50-536f01e6c135 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:55.077135 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0ee08f0f-56a1-47d2-bf50-536f01e6c135 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1801 microversion: 2.32 time: 1.349292 Jun 16 14:51:55.078218 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1261/2619] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:53 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1801 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:55.099086 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1411757c-e861-4862-9163-0c51e41d09f6 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:55.108564 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1411757c-e861-4862-9163-0c51e41d09f6 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:55.150609 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1411757c-e861-4862-9163-0c51e41d09f6 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:55.151762 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1411757c-e861-4862-9163-0c51e41d09f6 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:55.153229 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1411757c-e861-4862-9163-0c51e41d09f6 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:55.154577 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1411757c-e861-4862-9163-0c51e41d09f6 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:55.904391 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-84565c05-ad09-43b3-ab3d-0d9ed4bb5dd9 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:55.929783 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-84565c05-ad09-43b3-ab3d-0d9ed4bb5dd9 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1667 microversion: 2.1 time: 1.331678 Jun 16 14:51:55.936443 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1359/2620] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:54 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1667 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:55.956333 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-78da7cfe-59ea-484d-8709-a2a09f937e38 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffa318b0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:56.038435 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-1411757c-e861-4862-9163-0c51e41d09f6 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:51:56.073774 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-78da7cfe-59ea-484d-8709-a2a09f937e38 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1430 microversion: 2.1 time: 0.135341 Jun 16 14:51:56.076762 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1360/2621] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:55 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1430 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:56.099858 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9bcae906-31ca-4dfc-9d4e-68eefc075155 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:56.101470 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9bcae906-31ca-4dfc-9d4e-68eefc075155 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:56.118347 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1411757c-e861-4862-9163-0c51e41d09f6 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1929 microversion: 2.75 time: 1.032147 Jun 16 14:51:56.126505 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1262/2622] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:55 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1929 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:56.137868 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-502e75ad-1c39-4da4-b69d-a16a5b9e447c tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeff2a9af0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:56.145636 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9bcae906-31ca-4dfc-9d4e-68eefc075155 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:56.146502 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9bcae906-31ca-4dfc-9d4e-68eefc075155 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:56.148363 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9bcae906-31ca-4dfc-9d4e-68eefc075155 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:56.149545 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9bcae906-31ca-4dfc-9d4e-68eefc075155 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:56.290842 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-502e75ad-1c39-4da4-b69d-a16a5b9e447c tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 200 len: 1430 microversion: 2.1 time: 0.161180 Jun 16 14:51:56.294411 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1263/2623] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:56 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 1430 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:56.332159 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2ae9f255-6e2e-47a6-8286-3cf283e867cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:56.337851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2ae9f255-6e2e-47a6-8286-3cf283e867cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:56.387182 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ae9f255-6e2e-47a6-8286-3cf283e867cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:56.389277 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ae9f255-6e2e-47a6-8286-3cf283e867cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:56.392176 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ae9f255-6e2e-47a6-8286-3cf283e867cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:56.395897 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2ae9f255-6e2e-47a6-8286-3cf283e867cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:56.506780 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:56.740721 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9bcae906-31ca-4dfc-9d4e-68eefc075155 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:56.752900 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9bcae906-31ca-4dfc-9d4e-68eefc075155 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1501 microversion: 2.1 time: 0.660842 Jun 16 14:51:56.758246 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1361/2624] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:56 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1501 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:56.777727 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-23881171-a534-4de2-8955-c49a357f5793 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:56.802262 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-23881171-a534-4de2-8955-c49a357f5793 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:56.816088 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23881171-a534-4de2-8955-c49a357f5793 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:56.820242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23881171-a534-4de2-8955-c49a357f5793 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:56.823490 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23881171-a534-4de2-8955-c49a357f5793 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:56.825565 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23881171-a534-4de2-8955-c49a357f5793 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:57.402287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-23881171-a534-4de2-8955-c49a357f5793 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:57.416457 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-23881171-a534-4de2-8955-c49a357f5793 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1465 microversion: 2.1 time: 0.655748 Jun 16 14:51:57.423253 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1362/2625] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:56 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1465 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:57.433829 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ca1e049a-f7e9-472b-a59c-d7669e04be7a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:57.435690 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ca1e049a-f7e9-472b-a59c-d7669e04be7a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:57.457817 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca1e049a-f7e9-472b-a59c-d7669e04be7a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:57.463918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca1e049a-f7e9-472b-a59c-d7669e04be7a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:57.465229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca1e049a-f7e9-472b-a59c-d7669e04be7a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:57.466503 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca1e049a-f7e9-472b-a59c-d7669e04be7a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:58.560626 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ca1e049a-f7e9-472b-a59c-d7669e04be7a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:58.571994 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ca1e049a-f7e9-472b-a59c-d7669e04be7a tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1667 microversion: 2.1 time: 1.145857 Jun 16 14:51:58.580746 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1363/2626] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:57 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1667 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:58.588907 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2ae9f255-6e2e-47a6-8286-3cf283e867cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:58.604046 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1361838c-7f32-4fdb-b7fa-4175fbcd0238 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:58.605772 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1361838c-7f32-4fdb-b7fa-4175fbcd0238 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:58.638484 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1361838c-7f32-4fdb-b7fa-4175fbcd0238 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:58.639791 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1361838c-7f32-4fdb-b7fa-4175fbcd0238 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:58.644298 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1361838c-7f32-4fdb-b7fa-4175fbcd0238 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:58.645004 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2ae9f255-6e2e-47a6-8286-3cf283e867cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:58.651319 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1361838c-7f32-4fdb-b7fa-4175fbcd0238 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:58.665230 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2ae9f255-6e2e-47a6-8286-3cf283e867cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:51:58.667770 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2ae9f255-6e2e-47a6-8286-3cf283e867cc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1801 microversion: 2.32 time: 2.368283 Jun 16 14:51:58.670075 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1264/2627] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:56 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1801 bytes in 2375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:58.713232 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b909b41a-4c29-4545-88c1-d6a6dadfc4d4 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeff25b160>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:58.811310 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-1361838c-7f32-4fdb-b7fa-4175fbcd0238 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:51:58.895696 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1361838c-7f32-4fdb-b7fa-4175fbcd0238 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1935 microversion: 2.75 time: 0.312294 Jun 16 14:51:58.895696 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1364/2628] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:51:58 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1935 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:58.916801 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-b83a7a9f-d29c-42df-9bbc-5dd4597b3218 req-e7d3d4dc-c64b-4cf6-8427-bdf02c427cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa828bec-416c-496b-9290-60892a56a452", "name": "network-vif-unplugged", "status": "completed", "tag": "50551314-0d91-4b89-ae9d-7adae8fcf3a6"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:51:58.937701 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-b83a7a9f-d29c-42df-9bbc-5dd4597b3218 req-e7d3d4dc-c64b-4cf6-8427-bdf02c427cb5 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:58.940340 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-b83a7a9f-d29c-42df-9bbc-5dd4597b3218 req-e7d3d4dc-c64b-4cf6-8427-bdf02c427cb5 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:58.973212 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b909b41a-4c29-4545-88c1-d6a6dadfc4d4 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/3c5b2063-0858-477e-a4dd-6736a4c60e42" status: 200 len: 784 microversion: 2.1 time: 0.300878 Jun 16 14:51:58.982825 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1265/2629] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:51:58 2022] GET /compute/v2.1/images/3c5b2063-0858-477e-a4dd-6736a4c60e42 => generated 784 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:59.027019 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-b83a7a9f-d29c-42df-9bbc-5dd4597b3218 req-e7d3d4dc-c64b-4cf6-8427-bdf02c427cb5 service nova] Creating event network-vif-unplugged:50551314-0d91-4b89-ae9d-7adae8fcf3a6 for instance aa828bec-416c-496b-9290-60892a56a452 on n-h2-836830-4 Jun 16 14:51:59.027823 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8b188439-595d-4ced-8bac-457fb68b2771 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:59.048784 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-b83a7a9f-d29c-42df-9bbc-5dd4597b3218 req-e7d3d4dc-c64b-4cf6-8427-bdf02c427cb5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148414 Jun 16 14:51:59.055292 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1365/2630] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:59.110912 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8b188439-595d-4ced-8bac-457fb68b2771 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.090611 Jun 16 14:51:59.127206 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-75023428-f99f-4a03-976d-2a634bc38fd6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffdad8b0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:59.128077 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1266/2631] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:51:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:51:59.614126 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-48a862d8-0589-4a39-a40c-de5d93f59805 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:59.616858 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-48a862d8-0589-4a39-a40c-de5d93f59805 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:51:59.656871 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-48a862d8-0589-4a39-a40c-de5d93f59805 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:59.660076 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-48a862d8-0589-4a39-a40c-de5d93f59805 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:51:59.671950 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-48a862d8-0589-4a39-a40c-de5d93f59805 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:51:59.673076 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-48a862d8-0589-4a39-a40c-de5d93f59805 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:00.891714 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-75023428-f99f-4a03-976d-2a634bc38fd6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "DELETE /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 204 len: 0 microversion: 2.1 time: 1.771607 Jun 16 14:52:00.896595 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1366/2632] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:59 2022] DELETE /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 0 bytes in 1774 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:52:00.915679 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cece3973-d8ef-4186-8216-8b8386aaa28d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:00.919559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-cece3973-d8ef-4186-8216-8b8386aaa28d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:00.951952 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:00.958217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cece3973-d8ef-4186-8216-8b8386aaa28d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:00.959314 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cece3973-d8ef-4186-8216-8b8386aaa28d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:00.961076 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cece3973-d8ef-4186-8216-8b8386aaa28d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:00.962286 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cece3973-d8ef-4186-8216-8b8386aaa28d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:01.670940 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-48a862d8-0589-4a39-a40c-de5d93f59805 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:01.711858 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-48a862d8-0589-4a39-a40c-de5d93f59805 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1667 microversion: 2.1 time: 2.096857 Jun 16 14:52:01.713370 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1267/2633] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:51:59 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1667 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:01.728914 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ddfda46e-a519-449b-85a8-6c0c8c11ac13 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:01.734468 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ddfda46e-a519-449b-85a8-6c0c8c11ac13 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:01.763518 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddfda46e-a519-449b-85a8-6c0c8c11ac13 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:01.767483 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddfda46e-a519-449b-85a8-6c0c8c11ac13 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:01.771332 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddfda46e-a519-449b-85a8-6c0c8c11ac13 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:01.772627 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ddfda46e-a519-449b-85a8-6c0c8c11ac13 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:01.856848 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cece3973-d8ef-4186-8216-8b8386aaa28d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:01.907245 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cece3973-d8ef-4186-8216-8b8386aaa28d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:01.918532 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-cece3973-d8ef-4186-8216-8b8386aaa28d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:01.928779 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cece3973-d8ef-4186-8216-8b8386aaa28d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1801 microversion: 2.32 time: 1.025099 Jun 16 14:52:01.942278 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1367/2634] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:00 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1801 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:01.951304 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b41c4500-811c-48b5-a9ef-12a867263eaa tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffdad160>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:01.989450 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-b41c4500-811c-48b5-a9ef-12a867263eaa tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] HTTP exception thrown: Image not found. Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b41c4500-811c-48b5-a9ef-12a867263eaa tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Request method failure captured: Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 HTTP/1.1 Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0M0_CzkpfsXSHfRB3JE7CRvCuxKo09QG96KnFHfjR7DyaTTsycyBux6AD9vhcS0lksg20XOedtkY-JPJ6ZwxRsTKdh9gtpUcvfvpxZafZPNHDK545VwZE0-nPkHaGV1_TYqsIrEuz3kJAu-zG9fc-flLbYuAul3e9yndy9A6CEu7Dw Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 516446d68e6b452c83140a9cf4625619 Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesOneServerTestJSON-649769668 Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_516446d68e6b452c83140a9cf4625619", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/516446d68e6b452c83140a9cf4625619"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/516446d68e6b452c83140a9cf4625619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/516446d68e6b452c83140a9cf4625619"}]}] Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesOneServerTestJSON-649769668 Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 516446d68e6b452c83140a9cf4625619 Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-649769668 Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesOneServerTestJSON-649769668-project Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 00c2308f7caf47369c442b63533253de Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesOneServerTestJSON-649769668-project Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: exception: Image not found. Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'dc44e4be-de2e-4f3e-a7ef-0b912bd539c9'} Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 14:52:02.001091 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 could not be found. Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:52:02.009953 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:02.023742 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b41c4500-811c-48b5-a9ef-12a867263eaa tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Returning 404 to user: Image not found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:52:02.029976 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b41c4500-811c-48b5-a9ef-12a867263eaa tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 404 len: 62 microversion: 2.1 time: 0.093960 Jun 16 14:52:02.046974 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1368/2635] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:01 2022] GET /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 62 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:52:02.055901 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-6651f59d-7998-4581-90c0-97e2bf485493 req-22ca9ba9-6c73-49a4-88a2-5f8e4abc55cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2d6585-b3a9-46a5-b43d-d9eb61f41d23", "name": "network-vif-unplugged", "status": "completed", "tag": "54d05d80-f4ed-4a22-8cbf-201e2d4efe15"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:02.096968 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-6651f59d-7998-4581-90c0-97e2bf485493 req-22ca9ba9-6c73-49a4-88a2-5f8e4abc55cd service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:02.097645 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-6651f59d-7998-4581-90c0-97e2bf485493 req-22ca9ba9-6c73-49a4-88a2-5f8e4abc55cd service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:02.117583 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-ddfda46e-a519-449b-85a8-6c0c8c11ac13 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:52:02.118494 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-6651f59d-7998-4581-90c0-97e2bf485493 req-22ca9ba9-6c73-49a4-88a2-5f8e4abc55cd service nova] Creating event network-vif-unplugged:54d05d80-f4ed-4a22-8cbf-201e2d4efe15 for instance 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 on n-h2-836830-4 Jun 16 14:52:02.129605 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-6651f59d-7998-4581-90c0-97e2bf485493 req-22ca9ba9-6c73-49a4-88a2-5f8e4abc55cd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080654 Jun 16 14:52:02.131462 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1369/2636] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:52:02.150188 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8d7af7b5-6063-4efc-8ff6-87d7827b7eca tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62256263-86ad-4496-9b5d-fa10fea9620a"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:02.154206 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ddfda46e-a519-449b-85a8-6c0c8c11ac13 tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1935 microversion: 2.75 time: 0.439092 Jun 16 14:52:02.160292 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1268/2637] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:01 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1935 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:02.168046 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7783d2ef-e8f3-4be9-aa9e-fe54551ee7e2 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1712098120"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:02.169639 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7783d2ef-e8f3-4be9-aa9e-fe54551ee7e2 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:02.178190 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7783d2ef-e8f3-4be9-aa9e-fe54551ee7e2 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:02.179128 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7783d2ef-e8f3-4be9-aa9e-fe54551ee7e2 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:02.180262 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7783d2ef-e8f3-4be9-aa9e-fe54551ee7e2 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:02.181017 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7783d2ef-e8f3-4be9-aa9e-fe54551ee7e2 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:02.188747 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8d7af7b5-6063-4efc-8ff6-87d7827b7eca tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:02.230190 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8d7af7b5-6063-4efc-8ff6-87d7827b7eca tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:02.240039 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8d7af7b5-6063-4efc-8ff6-87d7827b7eca tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:02.242029 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8d7af7b5-6063-4efc-8ff6-87d7827b7eca tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:02.244183 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8d7af7b5-6063-4efc-8ff6-87d7827b7eca tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:02.849715 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7783d2ef-e8f3-4be9-aa9e-fe54551ee7e2 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "POST /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452/action" status: 202 len: 0 microversion: 2.1 time: 0.687445 Jun 16 14:52:02.862017 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1269/2638] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:52:02 2022] POST /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452/action => generated 0 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 16 14:52:02.873525 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9fbee03b-65da-4198-8665-6bd553586980 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:02.876216 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9fbee03b-65da-4198-8665-6bd553586980 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:02.890300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9fbee03b-65da-4198-8665-6bd553586980 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:02.896024 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9fbee03b-65da-4198-8665-6bd553586980 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:02.899850 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9fbee03b-65da-4198-8665-6bd553586980 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:02.901127 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9fbee03b-65da-4198-8665-6bd553586980 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:03.194056 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9fbee03b-65da-4198-8665-6bd553586980 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60631612044343e1ad556690ed0eabe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f5198d96e9344898c15d63c0aa8615b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:03.205362 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9fbee03b-65da-4198-8665-6bd553586980 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 200 len: 1599 microversion: 2.1 time: 0.341284 Jun 16 14:52:03.205980 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1270/2639] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:02 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 1599 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:03.239016 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-30fa8d61-4511-4b8a-af5d-243786c2985b req-0abc9c8a-8075-4376-9959-9dfdc5e4c68c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2d6585-b3a9-46a5-b43d-d9eb61f41d23", "name": "network-vif-deleted", "tag": "54d05d80-f4ed-4a22-8cbf-201e2d4efe15"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:03.286799 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-30fa8d61-4511-4b8a-af5d-243786c2985b req-0abc9c8a-8075-4376-9959-9dfdc5e4c68c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:03.287352 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-30fa8d61-4511-4b8a-af5d-243786c2985b req-0abc9c8a-8075-4376-9959-9dfdc5e4c68c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:03.336769 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8d7af7b5-6063-4efc-8ff6-87d7827b7eca tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "POST /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.202593 Jun 16 14:52:03.338861 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-30fa8d61-4511-4b8a-af5d-243786c2985b req-0abc9c8a-8075-4376-9959-9dfdc5e4c68c service nova] Creating event network-vif-deleted:54d05d80-f4ed-4a22-8cbf-201e2d4efe15 for instance 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 on n-h2-836830-4 Jun 16 14:52:03.341981 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1370/2640] 10.222.0.57 () {60 vars in 1322 bytes} [Thu Jun 16 14:52:02 2022] POST /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b/os-volume_attachments => generated 194 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:52:03.348395 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-30fa8d61-4511-4b8a-af5d-243786c2985b req-0abc9c8a-8075-4376-9959-9dfdc5e4c68c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128803 Jun 16 14:52:03.352731 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1271/2641] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:52:03.363817 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f59218b8-f792-45a0-9bcf-deb616f8936d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:03.365185 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f59218b8-f792-45a0-9bcf-deb616f8936d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:03.388284 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f59218b8-f792-45a0-9bcf-deb616f8936d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:03.390347 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f59218b8-f792-45a0-9bcf-deb616f8936d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:03.391440 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f59218b8-f792-45a0-9bcf-deb616f8936d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:03.396619 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f59218b8-f792-45a0-9bcf-deb616f8936d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:03.400516 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d9b6aefc-fced-4801-a5b1-1d391418cfc8 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffea7670>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:03.521688 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d9b6aefc-fced-4801-a5b1-1d391418cfc8 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.173381 Jun 16 14:52:03.525462 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1371/2642] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:03 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:03.544142 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e098e9a5-901e-45c8-a4c3-4e1406307add tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:03.545887 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e098e9a5-901e-45c8-a4c3-4e1406307add tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:03.571674 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e098e9a5-901e-45c8-a4c3-4e1406307add tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:03.572995 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e098e9a5-901e-45c8-a4c3-4e1406307add tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:03.574016 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e098e9a5-901e-45c8-a4c3-4e1406307add tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:03.574818 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e098e9a5-901e-45c8-a4c3-4e1406307add tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:03.961606 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-e098e9a5-901e-45c8-a4c3-4e1406307add tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] Lazy-loading 'services' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:52:04.005576 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e098e9a5-901e-45c8-a4c3-4e1406307add tempest-ServersAdmin275Test-837507835 tempest-ServersAdmin275Test-837507835-project-admin] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1920 microversion: 2.75 time: 0.478434 Jun 16 14:52:04.030373 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1372/2643] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:03 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1920 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:04.044054 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5c414bde-15c5-4b50-9a04-075bd4b909a4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:04.044993 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5c414bde-15c5-4b50-9a04-075bd4b909a4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:04.064974 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5c414bde-15c5-4b50-9a04-075bd4b909a4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:04.065721 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5c414bde-15c5-4b50-9a04-075bd4b909a4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:04.066940 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5c414bde-15c5-4b50-9a04-075bd4b909a4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:04.067664 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5c414bde-15c5-4b50-9a04-075bd4b909a4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:04.198987 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5c414bde-15c5-4b50-9a04-075bd4b909a4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:52:04.265404 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:04.532264 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5c414bde-15c5-4b50-9a04-075bd4b909a4 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "DELETE /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 204 len: 0 microversion: 2.75 time: 0.486825 Jun 16 14:52:04.540672 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1373/2644] 10.222.0.57 () {60 vars in 1279 bytes} [Thu Jun 16 14:52:04 2022] DELETE /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 14:52:04.579767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-aee3d5dc-62b9-41f8-8ddc-0cf0d357ecf6 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:04.583476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-aee3d5dc-62b9-41f8-8ddc-0cf0d357ecf6 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] [instance: 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:04.622053 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aee3d5dc-62b9-41f8-8ddc-0cf0d357ecf6 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:04.627926 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aee3d5dc-62b9-41f8-8ddc-0cf0d357ecf6 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:04.633124 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aee3d5dc-62b9-41f8-8ddc-0cf0d357ecf6 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:04.634046 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-aee3d5dc-62b9-41f8-8ddc-0cf0d357ecf6 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:04.729691 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-aee3d5dc-62b9-41f8-8ddc-0cf0d357ecf6 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] HTTP exception thrown: Instance 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 could not be found. Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-aee3d5dc-62b9-41f8-8ddc-0cf0d357ecf6 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Request method failure captured: Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 HTTP/1.1 Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0MYGacjr-i1eRYBiYKB6vQ1SIOu9vSj_FSUB9btmZUXhC_ThTWj-fpFGKg6DQtaGpBizs7o5pFswPcqoQW093tA0taCb1t226-6UGOaLqNOuEDfSAUWjHB49GUYcHNdsBoDTWTenVvhOCG_QDXNCwB0e8i0ldOpNxt8hDvivsTOVZg Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 8f5198d96e9344898c15d63c0aa8615b Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ServersTestFqdnHostnames-1200327326 Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8f5198d96e9344898c15d63c0aa8615b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f5198d96e9344898c15d63c0aa8615b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8f5198d96e9344898c15d63c0aa8615b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8f5198d96e9344898c15d63c0aa8615b"}]}] Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ServersTestFqdnHostnames-1200327326 Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 8f5198d96e9344898c15d63c0aa8615b Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1200327326 Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ServersTestFqdnHostnames-1200327326-project Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 60631612044343e1ad556690ed0eabe7 Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ServersTestFqdnHostnames-1200327326-project Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 could not be found. Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '6e2d6585-b3a9-46a5-b43d-d9eb61f41d23'} Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 could not be found. Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 could not be found. Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:04.744223 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:04.753558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:04.753558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:04.753558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:04.753558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:52:04.753558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:52:04.753558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 could not be found. Jun 16 14:52:04.753558 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:04.753558 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-aee3d5dc-62b9-41f8-8ddc-0cf0d357ecf6 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Returning 404 to user: Instance 6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:52:04.756293 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-aee3d5dc-62b9-41f8-8ddc-0cf0d357ecf6 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23" status: 404 len: 111 microversion: 2.1 time: 0.208883 Jun 16 14:52:04.765041 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1374/2645] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:04 2022] GET /compute/v2.1/servers/6e2d6585-b3a9-46a5-b43d-d9eb61f41d23 => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:52:04.792235 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5f9f4c5d-3351-4dc1-a73d-34e35f474ab5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffe7f430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:04.963641 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5f9f4c5d-3351-4dc1-a73d-34e35f474ab5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.200335 Jun 16 14:52:04.965316 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1375/2646] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:04 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:04.980638 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-39a298ff-a654-4fc7-9f83-285234b452a8 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:04.982850 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-39a298ff-a654-4fc7-9f83-285234b452a8 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:04.999992 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39a298ff-a654-4fc7-9f83-285234b452a8 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:05.003436 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39a298ff-a654-4fc7-9f83-285234b452a8 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:05.005998 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39a298ff-a654-4fc7-9f83-285234b452a8 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:05.007399 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-39a298ff-a654-4fc7-9f83-285234b452a8 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:05.258774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-39a298ff-a654-4fc7-9f83-285234b452a8 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:05.351030 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-39a298ff-a654-4fc7-9f83-285234b452a8 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:05.352991 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-39a298ff-a654-4fc7-9f83-285234b452a8 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:05.369685 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-39a298ff-a654-4fc7-9f83-285234b452a8 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1444 microversion: 2.75 time: 0.401717 Jun 16 14:52:05.386073 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1376/2647] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:04 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1444 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:05.397736 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-19f8fb1b-353d-4e06-acfb-0e3712881311 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] Calling method '.version_select at 0x7fdeffe14310>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:05.456483 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-19f8fb1b-353d-4e06-acfb-0e3712881311 tempest-ServersTestFqdnHostnames-1200327326 tempest-ServersTestFqdnHostnames-1200327326-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-577065716" status: 202 len: 0 microversion: 2.1 time: 0.069101 Jun 16 14:52:05.467258 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1377/2648] 10.222.0.57 () {58 vars in 1217 bytes} [Thu Jun 16 14:52:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-577065716 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:52:05.665269 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f59218b8-f792-45a0-9bcf-deb616f8936d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:05.742073 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f59218b8-f792-45a0-9bcf-deb616f8936d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:05.748664 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f59218b8-f792-45a0-9bcf-deb616f8936d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:05.753531 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f59218b8-f792-45a0-9bcf-deb616f8936d tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1848 microversion: 2.32 time: 2.398799 Jun 16 14:52:05.781323 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1272/2649] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:03 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1848 bytes in 2427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:05.979125 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-08a37879-7a9a-45ed-b938-e9bcb1bb6261 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf0c0ec040>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:06.063663 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-08a37879-7a9a-45ed-b938-e9bcb1bb6261 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.089421 Jun 16 14:52:06.066077 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1378/2650] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:05 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:06.418687 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ce5d8821-be11-41ca-9b25-a4ea74d988df tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:06.419786 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ce5d8821-be11-41ca-9b25-a4ea74d988df tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:06.455770 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ce5d8821-be11-41ca-9b25-a4ea74d988df tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:06.456789 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ce5d8821-be11-41ca-9b25-a4ea74d988df tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:06.457844 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ce5d8821-be11-41ca-9b25-a4ea74d988df tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:06.461484 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ce5d8821-be11-41ca-9b25-a4ea74d988df tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:06.790981 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0764f3e6-14d6-47b3-9280-c0d89d7da576 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:06.791910 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0764f3e6-14d6-47b3-9280-c0d89d7da576 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:06.822694 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0764f3e6-14d6-47b3-9280-c0d89d7da576 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:06.824636 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0764f3e6-14d6-47b3-9280-c0d89d7da576 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:06.828393 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0764f3e6-14d6-47b3-9280-c0d89d7da576 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:06.831801 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0764f3e6-14d6-47b3-9280-c0d89d7da576 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:06.885018 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ce5d8821-be11-41ca-9b25-a4ea74d988df tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:06.968989 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ce5d8821-be11-41ca-9b25-a4ea74d988df tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:06.980195 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ce5d8821-be11-41ca-9b25-a4ea74d988df tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:07.008611 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ce5d8821-be11-41ca-9b25-a4ea74d988df tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1444 microversion: 2.75 time: 0.618258 Jun 16 14:52:07.024049 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1273/2651] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:06 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1444 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:07.084490 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2ed4ec2d-49a6-4d25-8c5f-e6d1e9ce0d00 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeff25d820>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:07.219238 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2ed4ec2d-49a6-4d25-8c5f-e6d1e9ce0d00 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.140858 Jun 16 14:52:07.227254 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1274/2652] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:07 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:07.981756 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0764f3e6-14d6-47b3-9280-c0d89d7da576 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:07.999803 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0764f3e6-14d6-47b3-9280-c0d89d7da576 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:08.006062 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0764f3e6-14d6-47b3-9280-c0d89d7da576 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:08.009721 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0764f3e6-14d6-47b3-9280-c0d89d7da576 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1848 microversion: 2.32 time: 1.227283 Jun 16 14:52:08.026576 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1379/2653] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:06 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1848 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:08.040282 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-40ec291c-acec-4bf1-9c5b-736d95b15eda tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:08.041463 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-40ec291c-acec-4bf1-9c5b-736d95b15eda tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:08.067421 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40ec291c-acec-4bf1-9c5b-736d95b15eda tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:08.072778 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40ec291c-acec-4bf1-9c5b-736d95b15eda tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:08.076691 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40ec291c-acec-4bf1-9c5b-736d95b15eda tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:08.081858 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-40ec291c-acec-4bf1-9c5b-736d95b15eda tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:08.238124 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b9db7601-6fa5-4f1d-84bc-186f7bde1a06 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffe869d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:08.313026 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b9db7601-6fa5-4f1d-84bc-186f7bde1a06 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.079710 Jun 16 14:52:08.314655 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1380/2654] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:08 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:08.440344 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-40ec291c-acec-4bf1-9c5b-736d95b15eda tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:08.461132 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-40ec291c-acec-4bf1-9c5b-736d95b15eda tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:08.465588 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-40ec291c-acec-4bf1-9c5b-736d95b15eda tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:08.483665 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-40ec291c-acec-4bf1-9c5b-736d95b15eda tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1444 microversion: 2.75 time: 0.450052 Jun 16 14:52:08.488301 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1275/2655] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:08 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1444 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:09.040761 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-11af51ae-55a7-4401-ac23-213d3a094c60 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:09.050175 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-11af51ae-55a7-4401-ac23-213d3a094c60 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:09.101040 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11af51ae-55a7-4401-ac23-213d3a094c60 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:09.101519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11af51ae-55a7-4401-ac23-213d3a094c60 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:09.102405 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11af51ae-55a7-4401-ac23-213d3a094c60 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:09.104605 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-11af51ae-55a7-4401-ac23-213d3a094c60 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:09.207257 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-d87d222f-b48c-46f1-94e5-649254cd66ed req-6b94b332-7343-488e-a9e8-58686ce77db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa828bec-416c-496b-9290-60892a56a452", "name": "network-vif-plugged", "status": "completed", "tag": "50551314-0d91-4b89-ae9d-7adae8fcf3a6"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:09.247123 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-d87d222f-b48c-46f1-94e5-649254cd66ed req-6b94b332-7343-488e-a9e8-58686ce77db3 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:09.253110 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-d87d222f-b48c-46f1-94e5-649254cd66ed req-6b94b332-7343-488e-a9e8-58686ce77db3 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:09.301949 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-d87d222f-b48c-46f1-94e5-649254cd66ed req-6b94b332-7343-488e-a9e8-58686ce77db3 service nova] Creating event network-vif-plugged:50551314-0d91-4b89-ae9d-7adae8fcf3a6 for instance aa828bec-416c-496b-9290-60892a56a452 on n-h2-836830-4 Jun 16 14:52:09.323454 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-d87d222f-b48c-46f1-94e5-649254cd66ed req-6b94b332-7343-488e-a9e8-58686ce77db3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130100 Jun 16 14:52:09.327697 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1276/2656] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:52:09.350455 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-d312ec36-1695-4fed-99a5-55cf32ea3c85 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf0c2d21f0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:09.475383 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-d312ec36-1695-4fed-99a5-55cf32ea3c85 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.145833 Jun 16 14:52:09.483585 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1277/2657] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:09 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:09.530549 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bc962cef-edc9-4176-89bb-aed958f668f6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:09.532722 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bc962cef-edc9-4176-89bb-aed958f668f6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:09.566197 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bc962cef-edc9-4176-89bb-aed958f668f6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:09.567117 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bc962cef-edc9-4176-89bb-aed958f668f6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:09.576903 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bc962cef-edc9-4176-89bb-aed958f668f6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:09.581020 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bc962cef-edc9-4176-89bb-aed958f668f6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:09.760025 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bc962cef-edc9-4176-89bb-aed958f668f6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:09.760595 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bc962cef-edc9-4176-89bb-aed958f668f6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:09.763269 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.objects.instance [None req-bc962cef-edc9-4176-89bb-aed958f668f6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lazy-loading 'fault' on Instance uuid 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb {{(pid=125863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:52:10.170442 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bc962cef-edc9-4176-89bb-aed958f668f6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:10.246518 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bc962cef-edc9-4176-89bb-aed958f668f6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:10.250551 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bc962cef-edc9-4176-89bb-aed958f668f6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1df05dddb19478cb6d5966c027d23fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9dcec2ee344669a21194366f617d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:10.260774 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bc962cef-edc9-4176-89bb-aed958f668f6 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 200 len: 1449 microversion: 2.75 time: 0.737854 Jun 16 14:52:10.280109 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1278/2658] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:09 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 1449 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:10.287780 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-fc037688-aa13-4a90-bd11-537e47608f14 req-25994115-54d2-49f9-9a8d-3086d3857b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d33c522d-8fb2-4c37-a15c-e1af48406b09", "tag": "06d3d87e-c24d-4c54-959e-05ab2fe4500b"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:10.299753 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-fc037688-aa13-4a90-bd11-537e47608f14 req-25994115-54d2-49f9-9a8d-3086d3857b8c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:10.300621 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-fc037688-aa13-4a90-bd11-537e47608f14 req-25994115-54d2-49f9-9a8d-3086d3857b8c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:10.325515 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-fc037688-aa13-4a90-bd11-537e47608f14 req-25994115-54d2-49f9-9a8d-3086d3857b8c service nova] Creating event network-changed:06d3d87e-c24d-4c54-959e-05ab2fe4500b for instance d33c522d-8fb2-4c37-a15c-e1af48406b09 on n-h1-836830-4 Jun 16 14:52:10.334131 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-fc037688-aa13-4a90-bd11-537e47608f14 req-25994115-54d2-49f9-9a8d-3086d3857b8c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052307 Jun 16 14:52:10.335735 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1279/2659] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:52:10.491097 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-835c5362-bfd1-45ce-a9fe-d0f201461c9f tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeff25b3a0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:10.496053 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-11af51ae-55a7-4401-ac23-213d3a094c60 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:10.510108 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-11af51ae-55a7-4401-ac23-213d3a094c60 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:10.511736 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-11af51ae-55a7-4401-ac23-213d3a094c60 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:10.513045 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-11af51ae-55a7-4401-ac23-213d3a094c60 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1848 microversion: 2.32 time: 1.484704 Jun 16 14:52:10.513626 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1381/2660] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:09 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1848 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:10.589826 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-835c5362-bfd1-45ce-a9fe-d0f201461c9f tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.103958 Jun 16 14:52:10.594542 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1280/2661] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:10 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:11.293487 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8251094f-edd7-4b58-8946-d4343b768e63 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:11.295033 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8251094f-edd7-4b58-8946-d4343b768e63 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] [instance: 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:11.329362 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8251094f-edd7-4b58-8946-d4343b768e63 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:11.346750 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8251094f-edd7-4b58-8946-d4343b768e63 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:11.356127 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8251094f-edd7-4b58-8946-d4343b768e63 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:11.357111 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8251094f-edd7-4b58-8946-d4343b768e63 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:11.395584 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-8251094f-edd7-4b58-8946-d4343b768e63 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] HTTP exception thrown: Instance 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb could not be found. Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8251094f-edd7-4b58-8946-d4343b768e63 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Request method failure captured: Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb HTTP/1.1 Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0M-TUFY_IWCMA8kPLZgVuYwGjfauRUgxyjk32wm55AnGcE9YiKiGOdNicGLswEmYtz6o0ciha97Nsp0o8rrVDUzblnET1VFCBH2I4ls51KdipU0C-0GAeECi64UEZqRgngzEN4nI6S7WKKTT14SZP7hpn8u31RAngPmpN-sGXZVv78 Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Openstack-Nova-Api-Version: 2.75 Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 9b9dcec2ee344669a21194366f617d15 Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ServersAdmin275Test-344052761 Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9b9dcec2ee344669a21194366f617d15", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9b9dcec2ee344669a21194366f617d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9b9dcec2ee344669a21194366f617d15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9b9dcec2ee344669a21194366f617d15"}]}] Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ServersAdmin275Test-344052761 Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 9b9dcec2ee344669a21194366f617d15 Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ServersAdmin275Test-344052761 Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ServersAdmin275Test-344052761-project Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: b1df05dddb19478cb6d5966c027d23fb Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ServersAdmin275Test-344052761-project Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb could not be found. Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb'} Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb could not be found. Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb could not be found. Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:11.401941 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:11.433414 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:11.433414 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:11.433414 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:11.433414 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:52:11.433414 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:52:11.433414 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb could not be found. Jun 16 14:52:11.433414 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:11.443573 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8251094f-edd7-4b58-8946-d4343b768e63 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] Returning 404 to user: Instance 96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:52:11.457367 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8251094f-edd7-4b58-8946-d4343b768e63 tempest-ServersAdmin275Test-344052761 tempest-ServersAdmin275Test-344052761-project] 10.222.0.57 "GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb" status: 404 len: 111 microversion: 2.75 time: 0.162129 Jun 16 14:52:11.459497 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1382/2662] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:11 2022] GET /compute/v2.1/servers/96b23b03-73aa-4ee3-a9ee-5c1d015e6ceb => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:52:11.538358 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-17682847-92e9-43b9-8548-8b2ff97c84c6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:11.540736 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-17682847-92e9-43b9-8548-8b2ff97c84c6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:11.581782 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-17682847-92e9-43b9-8548-8b2ff97c84c6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:11.586042 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-17682847-92e9-43b9-8548-8b2ff97c84c6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:11.588185 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-17682847-92e9-43b9-8548-8b2ff97c84c6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:11.591172 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-17682847-92e9-43b9-8548-8b2ff97c84c6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:11.606318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dbd9c5ee-3f74-4188-8699-3e23c8f0494a tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf0c6c3160>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:11.754493 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-dbd9c5ee-3f74-4188-8699-3e23c8f0494a tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.147292 Jun 16 14:52:11.758267 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1383/2663] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:11 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:12.496363 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-17682847-92e9-43b9-8548-8b2ff97c84c6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:12.522058 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-17682847-92e9-43b9-8548-8b2ff97c84c6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:12.525183 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-17682847-92e9-43b9-8548-8b2ff97c84c6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:12.540068 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-17682847-92e9-43b9-8548-8b2ff97c84c6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1848 microversion: 2.32 time: 1.009658 Jun 16 14:52:12.541082 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1281/2664] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:11 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1848 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:12.774266 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b1ea3440-843c-4099-b3d7-161473210375 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffe11700>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:12.898729 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b1ea3440-843c-4099-b3d7-161473210375 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.128989 Jun 16 14:52:12.900797 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1384/2665] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:12 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:13.576346 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1246f0b0-ea8e-452a-87cf-1d51c227a7ef tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:13.577453 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1246f0b0-ea8e-452a-87cf-1d51c227a7ef tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:13.608700 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1246f0b0-ea8e-452a-87cf-1d51c227a7ef tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:13.627296 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1246f0b0-ea8e-452a-87cf-1d51c227a7ef tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:13.631531 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1246f0b0-ea8e-452a-87cf-1d51c227a7ef tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:13.640669 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1246f0b0-ea8e-452a-87cf-1d51c227a7ef tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:13.907451 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-0d0d30c3-31e7-4b6e-924c-8114335843fb req-72ecbbeb-0aa1-4b99-b843-a26f7ce69407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d33c522d-8fb2-4c37-a15c-e1af48406b09", "tag": "59329a00-c78e-4af9-81f7-04ede23e4f24"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:13.958839 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-0d0d30c3-31e7-4b6e-924c-8114335843fb req-72ecbbeb-0aa1-4b99-b843-a26f7ce69407 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:13.969390 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-0d0d30c3-31e7-4b6e-924c-8114335843fb req-72ecbbeb-0aa1-4b99-b843-a26f7ce69407 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:14.019605 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-0d0d30c3-31e7-4b6e-924c-8114335843fb req-72ecbbeb-0aa1-4b99-b843-a26f7ce69407 service nova] Creating event network-changed:59329a00-c78e-4af9-81f7-04ede23e4f24 for instance d33c522d-8fb2-4c37-a15c-e1af48406b09 on n-h1-836830-4 Jun 16 14:52:14.049565 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-0d0d30c3-31e7-4b6e-924c-8114335843fb req-72ecbbeb-0aa1-4b99-b843-a26f7ce69407 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146636 Jun 16 14:52:14.083042 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1385/2666] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:52:14.132131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9a7e7755-90df-46f7-9dbc-764e8a03e41d tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffe86430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:14.236650 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9a7e7755-90df-46f7-9dbc-764e8a03e41d tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.150359 Jun 16 14:52:14.239138 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1386/2667] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:14 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:15.257922 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-91c76a01-0f6a-4f74-9787-d47ca5dcc399 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffe588b0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:15.451826 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-91c76a01-0f6a-4f74-9787-d47ca5dcc399 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.198492 Jun 16 14:52:15.461150 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1387/2668] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:15 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:16.799821 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0eba26dc-52b4-4e17-a439-f72c7108faa3 tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] 10.222.0.57 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 1.043787 Jun 16 14:52:16.823318 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1388/2669] 10.222.0.57 () {58 vars in 1127 bytes} [Thu Jun 16 14:52:15 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 1074 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 14:52:16.828964 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-fa34ed88-1edf-40ee-ab28-2f492cf1c6d6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffa93430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:16.950782 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-fa34ed88-1edf-40ee-ab28-2f492cf1c6d6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.125317 Jun 16 14:52:16.967035 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1389/2670] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:16 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:16.972543 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1246f0b0-ea8e-452a-87cf-1d51c227a7ef tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:16.987427 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e20b2a86-83df-482d-9a69-ddba2828330b tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] Calling method '.version_select at 0x7fdeffa93b80>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:16.990314 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1246f0b0-ea8e-452a-87cf-1d51c227a7ef tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:16.992038 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1246f0b0-ea8e-452a-87cf-1d51c227a7ef tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:16.993296 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1246f0b0-ea8e-452a-87cf-1d51c227a7ef tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1869 microversion: 2.32 time: 3.424804 Jun 16 14:52:16.999672 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1282/2671] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:13 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1869 bytes in 3432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:17.093324 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-e20b2a86-83df-482d-9a69-ddba2828330b tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] HTTP exception thrown: Image not found. Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e20b2a86-83df-482d-9a69-ddba2828330b tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] Request method failure captured: Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0OfKzH4VIV_l7WuunRCcaqeb8GmWmIJp_XfXu0utW7zGIcWFgy9K3NrtudzQ_W7dGb-b2xOMmTqS_G1DI-C4uNQlIRvgfaAgOAcYFmyy_TgYHBtNguOfwpRGZL5Lj9WIv4EsZthg-inuz0mZakYZNZndOHycBOWlpvhCA7CI7n2n_U Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 908219c47da043168726ce7e2a1bde2a Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-292042042 Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_908219c47da043168726ce7e2a1bde2a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/908219c47da043168726ce7e2a1bde2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/908219c47da043168726ce7e2a1bde2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/908219c47da043168726ce7e2a1bde2a"}]}] Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-292042042 Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 908219c47da043168726ce7e2a1bde2a Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-292042042 Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesDeleteNegativeTestJSON-292042042-project Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: d04698779a754bfa9e0a5113edce23ba Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-292042042-project Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: exception: Image not found. Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '-1'} Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.099137 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.103220 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e20b2a86-83df-482d-9a69-ddba2828330b tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] Returning 404 to user: Image not found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:52:17.110989 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e20b2a86-83df-482d-9a69-ddba2828330b tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] 10.222.0.57 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.135496 Jun 16 14:52:17.114652 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1390/2672] 10.222.0.57 () {58 vars in 1133 bytes} [Thu Jun 16 14:52:16 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:52:17.125401 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-69406f8a-a29c-4b56-a3cb-40e989b6abad tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] Calling method '.version_select at 0x7fdeff25daf0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:17.178358 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-69406f8a-a29c-4b56-a3cb-40e989b6abad tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] HTTP exception thrown: Image not found. Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-69406f8a-a29c-4b56-a3cb-40e989b6abad tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] Request method failure captured: Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/images/0a1ba4fe-4188-44de-9e92-fe1f4ee0745j HTTP/1.1 Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0OfKzH4VIV_l7WuunRCcaqeb8GmWmIJp_XfXu0utW7zGIcWFgy9K3NrtudzQ_W7dGb-b2xOMmTqS_G1DI-C4uNQlIRvgfaAgOAcYFmyy_TgYHBtNguOfwpRGZL5Lj9WIv4EsZthg-inuz0mZakYZNZndOHycBOWlpvhCA7CI7n2n_U Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 908219c47da043168726ce7e2a1bde2a Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-292042042 Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_908219c47da043168726ce7e2a1bde2a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/908219c47da043168726ce7e2a1bde2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/908219c47da043168726ce7e2a1bde2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/908219c47da043168726ce7e2a1bde2a"}]}] Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-292042042 Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 908219c47da043168726ce7e2a1bde2a Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-292042042 Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesDeleteNegativeTestJSON-292042042-project Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: d04698779a754bfa9e0a5113edce23ba Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-292042042-project Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: exception: Image not found. Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '0a1ba4fe-4188-44de-9e92-fe1f4ee0745j'} Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0a1ba4fe-4188-44de-9e92-fe1f4ee0745j to delete Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0a1ba4fe-4188-44de-9e92-fe1f4ee0745j could not be found. Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:17.180302 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-69406f8a-a29c-4b56-a3cb-40e989b6abad tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] Returning 404 to user: Image not found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-69406f8a-a29c-4b56-a3cb-40e989b6abad tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] 10.222.0.57 "DELETE /compute/v2.1/images/0a1ba4fe-4188-44de-9e92-fe1f4ee0745j" status: 404 len: 62 microversion: 2.1 time: 0.061148 Jun 16 14:52:17.184136 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1283/2673] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:17 2022] DELETE /compute/v2.1/images/0a1ba4fe-4188-44de-9e92-fe1f4ee0745j => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 14:52:17.212915 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9e83a571-b608-4e8b-8743-10b619fd9f02 tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] Calling method '.version_select at 0x7fdeffa934c0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:17.258248 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-9e83a571-b608-4e8b-8743-10b619fd9f02 tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] HTTP exception thrown: Image not found. Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9e83a571-b608-4e8b-8743-10b619fd9f02 tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] Request method failure captured: Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/images/9d9113fd-3bef-4ec5-9aa6-a0baa6e5dd431 HTTP/1.1 Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0OfKzH4VIV_l7WuunRCcaqeb8GmWmIJp_XfXu0utW7zGIcWFgy9K3NrtudzQ_W7dGb-b2xOMmTqS_G1DI-C4uNQlIRvgfaAgOAcYFmyy_TgYHBtNguOfwpRGZL5Lj9WIv4EsZthg-inuz0mZakYZNZndOHycBOWlpvhCA7CI7n2n_U Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 908219c47da043168726ce7e2a1bde2a Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-292042042 Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_908219c47da043168726ce7e2a1bde2a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/908219c47da043168726ce7e2a1bde2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/908219c47da043168726ce7e2a1bde2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/908219c47da043168726ce7e2a1bde2a"}]}] Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-292042042 Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 908219c47da043168726ce7e2a1bde2a Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-292042042 Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesDeleteNegativeTestJSON-292042042-project Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: d04698779a754bfa9e0a5113edce23ba Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-292042042-project Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: exception: Image not found. Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '9d9113fd-3bef-4ec5-9aa6-a0baa6e5dd431'} Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9d9113fd-3bef-4ec5-9aa6-a0baa6e5dd431 to delete Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9d9113fd-3bef-4ec5-9aa6-a0baa6e5dd431 could not be found. Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:17.263059 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:52:17.267024 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.275283 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9e83a571-b608-4e8b-8743-10b619fd9f02 tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] Returning 404 to user: Image not found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:52:17.279427 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9e83a571-b608-4e8b-8743-10b619fd9f02 tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] 10.222.0.57 "DELETE /compute/v2.1/images/9d9113fd-3bef-4ec5-9aa6-a0baa6e5dd431" status: 404 len: 62 microversion: 2.1 time: 0.086793 Jun 16 14:52:17.281626 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1391/2674] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:52:17 2022] DELETE /compute/v2.1/images/9d9113fd-3bef-4ec5-9aa6-a0baa6e5dd431 => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:52:17.295906 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-865e224d-e386-443f-891e-ec799743981e tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] Calling method '.version_select at 0x7fdeff23c160>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:17.417938 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-865e224d-e386-443f-891e-ec799743981e tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] HTTP exception thrown: Image not found. Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-865e224d-e386-443f-891e-ec799743981e tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] Request method failure captured: Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: request: DELETE /compute/v2.1/images/tempest-invalid-1569147967 HTTP/1.1 Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0OfKzH4VIV_l7WuunRCcaqeb8GmWmIJp_XfXu0utW7zGIcWFgy9K3NrtudzQ_W7dGb-b2xOMmTqS_G1DI-C4uNQlIRvgfaAgOAcYFmyy_TgYHBtNguOfwpRGZL5Lj9WIv4EsZthg-inuz0mZakYZNZndOHycBOWlpvhCA7CI7n2n_U Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 908219c47da043168726ce7e2a1bde2a Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-292042042 Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_908219c47da043168726ce7e2a1bde2a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/908219c47da043168726ce7e2a1bde2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/908219c47da043168726ce7e2a1bde2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/908219c47da043168726ce7e2a1bde2a"}]}] Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-292042042 Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 908219c47da043168726ce7e2a1bde2a Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-292042042 Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ImagesDeleteNegativeTestJSON-292042042-project Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: d04698779a754bfa9e0a5113edce23ba Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-292042042-project Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: exception: Image not found. Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'tempest-invalid-1569147967'} Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1569147967 to delete Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1569147967 could not be found. Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.420766 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:52:17.428042 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.432108 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-865e224d-e386-443f-891e-ec799743981e tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] Returning 404 to user: Image not found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:52:17.433473 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-865e224d-e386-443f-891e-ec799743981e tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] 10.222.0.57 "DELETE /compute/v2.1/images/tempest-invalid-1569147967" status: 404 len: 62 microversion: 2.1 time: 0.142266 Jun 16 14:52:17.434751 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1284/2675] 10.222.0.57 () {58 vars in 1205 bytes} [Thu Jun 16 14:52:17 2022] DELETE /compute/v2.1/images/tempest-invalid-1569147967 => generated 62 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:52:17.452295 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a9166669-9272-4d7d-bae9-d56952147955 tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] Calling method '.version_select at 0x7fdeffe0a0d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:17.538560 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-a9166669-9272-4d7d-bae9-d56952147955 tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] HTTP exception thrown: Image not found. Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a9166669-9272-4d7d-bae9-d56952147955 tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] Request method failure captured: Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/images/456f9f5d-d814-4d8b-9f90-049d9c1da63a HTTP/1.1 Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0OfKzH4VIV_l7WuunRCcaqeb8GmWmIJp_XfXu0utW7zGIcWFgy9K3NrtudzQ_W7dGb-b2xOMmTqS_G1DI-C4uNQlIRvgfaAgOAcYFmyy_TgYHBtNguOfwpRGZL5Lj9WIv4EsZthg-inuz0mZakYZNZndOHycBOWlpvhCA7CI7n2n_U Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 908219c47da043168726ce7e2a1bde2a Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-292042042 Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_908219c47da043168726ce7e2a1bde2a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/908219c47da043168726ce7e2a1bde2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/908219c47da043168726ce7e2a1bde2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/908219c47da043168726ce7e2a1bde2a"}]}] Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-292042042 Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 908219c47da043168726ce7e2a1bde2a Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-292042042 Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesDeleteNegativeTestJSON-292042042-project Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: d04698779a754bfa9e0a5113edce23ba Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-292042042-project Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: exception: Image not found. Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '456f9f5d-d814-4d8b-9f90-049d9c1da63a'} Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 456f9f5d-d814-4d8b-9f90-049d9c1da63a to delete Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 456f9f5d-d814-4d8b-9f90-049d9c1da63a could not be found. Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:17.540873 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a9166669-9272-4d7d-bae9-d56952147955 tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] Returning 404 to user: Image not found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a9166669-9272-4d7d-bae9-d56952147955 tempest-ImagesDeleteNegativeTestJSON-292042042 tempest-ImagesDeleteNegativeTestJSON-292042042-project] 10.222.0.57 "DELETE /compute/v2.1/images/456f9f5d-d814-4d8b-9f90-049d9c1da63a" status: 404 len: 62 microversion: 2.1 time: 0.094131 Jun 16 14:52:17.557515 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1392/2676] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:17 2022] DELETE /compute/v2.1/images/456f9f5d-d814-4d8b-9f90-049d9c1da63a => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:52:17.968896 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f8704492-50a3-4c5e-b48b-684c435c7057 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf0c2d2310>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:18.023440 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3e6c4e03-763b-4882-a0a7-5413e17c27ae tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:18.024149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3e6c4e03-763b-4882-a0a7-5413e17c27ae tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:18.071242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3e6c4e03-763b-4882-a0a7-5413e17c27ae tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:18.071933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3e6c4e03-763b-4882-a0a7-5413e17c27ae tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:18.086639 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3e6c4e03-763b-4882-a0a7-5413e17c27ae tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:18.093946 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3e6c4e03-763b-4882-a0a7-5413e17c27ae tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:18.123444 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f8704492-50a3-4c5e-b48b-684c435c7057 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.159636 Jun 16 14:52:18.125610 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1285/2677] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:17 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:52:18.800990 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3e6c4e03-763b-4882-a0a7-5413e17c27ae tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:18.850044 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3e6c4e03-763b-4882-a0a7-5413e17c27ae tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:18.853652 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3e6c4e03-763b-4882-a0a7-5413e17c27ae tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:18.867778 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3e6c4e03-763b-4882-a0a7-5413e17c27ae tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1869 microversion: 2.32 time: 0.847025 Jun 16 14:52:18.901062 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1393/2678] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:18 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1869 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:19.140376 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f67c5006-f259-4908-b6bc-601907164d48 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdefff944c0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:19.418172 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f67c5006-f259-4908-b6bc-601907164d48 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.282038 Jun 16 14:52:19.434044 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1394/2679] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:19 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:19.825342 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1099212876", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "fa630f7d-ec15-4174-919f-0a5bce1a9314"}]}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:19.913629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1ba9b998-419f-4f2f-8ae9-bcbae1e489a7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:19.927897 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1ba9b998-419f-4f2f-8ae9-bcbae1e489a7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:19.978253 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1ba9b998-419f-4f2f-8ae9-bcbae1e489a7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:19.996783 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1ba9b998-419f-4f2f-8ae9-bcbae1e489a7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:20.005422 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1ba9b998-419f-4f2f-8ae9-bcbae1e489a7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:20.037529 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1ba9b998-419f-4f2f-8ae9-bcbae1e489a7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:20.102258 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] validate_networks() for [('fa630f7d-ec15-4174-919f-0a5bce1a9314', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:52:21.093406 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1ba9b998-419f-4f2f-8ae9-bcbae1e489a7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:21.168740 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1ba9b998-419f-4f2f-8ae9-bcbae1e489a7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:21.187117 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1ba9b998-419f-4f2f-8ae9-bcbae1e489a7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:21.194516 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1ba9b998-419f-4f2f-8ae9-bcbae1e489a7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1890 microversion: 2.32 time: 1.289145 Jun 16 14:52:21.196001 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1395/2680] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:19 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1890 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:21.219082 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e6578143-66f7-49d7-b009-98acd443dc66 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffedd310>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:21.367511 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e6578143-66f7-49d7-b009-98acd443dc66 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.170115 Jun 16 14:52:21.370167 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1396/2681] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:21 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:22.229064 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6c80bcc0-a0e3-420b-936a-95fb467a4c04 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:22.230093 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6c80bcc0-a0e3-420b-936a-95fb467a4c04 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:22.253714 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c80bcc0-a0e3-420b-936a-95fb467a4c04 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:22.254195 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c80bcc0-a0e3-420b-936a-95fb467a4c04 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:22.264549 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c80bcc0-a0e3-420b-936a-95fb467a4c04 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:22.269631 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c80bcc0-a0e3-420b-936a-95fb467a4c04 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:24.044192 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:52:24.046878 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:52:24.047798 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:52:24.048514 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:52:24.049146 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:52:24.054667 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=52 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:24.172696 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:24.183237 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:24.191809 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:24.192365 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:24.325335 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Getting quotas for project aa0ce43c5ac64864b458514ebdc5ad1a. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:52:24.381052 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Getting quotas for user 2f53e4d9a56c47089527b650611fa453 and project aa0ce43c5ac64864b458514ebdc5ad1a. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:52:24.461549 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Going to run 3 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:52:24.473904 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 9d3e4c1a-dfce-477f-b0a6-990624d387cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:52:24.684815 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: a6f54e74-9834-449d-8a62-2f33df36a320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=9d3e4c1a-dfce-477f-b0a6-990624d387cb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:52:24.850503 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=a6f54e74-9834-449d-8a62-2f33df36a320,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:52:25.249386 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6c80bcc0-a0e3-420b-936a-95fb467a4c04 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:25.295802 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6c80bcc0-a0e3-420b-936a-95fb467a4c04 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:25.303536 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6c80bcc0-a0e3-420b-936a-95fb467a4c04 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:25.310596 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6c80bcc0-a0e3-420b-936a-95fb467a4c04 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1890 microversion: 2.32 time: 3.083600 Jun 16 14:52:25.315513 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1397/2682] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:22 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1890 bytes in 3089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:52:25.336780 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7bbcc32b-b16f-4082-ab48-64c30cd5ccda tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf0c6065e0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:25.435190 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7faa49ed-1647-4bb0-a6fa-ad0dcfdf595a tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.320045 Jun 16 14:52:25.443017 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1286/2683] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:52:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 6329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:52:25.468546 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-09a700d8-3bf3-46b0-a816-d42ceadffd18 req-2cb32a77-1d2c-4d14-a720-d28fd1204c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d33c522d-8fb2-4c37-a15c-e1af48406b09", "tag": "59215472-4985-4b78-b577-83b9797bacb4"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:25.499230 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7bbcc32b-b16f-4082-ab48-64c30cd5ccda tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.179478 Jun 16 14:52:25.501901 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1398/2684] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:25 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:25.517724 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-09a700d8-3bf3-46b0-a816-d42ceadffd18 req-2cb32a77-1d2c-4d14-a720-d28fd1204c1a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:25.519589 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-09a700d8-3bf3-46b0-a816-d42ceadffd18 req-2cb32a77-1d2c-4d14-a720-d28fd1204c1a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:25.524320 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-909c0a99-5039-4421-a6ef-1e1ab7f3c1a2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:25.551514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-909c0a99-5039-4421-a6ef-1e1ab7f3c1a2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:25.558166 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-909c0a99-5039-4421-a6ef-1e1ab7f3c1a2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Searching by: {'deleted': False, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a'} {{(pid=125862) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:52:25.598817 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-09a700d8-3bf3-46b0-a816-d42ceadffd18 req-2cb32a77-1d2c-4d14-a720-d28fd1204c1a service nova] Creating event network-changed:59215472-4985-4b78-b577-83b9797bacb4 for instance d33c522d-8fb2-4c37-a15c-e1af48406b09 on n-h1-836830-4 Jun 16 14:52:25.662271 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-09a700d8-3bf3-46b0-a816-d42ceadffd18 req-2cb32a77-1d2c-4d14-a720-d28fd1204c1a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216487 Jun 16 14:52:25.667861 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1287/2685] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:52:25.779353 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-909c0a99-5039-4421-a6ef-1e1ab7f3c1a2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:25.780133 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-909c0a99-5039-4421-a6ef-1e1ab7f3c1a2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:25.800789 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-909c0a99-5039-4421-a6ef-1e1ab7f3c1a2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:25.801490 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-909c0a99-5039-4421-a6ef-1e1ab7f3c1a2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:25.934319 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-909c0a99-5039-4421-a6ef-1e1ab7f3c1a2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.430874 Jun 16 14:52:25.942829 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1399/2686] 10.222.0.57 () {58 vars in 1124 bytes} [Thu Jun 16 14:52:25 2022] GET /compute/v2.1/servers => generated 1018 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:25.961071 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2886d108-2a8c-4b6a-b362-1e2d246fc3ec tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:25.962444 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2886d108-2a8c-4b6a-b362-1e2d246fc3ec tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:26.573305 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2886d108-2a8c-4b6a-b362-1e2d246fc3ec tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:26.592673 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2886d108-2a8c-4b6a-b362-1e2d246fc3ec tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1223 microversion: 2.1 time: 0.641596 Jun 16 14:52:26.594147 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1288/2687] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:25 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1223 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:26.623367 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-24eb95b6-3d94-497a-b119-52f983807059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:26.624610 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-24eb95b6-3d94-497a-b119-52f983807059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:26.653042 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-24eb95b6-3d94-497a-b119-52f983807059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:26.653892 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-24eb95b6-3d94-497a-b119-52f983807059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:26.667813 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-24eb95b6-3d94-497a-b119-52f983807059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:26.668722 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-24eb95b6-3d94-497a-b119-52f983807059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:26.695981 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:28.331229 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ef24bea6-cf9f-48b7-83b7-5a6e56268815 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:28.332843 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:28.332843 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:28.334225 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ef24bea6-cf9f-48b7-83b7-5a6e56268815 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:28.339611 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ef24bea6-cf9f-48b7-83b7-5a6e56268815 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:28.341278 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ef24bea6-cf9f-48b7-83b7-5a6e56268815 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:28.349906 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ef24bea6-cf9f-48b7-83b7-5a6e56268815 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:28.471345 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ef24bea6-cf9f-48b7-83b7-5a6e56268815 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 2.332937 Jun 16 14:52:28.479724 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1400/2688] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:52:26 2022] GET /compute/v2.1/os-services => generated 944 bytes in 2342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:52:28.532065 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-52e109a5-1e24-4c9f-95ee-a32970ad9d89 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffe11670>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:28.694726 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-24eb95b6-3d94-497a-b119-52f983807059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:28.781201 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-24eb95b6-3d94-497a-b119-52f983807059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:28.828309 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-24eb95b6-3d94-497a-b119-52f983807059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:28.835093 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-24eb95b6-3d94-497a-b119-52f983807059 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1890 microversion: 2.32 time: 2.237885 Jun 16 14:52:28.836027 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1289/2689] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:26 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1890 bytes in 2241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:28.865722 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-52e109a5-1e24-4c9f-95ee-a32970ad9d89 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.384520 Jun 16 14:52:28.866514 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1401/2690] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:28 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:28.869958 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-300988f1-f019-4064-9cf2-82dbe6e4932b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:28.873089 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-300988f1-f019-4064-9cf2-82dbe6e4932b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:28.881043 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9eacc198-6f36-4333-9b6b-10e95369ebbb tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:28.892950 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:28.892950 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:28.905129 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9eacc198-6f36-4333-9b6b-10e95369ebbb tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:28.916824 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9eacc198-6f36-4333-9b6b-10e95369ebbb tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:28.918118 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9eacc198-6f36-4333-9b6b-10e95369ebbb tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:28.921293 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9eacc198-6f36-4333-9b6b-10e95369ebbb tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:29.037555 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9eacc198-6f36-4333-9b6b-10e95369ebbb tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.169667 Jun 16 14:52:29.046533 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1402/2691] 10.222.0.57 () {58 vars in 1169 bytes} [Thu Jun 16 14:52:28 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:52:29.065918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b90ba3ee-56c6-415d-8939-c0f8c61d0d00 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:29.073656 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:29.073656 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:29.075598 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b90ba3ee-56c6-415d-8939-c0f8c61d0d00 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:29.076369 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b90ba3ee-56c6-415d-8939-c0f8c61d0d00 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:29.096051 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b90ba3ee-56c6-415d-8939-c0f8c61d0d00 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:29.097109 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b90ba3ee-56c6-415d-8939-c0f8c61d0d00 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:29.194794 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b90ba3ee-56c6-415d-8939-c0f8c61d0d00 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.132052 Jun 16 14:52:29.197057 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1403/2692] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:52:29 2022] GET /compute/v2.1/os-services => generated 944 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:52:29.214946 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3d4ed581-8d47-4189-b57f-09138754db15 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:29.216939 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:29.216939 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:29.220788 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d4ed581-8d47-4189-b57f-09138754db15 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:29.222742 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d4ed581-8d47-4189-b57f-09138754db15 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:29.227422 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d4ed581-8d47-4189-b57f-09138754db15 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:29.230143 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d4ed581-8d47-4189-b57f-09138754db15 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:29.302460 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3d4ed581-8d47-4189-b57f-09138754db15 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?host=n-d-836830-4&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.093840 Jun 16 14:52:29.305449 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1404/2693] 10.222.0.57 () {58 vars in 1193 bytes} [Thu Jun 16 14:52:29 2022] GET /compute/v2.1/os-services?host=n-d-836830-4&binary=xxx => generated 16 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 14:52:29.327932 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3b42a88f-077c-4bc6-8434-4fa516e96edd tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:29.340332 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:29.340332 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:29.348973 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3b42a88f-077c-4bc6-8434-4fa516e96edd tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:29.351837 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3b42a88f-077c-4bc6-8434-4fa516e96edd tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:29.355091 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3b42a88f-077c-4bc6-8434-4fa516e96edd tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:29.356083 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3b42a88f-077c-4bc6-8434-4fa516e96edd tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:29.480674 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3b42a88f-077c-4bc6-8434-4fa516e96edd tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.161052 Jun 16 14:52:29.496255 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1405/2694] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:52:29 2022] GET /compute/v2.1/os-services => generated 944 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:52:29.508603 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3ead379c-18b5-4065-94be-4a19183965a0 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:29.512214 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:29.512214 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:29.519416 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3ead379c-18b5-4065-94be-4a19183965a0 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:29.521421 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3ead379c-18b5-4065-94be-4a19183965a0 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:29.523880 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3ead379c-18b5-4065-94be-4a19183965a0 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:29.525365 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3ead379c-18b5-4065-94be-4a19183965a0 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:29.600430 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-300988f1-f019-4064-9cf2-82dbe6e4932b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:29.609629 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-300988f1-f019-4064-9cf2-82dbe6e4932b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1223 microversion: 2.1 time: 0.757826 Jun 16 14:52:29.615897 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3ead379c-18b5-4065-94be-4a19183965a0 tempest-ServicesAdminNegativeTestJSON-841312246 tempest-ServicesAdminNegativeTestJSON-841312246-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.117432 Jun 16 14:52:29.621092 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1406/2695] 10.222.0.57 () {58 vars in 1197 bytes} [Thu Jun 16 14:52:29 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:52:29.634089 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1290/2696] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:28 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1223 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:29.867399 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a87f5a13-ac76-491e-b962-134590260a03 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:29.870874 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a87f5a13-ac76-491e-b962-134590260a03 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:29.903339 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a87f5a13-ac76-491e-b962-134590260a03 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:29.903809 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a87f5a13-ac76-491e-b962-134590260a03 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:29.904660 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a87f5a13-ac76-491e-b962-134590260a03 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:29.905089 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a87f5a13-ac76-491e-b962-134590260a03 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:30.676832 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-99cd9f41-d783-476c-b43c-6c3a95cd6f51 tempest-ServicesAdminNegativeTestJSON-1350717911 tempest-ServicesAdminNegativeTestJSON-1350717911-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:30.687060 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:30.687060 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:30.695340 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-99cd9f41-d783-476c-b43c-6c3a95cd6f51 tempest-ServicesAdminNegativeTestJSON-1350717911 tempest-ServicesAdminNegativeTestJSON-1350717911-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'aede2f361472445b8719651a7d34bd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71641c69fa1c438ca56daa6221126c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-99cd9f41-d783-476c-b43c-6c3a95cd6f51 tempest-ServicesAdminNegativeTestJSON-1350717911 tempest-ServicesAdminNegativeTestJSON-1350717911-project] Request method failure captured: Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0OmKiLC87AoOrxjzdUTu15jgRxkCwYi5qZANS7oL9EUuueBcnOnzyI8AYb8dbLBxelxcU6TCUOgCtF7hNlKjL0JCEbEs8Ya9UajIw41ftwe76z3pL6m1JkAlA7LzcjkfGoapPYH-5gZ0PpZBPI69uKdnWnuDAqwO-DzYM32iuUwRls Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 71641c69fa1c438ca56daa6221126c8d Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1350717911 Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_71641c69fa1c438ca56daa6221126c8d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/71641c69fa1c438ca56daa6221126c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/71641c69fa1c438ca56daa6221126c8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/71641c69fa1c438ca56daa6221126c8d"}]}] Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1350717911 Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 71641c69fa1c438ca56daa6221126c8d Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1350717911 Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ServicesAdminNegativeTestJSON-1350717911-project Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: aede2f361472445b8719651a7d34bd1a Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1350717911-project Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: action_args: {} Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 16 14:52:30.711090 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:30.724207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:30.724207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:30.724207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:30.724207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:30.724207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:30.724207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:52:30.724207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:52:30.724207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 16 14:52:30.724207 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:30.731845 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-99cd9f41-d783-476c-b43c-6c3a95cd6f51 tempest-ServicesAdminNegativeTestJSON-1350717911 tempest-ServicesAdminNegativeTestJSON-1350717911-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:52:30.732619 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-99cd9f41-d783-476c-b43c-6c3a95cd6f51 tempest-ServicesAdminNegativeTestJSON-1350717911 tempest-ServicesAdminNegativeTestJSON-1350717911-project] 10.222.0.57 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 1.092580 Jun 16 14:52:30.745254 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1407/2697] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:52:29 2022] GET /compute/v2.1/os-services => generated 112 bytes in 1108 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:52:30.759486 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-807118b5-ae41-4aeb-9853-2055a5b6f111 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffdad310>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:30.941807 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-807118b5-ae41-4aeb-9853-2055a5b6f111 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.194371 Jun 16 14:52:30.954435 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1408/2698] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:30 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:30.977145 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-646e77cb-edd1-43ac-a034-667fc1c7fcf5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:30.983616 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-646e77cb-edd1-43ac-a034-667fc1c7fcf5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:31.045883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-646e77cb-edd1-43ac-a034-667fc1c7fcf5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:31.048824 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-646e77cb-edd1-43ac-a034-667fc1c7fcf5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:31.050482 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-646e77cb-edd1-43ac-a034-667fc1c7fcf5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:31.053478 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-646e77cb-edd1-43ac-a034-667fc1c7fcf5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:31.294993 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-646e77cb-edd1-43ac-a034-667fc1c7fcf5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:31.321409 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-646e77cb-edd1-43ac-a034-667fc1c7fcf5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1275 microversion: 2.1 time: 0.360951 Jun 16 14:52:31.337966 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1409/2699] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:30 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1275 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:31.349035 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-be86148d-4637-4ad6-a7ff-784d760ccd4d req-f9e62528-cefe-43b3-a37e-a7e0ff2e3a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d33c522d-8fb2-4c37-a15c-e1af48406b09", "tag": "02831d3d-c073-4baa-972f-887b4ac2e4eb"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:31.368844 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:31.403854 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-be86148d-4637-4ad6-a7ff-784d760ccd4d req-f9e62528-cefe-43b3-a37e-a7e0ff2e3a12 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:31.409108 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-be86148d-4637-4ad6-a7ff-784d760ccd4d req-f9e62528-cefe-43b3-a37e-a7e0ff2e3a12 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:31.451621 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-be86148d-4637-4ad6-a7ff-784d760ccd4d req-f9e62528-cefe-43b3-a37e-a7e0ff2e3a12 service nova] Creating event network-changed:02831d3d-c073-4baa-972f-887b4ac2e4eb for instance d33c522d-8fb2-4c37-a15c-e1af48406b09 on n-h1-836830-4 Jun 16 14:52:31.485029 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-be86148d-4637-4ad6-a7ff-784d760ccd4d req-f9e62528-cefe-43b3-a37e-a7e0ff2e3a12 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145200 Jun 16 14:52:31.499790 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1410/2700] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:52:31.968124 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-79eeb7be-d896-41c7-9a62-234e894a8ca0 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffa93160>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:32.147763 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-79eeb7be-d896-41c7-9a62-234e894a8ca0 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.183609 Jun 16 14:52:32.157500 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1411/2701] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:31 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:52:32.191519 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a87f5a13-ac76-491e-b962-134590260a03 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:32.222717 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a87f5a13-ac76-491e-b962-134590260a03 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:32.230739 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a87f5a13-ac76-491e-b962-134590260a03 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:32.232026 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a87f5a13-ac76-491e-b962-134590260a03 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1890 microversion: 2.32 time: 2.369697 Jun 16 14:52:32.254909 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1291/2702] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:29 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1890 bytes in 2380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:32.347001 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0d2370ee-9f6c-47e0-a4b4-1fed1eec9c80 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:32.348043 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0d2370ee-9f6c-47e0-a4b4-1fed1eec9c80 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:32.358856 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0d2370ee-9f6c-47e0-a4b4-1fed1eec9c80 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:32.360326 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0d2370ee-9f6c-47e0-a4b4-1fed1eec9c80 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:32.361386 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0d2370ee-9f6c-47e0-a4b4-1fed1eec9c80 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:32.362945 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0d2370ee-9f6c-47e0-a4b4-1fed1eec9c80 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:32.461891 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0d2370ee-9f6c-47e0-a4b4-1fed1eec9c80 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:32.474511 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0d2370ee-9f6c-47e0-a4b4-1fed1eec9c80 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1293 microversion: 2.1 time: 0.135993 Jun 16 14:52:32.475943 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1412/2703] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:32 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1293 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:52:33.167228 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-06375776-fb63-4102-a548-05a2f81add01 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffa93280>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:33.244579 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5f783324-4daf-4f45-967e-663ca775ac37 tempest-ListImageFiltersNegativeTestJSON-502315966 tempest-ListImageFiltersNegativeTestJSON-502315966-project] Calling method '.version_select at 0x7fdeff1e2820>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:33.294199 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-06375776-fb63-4102-a548-05a2f81add01 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.131701 Jun 16 14:52:33.297006 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1413/2704] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:33 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:52:33.317571 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c3d88a54-b4b2-4184-81a8-7084f57ee530 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:33.319976 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c3d88a54-b4b2-4184-81a8-7084f57ee530 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:33.343683 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c3d88a54-b4b2-4184-81a8-7084f57ee530 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:33.352306 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-5f783324-4daf-4f45-967e-663ca775ac37 tempest-ListImageFiltersNegativeTestJSON-502315966 tempest-ListImageFiltersNegativeTestJSON-502315966-project] HTTP exception thrown: Image not found. Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5f783324-4daf-4f45-967e-663ca775ac37 tempest-ListImageFiltersNegativeTestJSON-502315966 tempest-ListImageFiltersNegativeTestJSON-502315966-project] Request method failure captured: Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/images/53e375b6-e097-4b34-9961-68a69ba141ad HTTP/1.1 Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0OwIHxLhBYmaI3zcbRhRF7fhG1QaEWYB7jg5DSH2jPJOxsKXKOy0jPqe0QwY22HnkGsZXir7RRpByAUHYbdV5bRWagLH3H52fB3YEsZ2MZJ4TcWPiuVE-AoQsgdCpZvboVtrgViQG6SUKSUjBgnAb4gpnO4-lrlTRunySTRTLT_OG0 Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: b6a0c90b0eab42d488d8ac746a335d47 Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-502315966 Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_b6a0c90b0eab42d488d8ac746a335d47", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b6a0c90b0eab42d488d8ac746a335d47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/b6a0c90b0eab42d488d8ac746a335d47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/b6a0c90b0eab42d488d8ac746a335d47"}]}] Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-502315966 Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: b6a0c90b0eab42d488d8ac746a335d47 Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-502315966 Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ListImageFiltersNegativeTestJSON-502315966-project Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: e2a648899d8c4489ba84cabe6c07ea81 Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-502315966-project Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: exception: Image not found. Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '53e375b6-e097-4b34-9961-68a69ba141ad'} Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 53e375b6-e097-4b34-9961-68a69ba141ad Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 16 14:52:33.356041 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 53e375b6-e097-4b34-9961-68a69ba141ad could not be found. Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:52:33.361493 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:33.373577 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5f783324-4daf-4f45-967e-663ca775ac37 tempest-ListImageFiltersNegativeTestJSON-502315966 tempest-ListImageFiltersNegativeTestJSON-502315966-project] Returning 404 to user: Image not found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:52:33.374804 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5f783324-4daf-4f45-967e-663ca775ac37 tempest-ListImageFiltersNegativeTestJSON-502315966 tempest-ListImageFiltersNegativeTestJSON-502315966-project] 10.222.0.57 "GET /compute/v2.1/images/53e375b6-e097-4b34-9961-68a69ba141ad" status: 404 len: 62 microversion: 2.1 time: 0.778907 Jun 16 14:52:33.378461 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1292/2705] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:32 2022] GET /compute/v2.1/images/53e375b6-e097-4b34-9961-68a69ba141ad => generated 62 bytes in 784 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 14:52:33.378668 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c3d88a54-b4b2-4184-81a8-7084f57ee530 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:33.392817 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c3d88a54-b4b2-4184-81a8-7084f57ee530 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:33.393476 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c3d88a54-b4b2-4184-81a8-7084f57ee530 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:33.507879 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-a59aab33-ed52-45cd-8151-6cf75046c422 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:33.509033 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-a59aab33-ed52-45cd-8151-6cf75046c422 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:33.608837 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a59aab33-ed52-45cd-8151-6cf75046c422 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:33.616469 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a59aab33-ed52-45cd-8151-6cf75046c422 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:33.617929 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a59aab33-ed52-45cd-8151-6cf75046c422 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:33.618760 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-a59aab33-ed52-45cd-8151-6cf75046c422 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:34.261369 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:34.643553 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-a59aab33-ed52-45cd-8151-6cf75046c422 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:34.664643 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c3d88a54-b4b2-4184-81a8-7084f57ee530 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:34.668308 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-a59aab33-ed52-45cd-8151-6cf75046c422 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1281 microversion: 2.1 time: 1.171202 Jun 16 14:52:34.669379 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1293/2706] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:33 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1281 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:34.675486 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:34.684898 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2cb4fbc4-0aa6-4a3e-96d9-9ee32baf0d60 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeff1e2ca0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:34.717621 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c3d88a54-b4b2-4184-81a8-7084f57ee530 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:34.726973 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c3d88a54-b4b2-4184-81a8-7084f57ee530 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:34.734413 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c3d88a54-b4b2-4184-81a8-7084f57ee530 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1890 microversion: 2.32 time: 1.433727 Jun 16 14:52:34.757417 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1414/2707] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:33 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1890 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:34.866767 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2cb4fbc4-0aa6-4a3e-96d9-9ee32baf0d60 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.192962 Jun 16 14:52:34.876524 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1294/2708] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:34 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:35.041682 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1cae141d-5c07-4ba7-8f7d-d4bd29495792 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:35.042845 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1cae141d-5c07-4ba7-8f7d-d4bd29495792 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:35.051233 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1cae141d-5c07-4ba7-8f7d-d4bd29495792 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:35.052130 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1cae141d-5c07-4ba7-8f7d-d4bd29495792 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:35.053390 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1cae141d-5c07-4ba7-8f7d-d4bd29495792 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:35.054153 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1cae141d-5c07-4ba7-8f7d-d4bd29495792 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:35.160377 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1cae141d-5c07-4ba7-8f7d-d4bd29495792 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:52:35.587897 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1cae141d-5c07-4ba7-8f7d-d4bd29495792 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 204 len: 0 microversion: 2.1 time: 0.548252 Jun 16 14:52:35.591736 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1415/2709] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:52:35 2022] DELETE /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:52:35.604624 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0f6340d3-546a-4111-8a49-c674d42410d7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:35.605861 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0f6340d3-546a-4111-8a49-c674d42410d7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:35.623605 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0f6340d3-546a-4111-8a49-c674d42410d7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:35.635375 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0f6340d3-546a-4111-8a49-c674d42410d7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:35.636677 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0f6340d3-546a-4111-8a49-c674d42410d7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:35.639839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0f6340d3-546a-4111-8a49-c674d42410d7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:35.700315 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0b11530f-4941-4c7c-9b4b-80b9737e7584 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:35.702348 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0b11530f-4941-4c7c-9b4b-80b9737e7584 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:35.732783 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b11530f-4941-4c7c-9b4b-80b9737e7584 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:35.734767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b11530f-4941-4c7c-9b4b-80b9737e7584 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:35.741767 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b11530f-4941-4c7c-9b4b-80b9737e7584 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:35.744345 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0b11530f-4941-4c7c-9b4b-80b9737e7584 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:36.086772 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0b11530f-4941-4c7c-9b4b-80b9737e7584 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:36.096260 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0b11530f-4941-4c7c-9b4b-80b9737e7584 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1281 microversion: 2.1 time: 0.402306 Jun 16 14:52:36.107759 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1416/2710] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:35 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1281 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:36.115133 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3dc3bdda-48d1-41be-b090-1526a26286c9 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:36.117011 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3dc3bdda-48d1-41be-b090-1526a26286c9 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:36.124670 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3dc3bdda-48d1-41be-b090-1526a26286c9 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:36.126161 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3dc3bdda-48d1-41be-b090-1526a26286c9 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:36.131038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3dc3bdda-48d1-41be-b090-1526a26286c9 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:36.138860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3dc3bdda-48d1-41be-b090-1526a26286c9 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:36.760443 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3dc3bdda-48d1-41be-b090-1526a26286c9 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:36.790129 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3dc3bdda-48d1-41be-b090-1526a26286c9 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:36.799403 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3dc3bdda-48d1-41be-b090-1526a26286c9 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:36.803248 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3dc3bdda-48d1-41be-b090-1526a26286c9 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 0.693803 Jun 16 14:52:36.806436 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1417/2711] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:36 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:36.830448 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e921324a-6013-4daf-85e4-b2c007e773d3 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffa36040>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:36.927266 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e921324a-6013-4daf-85e4-b2c007e773d3 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.117959 Jun 16 14:52:36.933630 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1418/2712] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:36 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:37.118005 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e2e1d520-90ec-450e-a5f2-2cd710779b9c tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:37.119635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e2e1d520-90ec-450e-a5f2-2cd710779b9c tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:37.133495 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e2e1d520-90ec-450e-a5f2-2cd710779b9c tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:37.137165 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e2e1d520-90ec-450e-a5f2-2cd710779b9c tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:37.139554 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e2e1d520-90ec-450e-a5f2-2cd710779b9c tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:37.140220 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e2e1d520-90ec-450e-a5f2-2cd710779b9c tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:37.285438 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e2e1d520-90ec-450e-a5f2-2cd710779b9c tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:37.316523 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e2e1d520-90ec-450e-a5f2-2cd710779b9c tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1281 microversion: 2.1 time: 0.203432 Jun 16 14:52:37.325810 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1419/2713] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:37 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1281 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:52:37.414360 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0f6340d3-546a-4111-8a49-c674d42410d7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:37.435828 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0f6340d3-546a-4111-8a49-c674d42410d7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1553 microversion: 2.1 time: 1.836629 Jun 16 14:52:37.439761 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1295/2714] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:35 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1553 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:37.828084 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-35e7f117-1c5f-4e6b-83fc-c983fb74ecdb tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:37.830147 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-35e7f117-1c5f-4e6b-83fc-c983fb74ecdb tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:37.854033 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35e7f117-1c5f-4e6b-83fc-c983fb74ecdb tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:37.858425 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35e7f117-1c5f-4e6b-83fc-c983fb74ecdb tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:37.869840 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35e7f117-1c5f-4e6b-83fc-c983fb74ecdb tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:37.870883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-35e7f117-1c5f-4e6b-83fc-c983fb74ecdb tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:37.952995 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b262ff2e-bd6e-47de-8671-78d8c5101cf9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeff1e28b0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:38.213088 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b262ff2e-bd6e-47de-8671-78d8c5101cf9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.272992 Jun 16 14:52:38.213702 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1296/2715] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:37 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:38.338624 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-eba27bb7-0da8-4d66-a047-02e210a2a459 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:38.340209 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-eba27bb7-0da8-4d66-a047-02e210a2a459 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:38.364801 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eba27bb7-0da8-4d66-a047-02e210a2a459 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:38.374181 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eba27bb7-0da8-4d66-a047-02e210a2a459 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:38.379536 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eba27bb7-0da8-4d66-a047-02e210a2a459 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:38.380010 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-eba27bb7-0da8-4d66-a047-02e210a2a459 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:39.055955 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-35e7f117-1c5f-4e6b-83fc-c983fb74ecdb tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:39.075665 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-35e7f117-1c5f-4e6b-83fc-c983fb74ecdb tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:39.089103 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-35e7f117-1c5f-4e6b-83fc-c983fb74ecdb tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:39.098640 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-35e7f117-1c5f-4e6b-83fc-c983fb74ecdb tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 1.267345 Jun 16 14:52:39.112892 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1420/2716] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:37 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:52:39.121385 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a87c69e7-40a3-4af9-9074-38cda25ac955 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:39.122021 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a87c69e7-40a3-4af9-9074-38cda25ac955 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:39.141846 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a87c69e7-40a3-4af9-9074-38cda25ac955 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:39.142656 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a87c69e7-40a3-4af9-9074-38cda25ac955 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:39.145461 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a87c69e7-40a3-4af9-9074-38cda25ac955 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:39.147602 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a87c69e7-40a3-4af9-9074-38cda25ac955 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:39.155869 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-eba27bb7-0da8-4d66-a047-02e210a2a459 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:39.168733 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-eba27bb7-0da8-4d66-a047-02e210a2a459 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1281 microversion: 2.1 time: 0.837360 Jun 16 14:52:39.177376 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1297/2717] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:38 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1281 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:39.231871 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-09c36a2b-2c9f-4dfc-a592-50c6666a4198 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeff1e2e50>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:39.410132 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-09c36a2b-2c9f-4dfc-a592-50c6666a4198 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.185689 Jun 16 14:52:39.421247 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1298/2718] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:39 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:39.558073 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=14 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:40.121528 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f969250b-972d-4893-bf21-982dcb6aec0b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:40.124064 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-f969250b-972d-4893-bf21-982dcb6aec0b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:40.131516 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=10 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:40.176919 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f969250b-972d-4893-bf21-982dcb6aec0b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:40.180498 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f969250b-972d-4893-bf21-982dcb6aec0b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:40.182904 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f969250b-972d-4893-bf21-982dcb6aec0b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:40.191224 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-f969250b-972d-4893-bf21-982dcb6aec0b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:40.676962 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a87c69e7-40a3-4af9-9074-38cda25ac955 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:40.711067 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a87c69e7-40a3-4af9-9074-38cda25ac955 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1553 microversion: 2.1 time: 1.596645 Jun 16 14:52:40.724810 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1421/2719] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:39 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1553 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:40.744787 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f203ffd5-1b3d-426f-9d41-78be62c3a3cb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:40.756065 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f203ffd5-1b3d-426f-9d41-78be62c3a3cb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:40.787346 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f203ffd5-1b3d-426f-9d41-78be62c3a3cb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:40.788915 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f203ffd5-1b3d-426f-9d41-78be62c3a3cb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:40.790900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f203ffd5-1b3d-426f-9d41-78be62c3a3cb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:40.796058 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f203ffd5-1b3d-426f-9d41-78be62c3a3cb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:41.129920 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f203ffd5-1b3d-426f-9d41-78be62c3a3cb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:41.169226 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f203ffd5-1b3d-426f-9d41-78be62c3a3cb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1281 microversion: 2.1 time: 0.429920 Jun 16 14:52:41.171624 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1422/2720] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:40 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1281 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:41.202721 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c29202b5-1c50-48d7-a7db-9755c16695f6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffdaddc0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:41.442168 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c29202b5-1c50-48d7-a7db-9755c16695f6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.268113 Jun 16 14:52:41.448717 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1423/2721] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:41 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:41.762273 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1f241453-5899-4360-ab3e-9293ca36913b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:41.776135 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1f241453-5899-4360-ab3e-9293ca36913b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:41.841833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1f241453-5899-4360-ab3e-9293ca36913b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:41.847973 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1f241453-5899-4360-ab3e-9293ca36913b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:41.854534 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1f241453-5899-4360-ab3e-9293ca36913b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:41.863572 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1f241453-5899-4360-ab3e-9293ca36913b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:42.537146 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1f241453-5899-4360-ab3e-9293ca36913b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:42.615717 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1f241453-5899-4360-ab3e-9293ca36913b tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1511 microversion: 2.1 time: 0.858800 Jun 16 14:52:42.616859 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1424/2722] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:41 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1511 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:52:43.099241 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f969250b-972d-4893-bf21-982dcb6aec0b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:43.145232 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f969250b-972d-4893-bf21-982dcb6aec0b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:43.149196 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-f969250b-972d-4893-bf21-982dcb6aec0b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:43.159123 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f969250b-972d-4893-bf21-982dcb6aec0b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 3.036118 Jun 16 14:52:43.160279 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1299/2723] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:40 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 3046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:52:43.201604 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-cc7d0b39-4b6b-4e88-a487-a0abe47d427b tempest-AbsoluteLimitsNegativeTestJSON-547325667 tempest-AbsoluteLimitsNegativeTestJSON-547325667-project] Calling method '.version_select at 0x7fdeffdad0d0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:43.217946 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-0237ffa1-4ada-4d5d-b67c-7d5c3fb0ceb4 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:43.241075 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-0237ffa1-4ada-4d5d-b67c-7d5c3fb0ceb4 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:43.292947 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cc7d0b39-4b6b-4e88-a487-a0abe47d427b tempest-AbsoluteLimitsNegativeTestJSON-547325667 tempest-AbsoluteLimitsNegativeTestJSON-547325667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:43.298017 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cc7d0b39-4b6b-4e88-a487-a0abe47d427b tempest-AbsoluteLimitsNegativeTestJSON-547325667 tempest-AbsoluteLimitsNegativeTestJSON-547325667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:43.301034 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cc7d0b39-4b6b-4e88-a487-a0abe47d427b tempest-AbsoluteLimitsNegativeTestJSON-547325667 tempest-AbsoluteLimitsNegativeTestJSON-547325667-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:43.302988 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-cc7d0b39-4b6b-4e88-a487-a0abe47d427b tempest-AbsoluteLimitsNegativeTestJSON-547325667 tempest-AbsoluteLimitsNegativeTestJSON-547325667-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:43.305351 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0237ffa1-4ada-4d5d-b67c-7d5c3fb0ceb4 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:43.310739 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0237ffa1-4ada-4d5d-b67c-7d5c3fb0ceb4 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:43.314258 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0237ffa1-4ada-4d5d-b67c-7d5c3fb0ceb4 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:43.320839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-0237ffa1-4ada-4d5d-b67c-7d5c3fb0ceb4 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:43.389496 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-cc7d0b39-4b6b-4e88-a487-a0abe47d427b tempest-AbsoluteLimitsNegativeTestJSON-547325667 tempest-AbsoluteLimitsNegativeTestJSON-547325667-project] 10.222.0.57 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.760792 Jun 16 14:52:43.396058 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1425/2724] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jun 16 14:52:42 2022] GET /compute/v2.1/limits => generated 511 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:52:43.423727 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7226a110-7680-4779-94ec-bf42a6ec43db tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffe14160>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:43.601951 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7226a110-7680-4779-94ec-bf42a6ec43db tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.204241 Jun 16 14:52:43.604199 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1426/2725] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:43 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:43.804348 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1b392a5d-09a7-408a-aca3-e6130573d4c2 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Action: 'update', calling method: .version_select at 0x7fdeffa0c8b0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:43.806280 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:43.806280 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:43.807721 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1b392a5d-09a7-408a-aca3-e6130573d4c2 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:43.817362 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1b392a5d-09a7-408a-aca3-e6130573d4c2 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:43.867723 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-0237ffa1-4ada-4d5d-b67c-7d5c3fb0ceb4 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:43.877321 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-0237ffa1-4ada-4d5d-b67c-7d5c3fb0ceb4 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1281 microversion: 2.1 time: 0.692566 Jun 16 14:52:43.881956 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1b392a5d-09a7-408a-aca3-e6130573d4c2 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:43.886421 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1b392a5d-09a7-408a-aca3-e6130573d4c2 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:43.897279 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1300/2726] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:43 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1281 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:43.927608 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-36b6ff40-1069-4442-9898-d96e1b6ce5e5 req-0b8e7d51-3dc9-422f-93c2-f35990cd2a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6aba7d-22a7-4711-89b6-bee152b1ac6b", "name": "network-vif-deleted", "tag": "629943a5-6275-4c33-83f7-75df70f84598"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:43.947272 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-1b392a5d-09a7-408a-aca3-e6130573d4c2 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] HTTP exception thrown: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1b392a5d-09a7-408a-aca3-e6130573d4c2 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Request method failure captured: Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: request: PUT /compute/v2.1/os-services/2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e HTTP/1.1 Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 56 Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0O69heQwA0jOCDCKItx2ERGVtqJ5BMui6gdT8IvYyd_GS7iVLFPDiWDNs8KXdnAPUBYcuvYP-S7RXKdFKWDaCnbY16PNH_hJpgBole0tGVkBeoh4zzsxHu3Q4nDJN8D2TZP4p-amoi0A90rBpfetCT-d3csl7GSWnKcPGqITBUL4Lw Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Openstack-Nova-Api-Version: 2.53 Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: ae605537a349434d9be8155750edb43b Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1741452337 Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ae605537a349434d9be8155750edb43b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae605537a349434d9be8155750edb43b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae605537a349434d9be8155750edb43b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ae605537a349434d9be8155750edb43b"}]}] Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1741452337 Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: ae605537a349434d9be8155750edb43b Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1741452337 Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 601805e52d104586a633936f42d2e38b Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: {"status": "disabled", "disabled_reason": "maintenance"} Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: exception: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:52:43.964816 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:52:43.979427 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 16 14:52:43.979427 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:52:43.979427 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. Jun 16 14:52:43.979427 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:43.979427 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:43.979427 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:43.979427 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:43.979427 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:43.979427 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:43.979427 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:52:43.979427 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:52:43.979427 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. Jun 16 14:52:43.979427 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:43.981155 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-36b6ff40-1069-4442-9898-d96e1b6ce5e5 req-0b8e7d51-3dc9-422f-93c2-f35990cd2a66 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:43.981155 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-36b6ff40-1069-4442-9898-d96e1b6ce5e5 req-0b8e7d51-3dc9-422f-93c2-f35990cd2a66 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:43.981456 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1b392a5d-09a7-408a-aca3-e6130573d4c2 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Returning 404 to user: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:52:43.981456 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1b392a5d-09a7-408a-aca3-e6130573d4c2 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-services/2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e" status: 404 len: 110 microversion: 2.53 time: 0.363642 Jun 16 14:52:43.988790 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1427/2727] 10.222.0.57 () {62 vars in 1308 bytes} [Thu Jun 16 14:52:43 2022] PUT /compute/v2.1/os-services/2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e => generated 110 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:52:44.010615 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f15d820a-1d76-4f01-9680-a61d36b5b6fa tempest-AbsoluteLimitsNegativeTestJSON-547325667 tempest-AbsoluteLimitsNegativeTestJSON-547325667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-122427970", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:44.075040 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-36b6ff40-1069-4442-9898-d96e1b6ce5e5 req-0b8e7d51-3dc9-422f-93c2-f35990cd2a66 service nova] Creating event network-vif-deleted:629943a5-6275-4c33-83f7-75df70f84598 for instance 8c6aba7d-22a7-4711-89b6-bee152b1ac6b on n-h1-836830-4 Jun 16 14:52:44.129579 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-36b6ff40-1069-4442-9898-d96e1b6ce5e5 req-0b8e7d51-3dc9-422f-93c2-f35990cd2a66 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230291 Jun 16 14:52:44.141146 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1301/2728] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:52:44.171089 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-01eccab4-95f8-4082-8360-35e715117414 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:44.174621 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-01eccab4-95f8-4082-8360-35e715117414 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:44.215388 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01eccab4-95f8-4082-8360-35e715117414 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:44.222666 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01eccab4-95f8-4082-8360-35e715117414 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:44.228644 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01eccab4-95f8-4082-8360-35e715117414 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:44.228931 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-01eccab4-95f8-4082-8360-35e715117414 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:44.287675 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-f15d820a-1d76-4f01-9680-a61d36b5b6fa tempest-AbsoluteLimitsNegativeTestJSON-547325667 tempest-AbsoluteLimitsNegativeTestJSON-547325667-project] validate_networks() for None {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:52:45.586200 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-01eccab4-95f8-4082-8360-35e715117414 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:45.656735 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-01eccab4-95f8-4082-8360-35e715117414 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1345 microversion: 2.1 time: 1.495470 Jun 16 14:52:45.663849 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1302/2729] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:44 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1345 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:45.690138 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9973caf5-e4b5-4798-81f1-a2b46e84d7ad tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Action: 'update', calling method: .version_select at 0x7fdeff1e2310>, body: {"status": "disabled"} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:45.720212 n-d-836830-4 devstack@n-api.service[125863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:45.720212 n-d-836830-4 devstack@n-api.service[125863]: warnings.warn(msg) Jun 16 14:52:45.729038 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9973caf5-e4b5-4798-81f1-a2b46e84d7ad tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:45.736177 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9973caf5-e4b5-4798-81f1-a2b46e84d7ad tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:45.802236 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9973caf5-e4b5-4798-81f1-a2b46e84d7ad tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:45.803680 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9973caf5-e4b5-4798-81f1-a2b46e84d7ad tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:45.878297 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-9973caf5-e4b5-4798-81f1-a2b46e84d7ad tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] HTTP exception thrown: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9973caf5-e4b5-4798-81f1-a2b46e84d7ad tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Request method failure captured: Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: request: PUT /compute/v2.1/os-services/2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e HTTP/1.1 Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 22 Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0O69heQwA0jOCDCKItx2ERGVtqJ5BMui6gdT8IvYyd_GS7iVLFPDiWDNs8KXdnAPUBYcuvYP-S7RXKdFKWDaCnbY16PNH_hJpgBole0tGVkBeoh4zzsxHu3Q4nDJN8D2TZP4p-amoi0A90rBpfetCT-d3csl7GSWnKcPGqITBUL4Lw Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Openstack-Nova-Api-Version: 2.53 Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: ae605537a349434d9be8155750edb43b Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1741452337 Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Role: admin,member,reader Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: admin,member,reader Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ae605537a349434d9be8155750edb43b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae605537a349434d9be8155750edb43b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae605537a349434d9be8155750edb43b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ae605537a349434d9be8155750edb43b"}]}] Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1741452337 Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: ae605537a349434d9be8155750edb43b Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1741452337 Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 601805e52d104586a633936f42d2e38b Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: {"status": "disabled"} Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: method: Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: exception: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e', 'body': {'status': 'disabled'}} Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:52:45.895532 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:52:45.908851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 16 14:52:45.908851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:52:45.908851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. Jun 16 14:52:45.908851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:45.908851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:45.908851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:45.908851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:45.908851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:45.908851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:45.908851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:52:45.908851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:52:45.908851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. Jun 16 14:52:45.908851 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:52:45.915159 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9973caf5-e4b5-4798-81f1-a2b46e84d7ad tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Returning 404 to user: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:52:45.922421 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9973caf5-e4b5-4798-81f1-a2b46e84d7ad tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-services/2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e" status: 404 len: 110 microversion: 2.53 time: 0.255357 Jun 16 14:52:45.926933 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1303/2730] 10.222.0.57 () {62 vars in 1308 bytes} [Thu Jun 16 14:52:45 2022] PUT /compute/v2.1/os-services/2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e => generated 110 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:52:45.933938 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c75af515-6ebf-44c4-a6ad-d74a9adc6ee8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:45.935706 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c75af515-6ebf-44c4-a6ad-d74a9adc6ee8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:45.952097 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c75af515-6ebf-44c4-a6ad-d74a9adc6ee8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:45.953523 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c75af515-6ebf-44c4-a6ad-d74a9adc6ee8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:45.955454 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c75af515-6ebf-44c4-a6ad-d74a9adc6ee8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:45.956599 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c75af515-6ebf-44c4-a6ad-d74a9adc6ee8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:45.991675 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-f15d820a-1d76-4f01-9680-a61d36b5b6fa tempest-AbsoluteLimitsNegativeTestJSON-547325667 tempest-AbsoluteLimitsNegativeTestJSON-547325667-project] Getting quotas for project 60e3464df81b4d29b4eae46873495882. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:52:46.007349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-f15d820a-1d76-4f01-9680-a61d36b5b6fa tempest-AbsoluteLimitsNegativeTestJSON-547325667 tempest-AbsoluteLimitsNegativeTestJSON-547325667-project] Getting quotas for user 68570df80730452d9905e73026fb4ef8 and project 60e3464df81b4d29b4eae46873495882. Resources: dict_keys(['metadata_items']) {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:52:46.055808 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-f15d820a-1d76-4f01-9680-a61d36b5b6fa tempest-AbsoluteLimitsNegativeTestJSON-547325667 tempest-AbsoluteLimitsNegativeTestJSON-547325667-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f15d820a-1d76-4f01-9680-a61d36b5b6fa tempest-AbsoluteLimitsNegativeTestJSON-547325667 tempest-AbsoluteLimitsNegativeTestJSON-547325667-project] Request method failure captured: Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 1751 Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0O5PXG5_x_H2frtpyVTG4AI4XXdBMLYQPHCiufRt5jeBIenMcgHcTxZNB1Msg596Y31rQuqx1D4bkX6UHHLQ2VAoiPnZVLkdn5ogU717Uiv797YMSMMq21fxdG3-BA8EOWKdjWPucAmUficz7Mgan6zH6eQB0wQzJyCSSClv_j6YYI Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 60e3464df81b4d29b4eae46873495882 Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-547325667 Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_60e3464df81b4d29b4eae46873495882", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/60e3464df81b4d29b4eae46873495882"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/60e3464df81b4d29b4eae46873495882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/60e3464df81b4d29b4eae46873495882"}]}] Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-547325667 Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 60e3464df81b4d29b4eae46873495882 Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-547325667 Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-547325667-project Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 68570df80730452d9905e73026fb4ef8 Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-547325667-project Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-122427970", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:52:46.057955 n-d-836830-4 devstack@n-api.service[125862]: exception: Maximum number of metadata items exceeds 128 Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-122427970', 'imageRef': '3c5b2063-0858-477e-a4dd-6736a4c60e42', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:52:46.062081 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f15d820a-1d76-4f01-9680-a61d36b5b6fa tempest-AbsoluteLimitsNegativeTestJSON-547325667 tempest-AbsoluteLimitsNegativeTestJSON-547325667-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f15d820a-1d76-4f01-9680-a61d36b5b6fa tempest-AbsoluteLimitsNegativeTestJSON-547325667 tempest-AbsoluteLimitsNegativeTestJSON-547325667-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 2.069644 Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1428/2731] 10.222.0.57 () {60 vars in 1147 bytes} [Thu Jun 16 14:52:43 2022] POST /compute/v2.1/servers => generated 87 bytes in 2076 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:52:46.076813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b0c37d5f-224f-4155-9d53-86ec19d0ebc5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf1105f700>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:46.224941 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b0c37d5f-224f-4155-9d53-86ec19d0ebc5 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.158502 Jun 16 14:52:46.229966 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1429/2732] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:46 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:46.242231 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b1e0c990-a5f4-4aff-b368-d45715a6af4f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:46.251533 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b1e0c990-a5f4-4aff-b368-d45715a6af4f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:46.290848 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b1e0c990-a5f4-4aff-b368-d45715a6af4f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:46.292863 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b1e0c990-a5f4-4aff-b368-d45715a6af4f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:46.296034 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b1e0c990-a5f4-4aff-b368-d45715a6af4f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:46.298258 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b1e0c990-a5f4-4aff-b368-d45715a6af4f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:47.279599 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b1e0c990-a5f4-4aff-b368-d45715a6af4f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:47.297030 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b1e0c990-a5f4-4aff-b368-d45715a6af4f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1323 microversion: 2.1 time: 1.059618 Jun 16 14:52:47.303895 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1430/2733] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:46 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1323 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:47.338162 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-80930d32-0d9e-4782-a350-46c99aad5aba tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Action: 'update', calling method: .version_select at 0x7fdf1105f8b0>, body: {"status": "enabled"} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:47.342100 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:47.342100 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:47.346774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-80930d32-0d9e-4782-a350-46c99aad5aba tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:47.349248 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-80930d32-0d9e-4782-a350-46c99aad5aba tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:47.373656 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-80930d32-0d9e-4782-a350-46c99aad5aba tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:47.380541 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-80930d32-0d9e-4782-a350-46c99aad5aba tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:47.401716 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-80930d32-0d9e-4782-a350-46c99aad5aba tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] HTTP exception thrown: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-80930d32-0d9e-4782-a350-46c99aad5aba tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Request method failure captured: Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: request: PUT /compute/v2.1/os-services/2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e HTTP/1.1 Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 21 Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0O69heQwA0jOCDCKItx2ERGVtqJ5BMui6gdT8IvYyd_GS7iVLFPDiWDNs8KXdnAPUBYcuvYP-S7RXKdFKWDaCnbY16PNH_hJpgBole0tGVkBeoh4zzsxHu3Q4nDJN8D2TZP4p-amoi0A90rBpfetCT-d3csl7GSWnKcPGqITBUL4Lw Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Openstack-Nova-Api-Version: 2.53 Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: ae605537a349434d9be8155750edb43b Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1741452337 Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Role: admin,member,reader Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: admin,member,reader Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ae605537a349434d9be8155750edb43b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae605537a349434d9be8155750edb43b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae605537a349434d9be8155750edb43b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ae605537a349434d9be8155750edb43b"}]}] Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1741452337 Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: ae605537a349434d9be8155750edb43b Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1741452337 Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 601805e52d104586a633936f42d2e38b Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: {"status": "enabled"} Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: exception: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e', 'body': {'status': 'enabled'}} Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:52:47.404167 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:52:47.408313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 16 14:52:47.408313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:52:47.408313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. Jun 16 14:52:47.408313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:47.408313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:47.408313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:47.408313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:47.408313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:47.408313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:47.408313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:52:47.408313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:52:47.408313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. Jun 16 14:52:47.408313 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:47.413701 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-80930d32-0d9e-4782-a350-46c99aad5aba tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Returning 404 to user: Service 2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:52:47.419081 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-80930d32-0d9e-4782-a350-46c99aad5aba tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] 10.222.0.57 "PUT /compute/v2.1/os-services/2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e" status: 404 len: 110 microversion: 2.53 time: 0.099592 Jun 16 14:52:47.422366 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1431/2734] 10.222.0.57 () {62 vars in 1308 bytes} [Thu Jun 16 14:52:47 2022] PUT /compute/v2.1/os-services/2fd2f388-a2d5-4d4e-bf7c-5eef9e29c75e => generated 110 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:52:47.436455 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-992d7499-d70e-4926-97b1-7c91781993f2 req-28b80c58-c3f8-45b1-accc-180c2f81a5ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d33c522d-8fb2-4c37-a15c-e1af48406b09", "tag": "fb5abd93-9e7b-4e99-abcb-6470f0c9ec14"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:47.459724 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-992d7499-d70e-4926-97b1-7c91781993f2 req-28b80c58-c3f8-45b1-accc-180c2f81a5ee service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:47.462805 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-992d7499-d70e-4926-97b1-7c91781993f2 req-28b80c58-c3f8-45b1-accc-180c2f81a5ee service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:47.495090 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-992d7499-d70e-4926-97b1-7c91781993f2 req-28b80c58-c3f8-45b1-accc-180c2f81a5ee service nova] Creating event network-changed:fb5abd93-9e7b-4e99-abcb-6470f0c9ec14 for instance d33c522d-8fb2-4c37-a15c-e1af48406b09 on n-h1-836830-4 Jun 16 14:52:47.514786 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-992d7499-d70e-4926-97b1-7c91781993f2 req-28b80c58-c3f8-45b1-accc-180c2f81a5ee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090581 Jun 16 14:52:47.519302 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1432/2735] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:52:47.536784 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-01efe397-3731-40f3-aedb-2b066de174aa tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:47.539852 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-01efe397-3731-40f3-aedb-2b066de174aa tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:47.562323 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01efe397-3731-40f3-aedb-2b066de174aa tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:47.564310 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01efe397-3731-40f3-aedb-2b066de174aa tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:47.567809 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01efe397-3731-40f3-aedb-2b066de174aa tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:47.569386 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01efe397-3731-40f3-aedb-2b066de174aa tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:47.773912 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-01efe397-3731-40f3-aedb-2b066de174aa tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:47.789262 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-01efe397-3731-40f3-aedb-2b066de174aa tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1345 microversion: 2.1 time: 0.268203 Jun 16 14:52:47.791042 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1433/2736] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:47 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1345 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:47.798431 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-634bea2e-0ac1-419b-a2ef-559f83d6d832 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffa36430>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:47.916613 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-634bea2e-0ac1-419b-a2ef-559f83d6d832 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.123378 Jun 16 14:52:47.919190 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1434/2737] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:47 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:47.932463 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f7adb4c9-bd16-4924-97bf-da85708024a9 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:47.938864 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:47.938864 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:47.941407 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f7adb4c9-bd16-4924-97bf-da85708024a9 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:47.942153 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f7adb4c9-bd16-4924-97bf-da85708024a9 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:47.944794 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f7adb4c9-bd16-4924-97bf-da85708024a9 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:47.946703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f7adb4c9-bd16-4924-97bf-da85708024a9 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:48.024261 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f7adb4c9-bd16-4924-97bf-da85708024a9 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.103307 Jun 16 14:52:48.033796 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1435/2738] 10.222.0.57 () {60 vars in 1177 bytes} [Thu Jun 16 14:52:47 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:48.039824 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a9ded038-2669-4222-a12d-1b2d6b005197 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:48.041925 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:48.041925 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:48.044797 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9ded038-2669-4222-a12d-1b2d6b005197 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:48.046120 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9ded038-2669-4222-a12d-1b2d6b005197 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:48.048525 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9ded038-2669-4222-a12d-1b2d6b005197 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:48.049514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a9ded038-2669-4222-a12d-1b2d6b005197 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:48.087508 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a9ded038-2669-4222-a12d-1b2d6b005197 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.051718 Jun 16 14:52:48.097852 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1436/2739] 10.222.0.57 () {60 vars in 1210 bytes} [Thu Jun 16 14:52:48 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:48.105758 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ca490189-6f54-452c-af2b-236de4b70cc5 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:48.108050 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:48.108050 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:48.112042 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca490189-6f54-452c-af2b-236de4b70cc5 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:48.112787 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca490189-6f54-452c-af2b-236de4b70cc5 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:48.114013 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca490189-6f54-452c-af2b-236de4b70cc5 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:48.115179 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ca490189-6f54-452c-af2b-236de4b70cc5 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:48.155162 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ca490189-6f54-452c-af2b-236de4b70cc5 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.055788 Jun 16 14:52:48.164224 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1437/2740] 10.222.0.57 () {60 vars in 1177 bytes} [Thu Jun 16 14:52:48 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:48.170811 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4ef48aeb-61d2-441f-88ba-baf5722043b3 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:48.173480 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:48.173480 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:48.176164 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4ef48aeb-61d2-441f-88ba-baf5722043b3 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:48.176956 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4ef48aeb-61d2-441f-88ba-baf5722043b3 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:48.177997 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4ef48aeb-61d2-441f-88ba-baf5722043b3 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:48.178689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4ef48aeb-61d2-441f-88ba-baf5722043b3 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:48.217438 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4ef48aeb-61d2-441f-88ba-baf5722043b3 tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?host=n-d-836830-4&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.051541 Jun 16 14:52:48.231260 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1438/2741] 10.222.0.57 () {60 vars in 1234 bytes} [Thu Jun 16 14:52:48 2022] GET /compute/v2.1/os-services?host=n-d-836830-4&binary=xxx => generated 16 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:48.242676 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9dd4c410-bffe-429d-90db-fc3ff8e1343f tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:48.246122 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:48.246122 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:48.253252 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9dd4c410-bffe-429d-90db-fc3ff8e1343f tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:48.254268 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9dd4c410-bffe-429d-90db-fc3ff8e1343f tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:48.255916 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9dd4c410-bffe-429d-90db-fc3ff8e1343f tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:48.258635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9dd4c410-bffe-429d-90db-fc3ff8e1343f tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:48.428047 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9dd4c410-bffe-429d-90db-fc3ff8e1343f tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.194680 Jun 16 14:52:48.454215 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1439/2742] 10.222.0.57 () {60 vars in 1177 bytes} [Thu Jun 16 14:52:48 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:48.470703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e11f6f99-c4c2-4b81-ab20-1c00c5cc66b2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:48.475440 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e11f6f99-c4c2-4b81-ab20-1c00c5cc66b2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:48.521718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e11f6f99-c4c2-4b81-ab20-1c00c5cc66b2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:48.522653 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e11f6f99-c4c2-4b81-ab20-1c00c5cc66b2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:48.525021 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e11f6f99-c4c2-4b81-ab20-1c00c5cc66b2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:48.525838 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e11f6f99-c4c2-4b81-ab20-1c00c5cc66b2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:49.215152 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e11f6f99-c4c2-4b81-ab20-1c00c5cc66b2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:49.231106 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e11f6f99-c4c2-4b81-ab20-1c00c5cc66b2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1323 microversion: 2.1 time: 0.786041 Jun 16 14:52:49.232592 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1440/2743] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:48 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1323 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:49.254858 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3a6c1d03-43c3-4f7e-8dd7-521639364b9e tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:49.254858 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:49.254858 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:49.255689 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3a6c1d03-43c3-4f7e-8dd7-521639364b9e tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:49.256007 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3a6c1d03-43c3-4f7e-8dd7-521639364b9e tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:49.259218 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3a6c1d03-43c3-4f7e-8dd7-521639364b9e tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:49.259774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3a6c1d03-43c3-4f7e-8dd7-521639364b9e tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:49.331198 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3a6c1d03-43c3-4f7e-8dd7-521639364b9e tempest-ServicesAdminNegativeV253TestJSON-1741452337 tempest-ServicesAdminNegativeV253TestJSON-1741452337-project-admin] 10.222.0.57 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.097350 Jun 16 14:52:49.337430 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1441/2744] 10.222.0.57 () {60 vars in 1238 bytes} [Thu Jun 16 14:52:49 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:49.353440 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-dff6b267-8b28-41e7-aeb1-8e3620bf18a9 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:49.354280 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-dff6b267-8b28-41e7-aeb1-8e3620bf18a9 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:49.366952 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dff6b267-8b28-41e7-aeb1-8e3620bf18a9 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:49.367458 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dff6b267-8b28-41e7-aeb1-8e3620bf18a9 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:49.368264 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dff6b267-8b28-41e7-aeb1-8e3620bf18a9 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:49.374047 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-dff6b267-8b28-41e7-aeb1-8e3620bf18a9 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:49.416641 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:49.881473 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c75af515-6ebf-44c4-a6ad-d74a9adc6ee8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:49.927770 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c75af515-6ebf-44c4-a6ad-d74a9adc6ee8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:49.943896 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c75af515-6ebf-44c4-a6ad-d74a9adc6ee8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:49.945919 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c75af515-6ebf-44c4-a6ad-d74a9adc6ee8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 4.016920 Jun 16 14:52:49.946841 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1304/2745] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:45 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 4019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:49.964348 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8ce1c1b5-257a-41b7-aa44-88fbcfdf6fa1 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeff212160>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:50.028038 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-dff6b267-8b28-41e7-aeb1-8e3620bf18a9 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:50.070942 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-dff6b267-8b28-41e7-aeb1-8e3620bf18a9 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1345 microversion: 2.1 time: 0.729625 Jun 16 14:52:50.092236 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1442/2746] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:49 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1345 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:50.177075 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8ce1c1b5-257a-41b7-aa44-88fbcfdf6fa1 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.216699 Jun 16 14:52:50.185397 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1305/2747] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:49 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:50.258054 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fc2163f9-bab5-4c66-b569-1c71f1762b45 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:50.258635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fc2163f9-bab5-4c66-b569-1c71f1762b45 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:50.272364 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fc2163f9-bab5-4c66-b569-1c71f1762b45 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:50.273126 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fc2163f9-bab5-4c66-b569-1c71f1762b45 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:50.276125 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fc2163f9-bab5-4c66-b569-1c71f1762b45 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:50.276959 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fc2163f9-bab5-4c66-b569-1c71f1762b45 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:51.184895 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f4166ea0-be34-4b09-bc28-9f0465d91f8f tempest-ServicesAdminNegativeV253TestJSON-1194048614 tempest-ServicesAdminNegativeV253TestJSON-1194048614-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:51.193377 n-d-836830-4 devstack@n-api.service[125862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:52:51.193377 n-d-836830-4 devstack@n-api.service[125862]: warnings.warn(msg) Jun 16 14:52:51.199642 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f4166ea0-be34-4b09-bc28-9f0465d91f8f tempest-ServicesAdminNegativeV253TestJSON-1194048614 tempest-ServicesAdminNegativeV253TestJSON-1194048614-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'fcae32cf51db403eac0f107d77b371f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e200cf2db1804328815d0c93023d4843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f4166ea0-be34-4b09-bc28-9f0465d91f8f tempest-ServicesAdminNegativeV253TestJSON-1194048614 tempest-ServicesAdminNegativeV253TestJSON-1194048614-project] Request method failure captured: Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0O4mI-SeRzv8pc40U5625b-hJkEZmgUCYSVdHqBYB-QbETkfwVoo4eiXFM8bFBzOsKdzYffCUawZoLdTe4-5o94rtR_I9ZtxU--yjp9nHQLxXA0CbhaILPIedrZlnAiqcCt6GbvgSVu0pNV04SjLDfv30Ad7qNhw2e6CFcb4deNhXU Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Openstack-Nova-Api-Version: 2.53 Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: e200cf2db1804328815d0c93023d4843 Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1194048614 Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e200cf2db1804328815d0c93023d4843", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e200cf2db1804328815d0c93023d4843"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e200cf2db1804328815d0c93023d4843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e200cf2db1804328815d0c93023d4843"}]}] Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1194048614 Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: e200cf2db1804328815d0c93023d4843 Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1194048614 Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1194048614-project Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: fcae32cf51db403eac0f107d77b371f5 Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1194048614-project Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: action_args: {} Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise self.value Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 16 14:52:51.216716 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:51.225703 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:52:51.225703 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:51.225703 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:52:51.225703 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:52:51.225703 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:52:51.225703 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 16 14:52:51.225703 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 16 14:52:51.225703 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 16 14:52:51.225703 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:52:51.232359 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f4166ea0-be34-4b09-bc28-9f0465d91f8f tempest-ServicesAdminNegativeV253TestJSON-1194048614 tempest-ServicesAdminNegativeV253TestJSON-1194048614-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:52:51.235989 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f4166ea0-be34-4b09-bc28-9f0465d91f8f tempest-ServicesAdminNegativeV253TestJSON-1194048614 tempest-ServicesAdminNegativeV253TestJSON-1194048614-project] 10.222.0.57 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 1.139730 Jun 16 14:52:51.247380 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1443/2748] 10.222.0.57 () {60 vars in 1177 bytes} [Thu Jun 16 14:52:50 2022] GET /compute/v2.1/os-services => generated 112 bytes in 1154 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:52:51.273636 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-23623f95-d938-4d9e-8c43-536159af1da3 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:51.287016 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-23623f95-d938-4d9e-8c43-536159af1da3 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:51.311493 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23623f95-d938-4d9e-8c43-536159af1da3 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:51.317441 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23623f95-d938-4d9e-8c43-536159af1da3 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:51.320764 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23623f95-d938-4d9e-8c43-536159af1da3 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:51.323921 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-23623f95-d938-4d9e-8c43-536159af1da3 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:53.124530 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-23623f95-d938-4d9e-8c43-536159af1da3 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:53.181108 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-23623f95-d938-4d9e-8c43-536159af1da3 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:53.199480 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-23623f95-d938-4d9e-8c43-536159af1da3 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:53.213021 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-23623f95-d938-4d9e-8c43-536159af1da3 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 1.963488 Jun 16 14:52:53.227031 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1444/2749] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:51 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:53.264117 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-49490548-4632-4ffc-94a5-01325fef7690 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:53.265451 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-49490548-4632-4ffc-94a5-01325fef7690 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:53.304261 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49490548-4632-4ffc-94a5-01325fef7690 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:53.304959 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49490548-4632-4ffc-94a5-01325fef7690 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:53.306581 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49490548-4632-4ffc-94a5-01325fef7690 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:53.307812 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-49490548-4632-4ffc-94a5-01325fef7690 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:53.638263 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-49490548-4632-4ffc-94a5-01325fef7690 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:53.667567 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-49490548-4632-4ffc-94a5-01325fef7690 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1345 microversion: 2.1 time: 0.438327 Jun 16 14:52:53.668527 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1445/2750] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:53 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1345 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:53.689030 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a73f3fb8-9144-4d90-8ed7-6c072fc0d4f9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffe58e50>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:53.839509 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fc2163f9-bab5-4c66-b569-1c71f1762b45 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:53.874936 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fc2163f9-bab5-4c66-b569-1c71f1762b45 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1323 microversion: 2.1 time: 3.619410 Jun 16 14:52:53.881434 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1306/2751] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:50 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1323 bytes in 3629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:52:53.923424 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-34d7c6be-74d0-4463-9589-da8818b37aff req-d82a7dc5-9ca4-4aff-a6aa-0f6077630c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3e4c1a-dfce-477f-b0a6-990624d387cb", "tag": "3deab345-0596-4db1-8cb6-ed28e95a2aa7"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:53.965523 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-34d7c6be-74d0-4463-9589-da8818b37aff req-d82a7dc5-9ca4-4aff-a6aa-0f6077630c32 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:53.972822 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a73f3fb8-9144-4d90-8ed7-6c072fc0d4f9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1427 microversion: 2.1 time: 0.294614 Jun 16 14:52:53.973250 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-34d7c6be-74d0-4463-9589-da8818b37aff req-d82a7dc5-9ca4-4aff-a6aa-0f6077630c32 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:53.979593 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1446/2752] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:53 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1427 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:54.014458 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-34d7c6be-74d0-4463-9589-da8818b37aff req-d82a7dc5-9ca4-4aff-a6aa-0f6077630c32 service nova] Creating event network-changed:3deab345-0596-4db1-8cb6-ed28e95a2aa7 for instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb on n-h2-836830-4 Jun 16 14:52:54.044206 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-34d7c6be-74d0-4463-9589-da8818b37aff req-d82a7dc5-9ca4-4aff-a6aa-0f6077630c32 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136556 Jun 16 14:52:54.048168 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1307/2753] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:52:54.257894 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-541103f0-e0a7-4221-8b4d-35f979b1723c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:54.265478 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-541103f0-e0a7-4221-8b4d-35f979b1723c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:54.303216 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-541103f0-e0a7-4221-8b4d-35f979b1723c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:54.306214 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-541103f0-e0a7-4221-8b4d-35f979b1723c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:54.307462 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-541103f0-e0a7-4221-8b4d-35f979b1723c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:54.310749 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-541103f0-e0a7-4221-8b4d-35f979b1723c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:54.698828 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c420061f-5212-40e5-93e2-a6ee838ca786 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:54.700921 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c420061f-5212-40e5-93e2-a6ee838ca786 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:54.722246 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=9 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:54.728548 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c420061f-5212-40e5-93e2-a6ee838ca786 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:54.730456 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c420061f-5212-40e5-93e2-a6ee838ca786 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:54.733744 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c420061f-5212-40e5-93e2-a6ee838ca786 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:54.738696 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c420061f-5212-40e5-93e2-a6ee838ca786 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:55.332095 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-c420061f-5212-40e5-93e2-a6ee838ca786 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:55.358112 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c420061f-5212-40e5-93e2-a6ee838ca786 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1345 microversion: 2.1 time: 0.663999 Jun 16 14:52:55.391926 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1308/2754] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:54 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1345 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:55.398343 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-24c56990-c3f3-47c7-ace6-a83f2b497bc0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:55.400925 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-24c56990-c3f3-47c7-ace6-a83f2b497bc0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:55.444092 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-24c56990-c3f3-47c7-ace6-a83f2b497bc0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:55.446183 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-24c56990-c3f3-47c7-ace6-a83f2b497bc0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:55.446183 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-24c56990-c3f3-47c7-ace6-a83f2b497bc0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:55.447558 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-24c56990-c3f3-47c7-ace6-a83f2b497bc0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:55.760109 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-541103f0-e0a7-4221-8b4d-35f979b1723c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:55.788337 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-541103f0-e0a7-4221-8b4d-35f979b1723c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:55.791346 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-541103f0-e0a7-4221-8b4d-35f979b1723c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:55.797065 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:55.799216 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-541103f0-e0a7-4221-8b4d-35f979b1723c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 1.543500 Jun 16 14:52:55.835209 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1447/2755] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:54 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:52:55.876666 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a8a4d1bb-446a-4ef9-8aec-db4d8abd8535 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf1105f040>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:56.037355 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a8a4d1bb-446a-4ef9-8aec-db4d8abd8535 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1436 microversion: 2.1 time: 0.192988 Jun 16 14:52:56.038726 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1448/2756] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:55 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1436 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:56.088514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6c3f830b-1816-4ca6-9ed0-1c15d7aee88f tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdeffa36ee0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:56.119947 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=6 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:56.213942 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6c3f830b-1816-4ca6-9ed0-1c15d7aee88f tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 200 len: 1436 microversion: 2.1 time: 0.155959 Jun 16 14:52:56.217565 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1449/2757] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:52:56 2022] GET /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 1436 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:56.239730 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-deb72b1f-a8b7-4cb7-ad42-26c35dcab66f tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:56.244479 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-deb72b1f-a8b7-4cb7-ad42-26c35dcab66f tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:56.297014 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-deb72b1f-a8b7-4cb7-ad42-26c35dcab66f tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:56.305243 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-deb72b1f-a8b7-4cb7-ad42-26c35dcab66f tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:56.307437 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-deb72b1f-a8b7-4cb7-ad42-26c35dcab66f tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:56.308505 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-deb72b1f-a8b7-4cb7-ad42-26c35dcab66f tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:56.758190 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-24c56990-c3f3-47c7-ace6-a83f2b497bc0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:56.810924 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-24c56990-c3f3-47c7-ace6-a83f2b497bc0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1323 microversion: 2.1 time: 1.416950 Jun 16 14:52:56.813125 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1309/2758] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:55 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1323 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:56.826758 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6d0c6bd3-5df9-4534-a1ce-5febd90dc0df tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:56.838012 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6d0c6bd3-5df9-4534-a1ce-5febd90dc0df tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:56.871835 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6d0c6bd3-5df9-4534-a1ce-5febd90dc0df tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:56.877390 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6d0c6bd3-5df9-4534-a1ce-5febd90dc0df tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:56.882917 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6d0c6bd3-5df9-4534-a1ce-5febd90dc0df tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:56.883883 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6d0c6bd3-5df9-4534-a1ce-5febd90dc0df tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:57.006690 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=78 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:52:57.453803 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6d0c6bd3-5df9-4534-a1ce-5febd90dc0df tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:57.471604 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6d0c6bd3-5df9-4534-a1ce-5febd90dc0df tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 200 len: 1345 microversion: 2.1 time: 0.656242 Jun 16 14:52:57.474874 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1310/2759] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:56 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 1345 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:57.481812 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-2371dfa7-54f4-4499-84a5-8d893cc51e9f tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:57.483285 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-2371dfa7-54f4-4499-84a5-8d893cc51e9f tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:57.493635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2371dfa7-54f4-4499-84a5-8d893cc51e9f tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:57.494614 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2371dfa7-54f4-4499-84a5-8d893cc51e9f tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:57.495854 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2371dfa7-54f4-4499-84a5-8d893cc51e9f tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:57.496635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-2371dfa7-54f4-4499-84a5-8d893cc51e9f tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:58.170293 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-deb72b1f-a8b7-4cb7-ad42-26c35dcab66f tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:58.197934 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-deb72b1f-a8b7-4cb7-ad42-26c35dcab66f tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1465 microversion: 2.1 time: 1.970269 Jun 16 14:52:58.212233 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2371dfa7-54f4-4499-84a5-8d893cc51e9f tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:58.222290 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1450/2760] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:56 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1465 bytes in 1995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:52:58.227800 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-fcc3aaa1-92cc-4b34-b679-c0c82947a4eb req-06f2bc46-566c-4c1c-89d0-42faae988064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930c35e3-db68-47f4-9f47-06f74b96bebf", "tag": "f7ff22c8-ceb6-4415-8bab-0960e76eef51"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:52:58.259016 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-fcc3aaa1-92cc-4b34-b679-c0c82947a4eb req-06f2bc46-566c-4c1c-89d0-42faae988064 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:58.259487 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-fcc3aaa1-92cc-4b34-b679-c0c82947a4eb req-06f2bc46-566c-4c1c-89d0-42faae988064 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:58.268489 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2371dfa7-54f4-4499-84a5-8d893cc51e9f tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:58.274970 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-2371dfa7-54f4-4499-84a5-8d893cc51e9f tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:52:58.301838 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-fcc3aaa1-92cc-4b34-b679-c0c82947a4eb req-06f2bc46-566c-4c1c-89d0-42faae988064 service nova] Creating event network-changed:f7ff22c8-ceb6-4415-8bab-0960e76eef51 for instance 930c35e3-db68-47f4-9f47-06f74b96bebf on n-h1-836830-4 Jun 16 14:52:58.303742 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-2371dfa7-54f4-4499-84a5-8d893cc51e9f tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 0.826805 Jun 16 14:52:58.304985 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1311/2761] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:52:57 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:52:58.342662 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-b55b99ca-3e42-48ea-8b7f-331758972119 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:58.343932 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-b55b99ca-3e42-48ea-8b7f-331758972119 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:52:58.365320 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-fcc3aaa1-92cc-4b34-b679-c0c82947a4eb req-06f2bc46-566c-4c1c-89d0-42faae988064 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141568 Jun 16 14:52:58.366337 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1451/2762] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:52:58.380007 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b55b99ca-3e42-48ea-8b7f-331758972119 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:58.380766 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b55b99ca-3e42-48ea-8b7f-331758972119 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:58.381463 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5832abb5-60f2-4473-8aa7-543a17b5c6a6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf1105fa60>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:52:58.382252 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b55b99ca-3e42-48ea-8b7f-331758972119 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:52:58.383270 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-b55b99ca-3e42-48ea-8b7f-331758972119 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:52:59.280566 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=18 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:00.237546 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5832abb5-60f2-4473-8aa7-543a17b5c6a6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "DELETE /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334" status: 204 len: 0 microversion: 2.1 time: 1.869599 Jun 16 14:53:00.242095 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1452/2763] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:58 2022] DELETE /compute/v2.1/images/6331d41f-dae5-4774-8160-04373769c334 => generated 0 bytes in 1871 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:53:00.247420 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bde652ec-e6da-4d92-9198-cce7b495a776 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:00.254803 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bde652ec-e6da-4d92-9198-cce7b495a776 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:00.266416 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bde652ec-e6da-4d92-9198-cce7b495a776 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:00.266888 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bde652ec-e6da-4d92-9198-cce7b495a776 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:00.267716 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bde652ec-e6da-4d92-9198-cce7b495a776 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:00.268164 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bde652ec-e6da-4d92-9198-cce7b495a776 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:00.297895 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-bde652ec-e6da-4d92-9198-cce7b495a776 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] HTTP exception thrown: Instance 8c6aba7d-22a7-4711-89b6-bee152b1ac6b could not be found. Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bde652ec-e6da-4d92-9198-cce7b495a776 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Request method failure captured: Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b HTTP/1.1 Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0MvJ0R4NIFXfn4T9DdbY1PJWoesK-5nib9YvBtnFG9uywU3lbfvtjVN5oqZqx8_RnrO9BysZ0WqJt6XkJRYQmBGZAEbj8GVndngKni5KcW6-DH7CCdrUkWO5n5WzNi_C8qSq70U7P3qWrgvqNpu5Hzg9LouNmytvjJk_TvR4-o3m0Y Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: aa616e014da1416aa7369181bd1518e5 Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-DeleteServersTestJSON-31158303 Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa616e014da1416aa7369181bd1518e5", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa616e014da1416aa7369181bd1518e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa616e014da1416aa7369181bd1518e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa616e014da1416aa7369181bd1518e5"}]}] Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-DeleteServersTestJSON-31158303 Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: aa616e014da1416aa7369181bd1518e5 Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-DeleteServersTestJSON-31158303 Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-DeleteServersTestJSON-31158303-project Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 4e78da3d7a6f45d7abe04bc447f7c870 Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-DeleteServersTestJSON-31158303-project Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 8c6aba7d-22a7-4711-89b6-bee152b1ac6b could not be found. Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '8c6aba7d-22a7-4711-89b6-bee152b1ac6b'} Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6aba7d-22a7-4711-89b6-bee152b1ac6b could not be found. Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6aba7d-22a7-4711-89b6-bee152b1ac6b could not be found. Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:00.304099 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:00.308398 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:00.308398 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:00.308398 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:00.308398 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:53:00.308398 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:53:00.308398 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6aba7d-22a7-4711-89b6-bee152b1ac6b could not be found. Jun 16 14:53:00.308398 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:00.308398 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bde652ec-e6da-4d92-9198-cce7b495a776 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Returning 404 to user: Instance 8c6aba7d-22a7-4711-89b6-bee152b1ac6b could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:53:00.308398 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bde652ec-e6da-4d92-9198-cce7b495a776 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b" status: 404 len: 111 microversion: 2.1 time: 0.062561 Jun 16 14:53:00.309374 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1453/2764] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:00 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:53:00.481737 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-b55b99ca-3e42-48ea-8b7f-331758972119 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:00.499667 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-b55b99ca-3e42-48ea-8b7f-331758972119 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1323 microversion: 2.1 time: 2.192900 Jun 16 14:53:00.519535 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1312/2765] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:52:58 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1323 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:00.524963 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-143b5c4a-759e-42db-810c-e242970caad1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:00.525993 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-143b5c4a-759e-42db-810c-e242970caad1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:00.535989 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-143b5c4a-759e-42db-810c-e242970caad1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:00.536740 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-143b5c4a-759e-42db-810c-e242970caad1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:00.537885 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-143b5c4a-759e-42db-810c-e242970caad1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:00.540175 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-143b5c4a-759e-42db-810c-e242970caad1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:00.898976 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b8569268-ffcb-48ed-bc30-c65caf25837c tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Action: 'create', calling method: .version_select at 0x7fdeffa36f70>, body: {"keypair": {"name": "tempest-keypair-1742892133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKG8mLrau3+q++pC/DLPQ1IqAXqwTuE44lnRUNnVNCyy1PcHLapP9iUHX9Kx9kxDcgFwACyXylLpcFcd8gMcWgDqbR4Z5vJfQK6FNOnC+Pnku8M+I71D7eqb6WzlhVfEg=="}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:00.930534 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-b8569268-ffcb-48ed-bc30-c65caf25837c tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Getting quotas for project cbb2d93a8ca24b4cb81e316025504ef5. Resources: {'key_pairs'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:53:00.944217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-b8569268-ffcb-48ed-bc30-c65caf25837c tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Getting quotas for user 67b034bd6e71471bb3653eabbd5da828 and project cbb2d93a8ca24b4cb81e316025504ef5. Resources: {'key_pairs'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:53:00.986833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:01.002063 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b8569268-ffcb-48ed-bc30-c65caf25837c tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.678278 Jun 16 14:53:01.003643 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1454/2766] 10.222.0.57 () {60 vars in 1158 bytes} [Thu Jun 16 14:53:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:01.019979 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-46a345f6-f0a3-4c9e-9ac8-60437cd6549b tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '.version_select at 0x7fdf1106df70>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:01.085902 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-46a345f6-f0a3-4c9e-9ac8-60437cd6549b tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] HTTP exception thrown: Image not found. Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-46a345f6-f0a3-4c9e-9ac8-60437cd6549b tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Request method failure captured: Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 HTTP/1.1 Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0M0_CzkpfsXSHfRB3JE7CRvCuxKo09QG96KnFHfjR7DyaTTsycyBux6AD9vhcS0lksg20XOedtkY-JPJ6ZwxRsTKdh9gtpUcvfvpxZafZPNHDK545VwZE0-nPkHaGV1_TYqsIrEuz3kJAu-zG9fc-flLbYuAul3e9yndy9A6CEu7Dw Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 516446d68e6b452c83140a9cf4625619 Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesOneServerTestJSON-649769668 Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_516446d68e6b452c83140a9cf4625619", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/516446d68e6b452c83140a9cf4625619"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/516446d68e6b452c83140a9cf4625619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/516446d68e6b452c83140a9cf4625619"}]}] Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesOneServerTestJSON-649769668 Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 516446d68e6b452c83140a9cf4625619 Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-649769668 Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesOneServerTestJSON-649769668-project Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 00c2308f7caf47369c442b63533253de Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesOneServerTestJSON-649769668-project Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: method: Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: exception: Image not found. Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'dc44e4be-de2e-4f3e-a7ef-0b912bd539c9'} Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 to delete Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 could not be found. Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:01.089695 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-46a345f6-f0a3-4c9e-9ac8-60437cd6549b tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Returning 404 to user: Image not found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-46a345f6-f0a3-4c9e-9ac8-60437cd6549b tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "DELETE /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9" status: 404 len: 62 microversion: 2.1 time: 0.090592 Jun 16 14:53:01.099684 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1455/2767] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:01 2022] DELETE /compute/v2.1/images/dc44e4be-de2e-4f3e-a7ef-0b912bd539c9 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:53:01.106289 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d1a16d51-535a-4d27-b669-943c6d7b5068 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:01.107319 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d1a16d51-535a-4d27-b669-943c6d7b5068 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 8c6aba7d-22a7-4711-89b6-bee152b1ac6b] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:01.132262 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d1a16d51-535a-4d27-b669-943c6d7b5068 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:01.132755 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d1a16d51-535a-4d27-b669-943c6d7b5068 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:01.133592 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d1a16d51-535a-4d27-b669-943c6d7b5068 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:01.134048 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d1a16d51-535a-4d27-b669-943c6d7b5068 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:01.150350 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-d1a16d51-535a-4d27-b669-943c6d7b5068 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] HTTP exception thrown: Instance 8c6aba7d-22a7-4711-89b6-bee152b1ac6b could not be found. Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d1a16d51-535a-4d27-b669-943c6d7b5068 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Request method failure captured: Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b/os-volume_attachments HTTP/1.1 Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0MvJ0R4NIFXfn4T9DdbY1PJWoesK-5nib9YvBtnFG9uywU3lbfvtjVN5oqZqx8_RnrO9BysZ0WqJt6XkJRYQmBGZAEbj8GVndngKni5KcW6-DH7CCdrUkWO5n5WzNi_C8qSq70U7P3qWrgvqNpu5Hzg9LouNmytvjJk_TvR4-o3m0Y Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: aa616e014da1416aa7369181bd1518e5 Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-DeleteServersTestJSON-31158303 Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa616e014da1416aa7369181bd1518e5", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa616e014da1416aa7369181bd1518e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa616e014da1416aa7369181bd1518e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa616e014da1416aa7369181bd1518e5"}]}] Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-DeleteServersTestJSON-31158303 Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: aa616e014da1416aa7369181bd1518e5 Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-DeleteServersTestJSON-31158303 Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-DeleteServersTestJSON-31158303-project Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 4e78da3d7a6f45d7abe04bc447f7c870 Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-DeleteServersTestJSON-31158303-project Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 8c6aba7d-22a7-4711-89b6-bee152b1ac6b could not be found. Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'server_id': '8c6aba7d-22a7-4711-89b6-bee152b1ac6b'} Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6aba7d-22a7-4711-89b6-bee152b1ac6b could not be found. Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:53:01.152436 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6aba7d-22a7-4711-89b6-bee152b1ac6b could not be found. Jun 16 14:53:01.170501 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:01.170501 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:01.170501 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:01.170501 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:01.170501 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:01.170501 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:01.170501 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:53:01.170501 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:53:01.170501 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6aba7d-22a7-4711-89b6-bee152b1ac6b could not be found. Jun 16 14:53:01.170501 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:01.170501 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d1a16d51-535a-4d27-b669-943c6d7b5068 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Returning 404 to user: Instance 8c6aba7d-22a7-4711-89b6-bee152b1ac6b could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:53:01.170501 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d1a16d51-535a-4d27-b669-943c6d7b5068 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.055657 Jun 16 14:53:01.170501 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1456/2768] 10.222.0.57 () {58 vars in 1301 bytes} [Thu Jun 16 14:53:01 2022] GET /compute/v2.1/servers/8c6aba7d-22a7-4711-89b6-bee152b1ac6b/os-volume_attachments => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:53:01.178897 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-ce5df142-4c2b-4556-842c-ad2f27874422 req-898b6f97-e46d-4cc1-94a1-d802b6a8a63b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d33c522d-8fb2-4c37-a15c-e1af48406b09", "tag": "b11d7310-a550-44b5-aba3-1d27cb9e167a"}, {"name": "network-changed", "server_uuid": "a6f54e74-9834-449d-8a62-2f33df36a320", "tag": "44f50a71-e68c-45a7-8b61-e0a5daa83c9b"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:01.220326 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-ce5df142-4c2b-4556-842c-ad2f27874422 req-898b6f97-e46d-4cc1-94a1-d802b6a8a63b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:01.221073 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-ce5df142-4c2b-4556-842c-ad2f27874422 req-898b6f97-e46d-4cc1-94a1-d802b6a8a63b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:01.271120 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-ce5df142-4c2b-4556-842c-ad2f27874422 req-898b6f97-e46d-4cc1-94a1-d802b6a8a63b service nova] Creating event network-changed:b11d7310-a550-44b5-aba3-1d27cb9e167a for instance d33c522d-8fb2-4c37-a15c-e1af48406b09 on n-h1-836830-4 Jun 16 14:53:01.271676 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-ce5df142-4c2b-4556-842c-ad2f27874422 req-898b6f97-e46d-4cc1-94a1-d802b6a8a63b service nova] Creating event network-changed:44f50a71-e68c-45a7-8b61-e0a5daa83c9b for instance a6f54e74-9834-449d-8a62-2f33df36a320 on n-h2-836830-4 Jun 16 14:53:01.287112 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-ce5df142-4c2b-4556-842c-ad2f27874422 req-898b6f97-e46d-4cc1-94a1-d802b6a8a63b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.130551 Jun 16 14:53:01.287748 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1457/2769] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:01.294282 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6cb2b2a1-f77d-4ffb-bc19-dc36ba6fe3e9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:01.294937 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6cb2b2a1-f77d-4ffb-bc19-dc36ba6fe3e9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:01.311372 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6cb2b2a1-f77d-4ffb-bc19-dc36ba6fe3e9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:01.312460 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6cb2b2a1-f77d-4ffb-bc19-dc36ba6fe3e9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:01.313149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6cb2b2a1-f77d-4ffb-bc19-dc36ba6fe3e9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:01.313703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6cb2b2a1-f77d-4ffb-bc19-dc36ba6fe3e9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:01.447260 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6cb2b2a1-f77d-4ffb-bc19-dc36ba6fe3e9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:53:01.706814 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6cb2b2a1-f77d-4ffb-bc19-dc36ba6fe3e9 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "DELETE /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 204 len: 0 microversion: 2.1 time: 0.416349 Jun 16 14:53:01.709604 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1458/2770] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:53:01 2022] DELETE /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:53:01.722707 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-68afbe5c-3b38-499e-9900-4193d5918d9f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:01.723460 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-68afbe5c-3b38-499e-9900-4193d5918d9f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:01.746537 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-68afbe5c-3b38-499e-9900-4193d5918d9f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:01.746881 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-68afbe5c-3b38-499e-9900-4193d5918d9f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:01.753019 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-68afbe5c-3b38-499e-9900-4193d5918d9f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:01.753834 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-68afbe5c-3b38-499e-9900-4193d5918d9f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:02.040487 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-143b5c4a-759e-42db-810c-e242970caad1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:02.058669 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-143b5c4a-759e-42db-810c-e242970caad1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:02.066847 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-143b5c4a-759e-42db-810c-e242970caad1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:02.068751 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-143b5c4a-759e-42db-810c-e242970caad1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 1.547585 Jun 16 14:53:02.070854 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1313/2771] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:00 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:02.097927 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-474180821", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "8f2bdb2a-89e7-4760-bf67-a768c01f1b49"}]}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:02.212391 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] validate_networks() for [('8f2bdb2a-89e7-4760-bf67-a768c01f1b49', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:53:02.372633 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-68afbe5c-3b38-499e-9900-4193d5918d9f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:02.402829 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-68afbe5c-3b38-499e-9900-4193d5918d9f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1323 microversion: 2.1 time: 0.690183 Jun 16 14:53:02.404461 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1459/2772] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:01 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1323 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:02.415747 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bbcfe847-2973-4d10-ab05-c7e99243ac74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:02.417790 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bbcfe847-2973-4d10-ab05-c7e99243ac74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:02.445723 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bbcfe847-2973-4d10-ab05-c7e99243ac74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:02.447587 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bbcfe847-2973-4d10-ab05-c7e99243ac74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:02.465922 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bbcfe847-2973-4d10-ab05-c7e99243ac74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:02.471776 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bbcfe847-2973-4d10-ab05-c7e99243ac74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:03.019246 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bbcfe847-2973-4d10-ab05-c7e99243ac74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:03.034536 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bbcfe847-2973-4d10-ab05-c7e99243ac74 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1471 microversion: 2.1 time: 0.621386 Jun 16 14:53:03.049965 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1460/2773] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:02 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1471 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:03.090060 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e02899c2-e4c4-4eaa-831a-236feefc92fc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:03.091278 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e02899c2-e4c4-4eaa-831a-236feefc92fc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:03.106560 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e02899c2-e4c4-4eaa-831a-236feefc92fc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:03.110488 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e02899c2-e4c4-4eaa-831a-236feefc92fc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:03.112236 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e02899c2-e4c4-4eaa-831a-236feefc92fc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:03.113179 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e02899c2-e4c4-4eaa-831a-236feefc92fc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:04.250574 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e02899c2-e4c4-4eaa-831a-236feefc92fc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:04.264414 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e02899c2-e4c4-4eaa-831a-236feefc92fc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:04.267306 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e02899c2-e4c4-4eaa-831a-236feefc92fc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:04.275500 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e02899c2-e4c4-4eaa-831a-236feefc92fc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 1.189785 Jun 16 14:53:04.282542 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1461/2774] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:03 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:53:05.253128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-9d7357e4-e96a-4e3d-a989-c30c295c54ce req-014a19f1-49c2-4aaf-beb4-02fae837a2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa828bec-416c-496b-9290-60892a56a452", "name": "network-vif-unplugged", "status": "completed", "tag": "50551314-0d91-4b89-ae9d-7adae8fcf3a6"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:05.288813 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-9d7357e4-e96a-4e3d-a989-c30c295c54ce req-014a19f1-49c2-4aaf-beb4-02fae837a2f3 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:05.289607 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-9d7357e4-e96a-4e3d-a989-c30c295c54ce req-014a19f1-49c2-4aaf-beb4-02fae837a2f3 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:05.346106 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-9d7357e4-e96a-4e3d-a989-c30c295c54ce req-014a19f1-49c2-4aaf-beb4-02fae837a2f3 service nova] Creating event network-vif-unplugged:50551314-0d91-4b89-ae9d-7adae8fcf3a6 for instance aa828bec-416c-496b-9290-60892a56a452 on n-h2-836830-4 Jun 16 14:53:05.357962 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-9d7357e4-e96a-4e3d-a989-c30c295c54ce req-014a19f1-49c2-4aaf-beb4-02fae837a2f3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.071523 Jun 16 14:53:05.361853 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1462/2775] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:05.377498 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5aca71ff-fceb-45c9-b33f-5d8c2e76965f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:05.378532 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5aca71ff-fceb-45c9-b33f-5d8c2e76965f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:05.391972 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5aca71ff-fceb-45c9-b33f-5d8c2e76965f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:05.392443 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5aca71ff-fceb-45c9-b33f-5d8c2e76965f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:05.397461 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5aca71ff-fceb-45c9-b33f-5d8c2e76965f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:05.399103 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5aca71ff-fceb-45c9-b33f-5d8c2e76965f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:05.931791 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5aca71ff-fceb-45c9-b33f-5d8c2e76965f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:05.993571 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5aca71ff-fceb-45c9-b33f-5d8c2e76965f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1323 microversion: 2.1 time: 0.616059 Jun 16 14:53:05.997924 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1463/2776] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:05 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1323 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:06.045923 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b1571832-a809-4022-bfb3-4a66271102e6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:06.048503 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b1571832-a809-4022-bfb3-4a66271102e6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:06.103523 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b1571832-a809-4022-bfb3-4a66271102e6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:06.113221 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b1571832-a809-4022-bfb3-4a66271102e6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:06.114871 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b1571832-a809-4022-bfb3-4a66271102e6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:06.118882 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b1571832-a809-4022-bfb3-4a66271102e6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:06.331861 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:53:06.335846 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:53:06.336984 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:53:06.337753 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:53:06.338524 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:53:06.388396 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:06.393623 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:06.399268 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:06.400075 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:06.558550 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Getting quotas for project aa616e014da1416aa7369181bd1518e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:53:06.588728 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Getting quotas for user 4e78da3d7a6f45d7abe04bc447f7c870 and project aa616e014da1416aa7369181bd1518e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:53:06.651550 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b1571832-a809-4022-bfb3-4a66271102e6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:06.669925 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:53:06.679882 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: c202a760-9754-497a-8719-b0719e1181ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:53:06.691011 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b1571832-a809-4022-bfb3-4a66271102e6 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1471 microversion: 2.1 time: 0.687883 Jun 16 14:53:06.704093 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1464/2777] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:05 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1471 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:06.720282 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-031ee7b7-3685-4aa6-9c97-1d50edd74a98 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:06.722503 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-031ee7b7-3685-4aa6-9c97-1d50edd74a98 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:06.744737 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-031ee7b7-3685-4aa6-9c97-1d50edd74a98 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:06.745247 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-031ee7b7-3685-4aa6-9c97-1d50edd74a98 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:06.748507 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-031ee7b7-3685-4aa6-9c97-1d50edd74a98 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:06.749532 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-031ee7b7-3685-4aa6-9c97-1d50edd74a98 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:06.878624 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3c6d1a69-57fa-4ddb-9069-4dae21a3b5a6 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.791317 Jun 16 14:53:06.879802 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1314/2778] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:53:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 4794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:53:07.349862 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-f08a7322-c0a8-48f4-973d-ac8a7f593d71 tempest-FlavorsV2NegativeTest-1700862925 tempest-FlavorsV2NegativeTest-1700862925-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:07.372724 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-f08a7322-c0a8-48f4-973d-ac8a7f593d71 tempest-FlavorsV2NegativeTest-1700862925 tempest-FlavorsV2NegativeTest-1700862925-project] 10.222.0.57 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.490731 Jun 16 14:53:07.377379 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1315/2779] 10.222.0.57 () {58 vars in 1136 bytes} [Thu Jun 16 14:53:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:07.394951 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bbb09758-9e3f-42e1-b828-6c819ad2983e tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:07.396518 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bbb09758-9e3f-42e1-b828-6c819ad2983e tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: c202a760-9754-497a-8719-b0719e1181ef] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:07.737485 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-031ee7b7-3685-4aa6-9c97-1d50edd74a98 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:07.774024 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-031ee7b7-3685-4aa6-9c97-1d50edd74a98 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:07.786922 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-031ee7b7-3685-4aa6-9c97-1d50edd74a98 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:07.793254 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-031ee7b7-3685-4aa6-9c97-1d50edd74a98 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 1.080479 Jun 16 14:53:07.794915 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1465/2780] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:06 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:07.809304 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3aab4e7d-5d76-4079-84bf-a33b3e2b213b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:07.826090 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3aab4e7d-5d76-4079-84bf-a33b3e2b213b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:07.846851 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3aab4e7d-5d76-4079-84bf-a33b3e2b213b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:07.847462 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3aab4e7d-5d76-4079-84bf-a33b3e2b213b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:07.848560 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3aab4e7d-5d76-4079-84bf-a33b3e2b213b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:07.849021 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3aab4e7d-5d76-4079-84bf-a33b3e2b213b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:08.342326 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bbb09758-9e3f-42e1-b828-6c819ad2983e tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:08.361603 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bbb09758-9e3f-42e1-b828-6c819ad2983e tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/c202a760-9754-497a-8719-b0719e1181ef" status: 200 len: 1214 microversion: 2.1 time: 0.977473 Jun 16 14:53:08.364794 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1316/2781] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:07 2022] GET /compute/v2.1/servers/c202a760-9754-497a-8719-b0719e1181ef => generated 1214 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:08.379036 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9f4c7083-6a83-4339-bbb6-00b1bf9abfb3 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:08.389351 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-9f4c7083-6a83-4339-bbb6-00b1bf9abfb3 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:08.424634 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9f4c7083-6a83-4339-bbb6-00b1bf9abfb3 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:08.426081 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9f4c7083-6a83-4339-bbb6-00b1bf9abfb3 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:08.429993 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9f4c7083-6a83-4339-bbb6-00b1bf9abfb3 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:08.431263 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-9f4c7083-6a83-4339-bbb6-00b1bf9abfb3 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:08.568423 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3aab4e7d-5d76-4079-84bf-a33b3e2b213b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:08.577771 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3aab4e7d-5d76-4079-84bf-a33b3e2b213b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1323 microversion: 2.1 time: 0.775905 Jun 16 14:53:08.586157 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1466/2782] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:07 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1323 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:08.598505 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-cbd1a1df-820e-4879-b317-2b9d960a41d3 req-2072768b-fa74-456c-8bd1-537151958b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3e4c1a-dfce-477f-b0a6-990624d387cb", "name": "network-vif-plugged", "status": "completed", "tag": "3deab345-0596-4db1-8cb6-ed28e95a2aa7"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:08.614580 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-cbd1a1df-820e-4879-b317-2b9d960a41d3 req-2072768b-fa74-456c-8bd1-537151958b3a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:08.615217 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-cbd1a1df-820e-4879-b317-2b9d960a41d3 req-2072768b-fa74-456c-8bd1-537151958b3a service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:08.641901 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-cbd1a1df-820e-4879-b317-2b9d960a41d3 req-2072768b-fa74-456c-8bd1-537151958b3a service nova] Creating event network-vif-plugged:3deab345-0596-4db1-8cb6-ed28e95a2aa7 for instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb on n-h2-836830-4 Jun 16 14:53:08.652294 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-cbd1a1df-820e-4879-b317-2b9d960a41d3 req-2072768b-fa74-456c-8bd1-537151958b3a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064453 Jun 16 14:53:08.655903 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1467/2783] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:08.673566 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-157d1f65-093a-4a0f-bebe-b4b44235f4d4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:08.674492 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-157d1f65-093a-4a0f-bebe-b4b44235f4d4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: c202a760-9754-497a-8719-b0719e1181ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:08.688716 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-157d1f65-093a-4a0f-bebe-b4b44235f4d4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:08.689509 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-157d1f65-093a-4a0f-bebe-b4b44235f4d4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:08.690564 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-157d1f65-093a-4a0f-bebe-b4b44235f4d4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:08.692346 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-157d1f65-093a-4a0f-bebe-b4b44235f4d4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:08.750078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:08.768706 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-157d1f65-093a-4a0f-bebe-b4b44235f4d4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: c202a760-9754-497a-8719-b0719e1181ef] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:53:08.793516 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-157d1f65-093a-4a0f-bebe-b4b44235f4d4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:08.799182 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-157d1f65-093a-4a0f-bebe-b4b44235f4d4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:08.821841 n-d-836830-4 devstack@n-api.service[125863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 14:53:08.822086 n-d-836830-4 devstack@n-api.service[125863]: Thu Jun 16 14:53:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 (ip 10.222.0.57) !!! Jun 16 14:53:08.959094 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-157d1f65-093a-4a0f-bebe-b4b44235f4d4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lazy-loading 'flavor' on Instance uuid c202a760-9754-497a-8719-b0719e1181ef {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:53:08.991282 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-157d1f65-093a-4a0f-bebe-b4b44235f4d4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lazy-loading 'system_metadata' on Instance uuid c202a760-9754-497a-8719-b0719e1181ef {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:53:09.191688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.objects.instance [None req-157d1f65-093a-4a0f-bebe-b4b44235f4d4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lazy-loading 'metadata' on Instance uuid c202a760-9754-497a-8719-b0719e1181ef {{(pid=125862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:53:10.960937 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:11.082607 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.scheduler.client.report [None req-157d1f65-093a-4a0f-bebe-b4b44235f4d4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Deleted allocations for instance c202a760-9754-497a-8719-b0719e1181ef Jun 16 14:53:11.121956 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-157d1f65-093a-4a0f-bebe-b4b44235f4d4 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c202a760-9754-497a-8719-b0719e1181ef" status: 204 len: 0 microversion: 2.1 time: 2.463793 Jun 16 14:53:11.129867 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1468/2784] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:53:08 2022] DELETE /compute/v2.1/servers/c202a760-9754-497a-8719-b0719e1181ef => generated 0 bytes in 2469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:53:11.157560 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-112a8080-7592-47f2-b014-55477fe89ca8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:11.164444 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-112a8080-7592-47f2-b014-55477fe89ca8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:11.187173 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-112a8080-7592-47f2-b014-55477fe89ca8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:11.188913 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-112a8080-7592-47f2-b014-55477fe89ca8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:11.191602 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-112a8080-7592-47f2-b014-55477fe89ca8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:11.193156 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-112a8080-7592-47f2-b014-55477fe89ca8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:12.583708 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-9f4c7083-6a83-4339-bbb6-00b1bf9abfb3 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c2308f7caf47369c442b63533253de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '516446d68e6b452c83140a9cf4625619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:12.633267 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9f4c7083-6a83-4339-bbb6-00b1bf9abfb3 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 200 len: 1471 microversion: 2.1 time: 4.263092 Jun 16 14:53:12.635274 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1317/2785] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:08 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 1471 bytes in 4269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:12.663267 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5e5407f5-9dad-4099-9000-1ba6e1c0a5c0 tempest-FlavorsV2NegativeTest-1700862925 tempest-FlavorsV2NegativeTest-1700862925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-781631652", "imageRef": "30021069-9348-44f6-90b8-a80c9fe07b18", "flavorRef": "452"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:12.841042 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-5e5407f5-9dad-4099-9000-1ba6e1c0a5c0 tempest-FlavorsV2NegativeTest-1700862925 tempest-FlavorsV2NegativeTest-1700862925-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:53:13.790826 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-5e5407f5-9dad-4099-9000-1ba6e1c0a5c0 tempest-FlavorsV2NegativeTest-1700862925 tempest-FlavorsV2NegativeTest-1700862925-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5e5407f5-9dad-4099-9000-1ba6e1c0a5c0 tempest-FlavorsV2NegativeTest-1700862925 tempest-FlavorsV2NegativeTest-1700862925-project] Request method failure captured: Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 142 Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0PR6q0jfanwgzzh3Ko774gFCWuAdKbWus11nRmKzqEdHafCZ-d1U0AKi9HZdoNOySuwXb3ivf_sOSXB4riKr8laI3qb3cDL4O2rh5VAPQsnwjXwplCd-hEPlXYHUxkhPQrEmEfuyjuA2z0R94GWHEsOD5LBlaezKWW7Ill1sgQu4ik Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: 839df7d84c9f4050ac5508ef5ac6cb31 Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-FlavorsV2NegativeTest-1700862925 Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_839df7d84c9f4050ac5508ef5ac6cb31", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/839df7d84c9f4050ac5508ef5ac6cb31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/839df7d84c9f4050ac5508ef5ac6cb31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/839df7d84c9f4050ac5508ef5ac6cb31"}]}] Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-FlavorsV2NegativeTest-1700862925 Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: 839df7d84c9f4050ac5508ef5ac6cb31 Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1700862925 Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-FlavorsV2NegativeTest-1700862925-project Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 89bc47d5694440e9bb4756698ab6c4da Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-FlavorsV2NegativeTest-1700862925-project Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-781631652", "imageRef": "30021069-9348-44f6-90b8-a80c9fe07b18", "flavorRef": "452"}} Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: exception: Flavor's memory is too small for requested image. Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-781631652', 'imageRef': '30021069-9348-44f6-90b8-a80c9fe07b18', 'flavorRef': '452'}}} Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:53:13.794677 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jun 16 14:53:13.805223 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:13.814831 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5e5407f5-9dad-4099-9000-1ba6e1c0a5c0 tempest-FlavorsV2NegativeTest-1700862925 tempest-FlavorsV2NegativeTest-1700862925-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:53:13.823711 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5e5407f5-9dad-4099-9000-1ba6e1c0a5c0 tempest-FlavorsV2NegativeTest-1700862925 tempest-FlavorsV2NegativeTest-1700862925-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.185880 Jun 16 14:53:13.830924 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1318/2786] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:53:12 2022] POST /compute/v2.1/servers => generated 93 bytes in 1194 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:53:13.894682 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7ea81b59-e41a-4f7d-a063-807375210acf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:13.899725 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7ea81b59-e41a-4f7d-a063-807375210acf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:13.947024 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ea81b59-e41a-4f7d-a063-807375210acf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:13.948563 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ea81b59-e41a-4f7d-a063-807375210acf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:13.963136 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ea81b59-e41a-4f7d-a063-807375210acf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:13.965507 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7ea81b59-e41a-4f7d-a063-807375210acf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:14.502309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-112a8080-7592-47f2-b014-55477fe89ca8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:14.553223 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-112a8080-7592-47f2-b014-55477fe89ca8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:14.558761 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-112a8080-7592-47f2-b014-55477fe89ca8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:14.564249 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7ea81b59-e41a-4f7d-a063-807375210acf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:14.566009 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-112a8080-7592-47f2-b014-55477fe89ca8 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 3.434108 Jun 16 14:53:14.575356 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1469/2787] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:11 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 3445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:14.579628 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7ea81b59-e41a-4f7d-a063-807375210acf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1323 microversion: 2.1 time: 0.745280 Jun 16 14:53:14.583822 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1319/2788] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:13 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1323 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:14.616415 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-44ae943e-e1ab-4e39-b9dd-8a35f500626c tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:14.617635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-44ae943e-e1ab-4e39-b9dd-8a35f500626c tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: c202a760-9754-497a-8719-b0719e1181ef] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:14.641998 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-44ae943e-e1ab-4e39-b9dd-8a35f500626c tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:14.643180 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-44ae943e-e1ab-4e39-b9dd-8a35f500626c tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:14.644592 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-44ae943e-e1ab-4e39-b9dd-8a35f500626c tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:14.652745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-44ae943e-e1ab-4e39-b9dd-8a35f500626c tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:14.710372 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-44ae943e-e1ab-4e39-b9dd-8a35f500626c tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] HTTP exception thrown: Instance c202a760-9754-497a-8719-b0719e1181ef could not be found. Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-44ae943e-e1ab-4e39-b9dd-8a35f500626c tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Request method failure captured: Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/c202a760-9754-497a-8719-b0719e1181ef HTTP/1.1 Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0MvJ0R4NIFXfn4T9DdbY1PJWoesK-5nib9YvBtnFG9uywU3lbfvtjVN5oqZqx8_RnrO9BysZ0WqJt6XkJRYQmBGZAEbj8GVndngKni5KcW6-DH7CCdrUkWO5n5WzNi_C8qSq70U7P3qWrgvqNpu5Hzg9LouNmytvjJk_TvR4-o3m0Y Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: aa616e014da1416aa7369181bd1518e5 Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-DeleteServersTestJSON-31158303 Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa616e014da1416aa7369181bd1518e5", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa616e014da1416aa7369181bd1518e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa616e014da1416aa7369181bd1518e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa616e014da1416aa7369181bd1518e5"}]}] Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-DeleteServersTestJSON-31158303 Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: aa616e014da1416aa7369181bd1518e5 Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-DeleteServersTestJSON-31158303 Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-DeleteServersTestJSON-31158303-project Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 4e78da3d7a6f45d7abe04bc447f7c870 Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-DeleteServersTestJSON-31158303-project Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance c202a760-9754-497a-8719-b0719e1181ef could not be found. Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'c202a760-9754-497a-8719-b0719e1181ef'} Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c202a760-9754-497a-8719-b0719e1181ef could not be found. Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c202a760-9754-497a-8719-b0719e1181ef could not be found. Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:14.716545 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:14.725324 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:14.725324 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:14.725324 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:14.725324 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:53:14.725324 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:53:14.725324 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c202a760-9754-497a-8719-b0719e1181ef could not be found. Jun 16 14:53:14.725324 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:14.725324 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-44ae943e-e1ab-4e39-b9dd-8a35f500626c tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Returning 404 to user: Instance c202a760-9754-497a-8719-b0719e1181ef could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:53:14.725324 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-44ae943e-e1ab-4e39-b9dd-8a35f500626c tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/c202a760-9754-497a-8719-b0719e1181ef" status: 404 len: 111 microversion: 2.1 time: 0.142120 Jun 16 14:53:14.728114 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1470/2789] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:14 2022] GET /compute/v2.1/servers/c202a760-9754-497a-8719-b0719e1181ef => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:53:14.743178 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-51340465-d60c-4612-a875-052a0b639156 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:14.750493 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-51340465-d60c-4612-a875-052a0b639156 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] [instance: aa828bec-416c-496b-9290-60892a56a452] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:14.788497 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-51340465-d60c-4612-a875-052a0b639156 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:14.791486 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-51340465-d60c-4612-a875-052a0b639156 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:14.794035 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-51340465-d60c-4612-a875-052a0b639156 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:14.795924 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-51340465-d60c-4612-a875-052a0b639156 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:14.859591 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-51340465-d60c-4612-a875-052a0b639156 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] HTTP exception thrown: Instance aa828bec-416c-496b-9290-60892a56a452 could not be found. Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-51340465-d60c-4612-a875-052a0b639156 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Request method failure captured: Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 HTTP/1.1 Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0M0_CzkpfsXSHfRB3JE7CRvCuxKo09QG96KnFHfjR7DyaTTsycyBux6AD9vhcS0lksg20XOedtkY-JPJ6ZwxRsTKdh9gtpUcvfvpxZafZPNHDK545VwZE0-nPkHaGV1_TYqsIrEuz3kJAu-zG9fc-flLbYuAul3e9yndy9A6CEu7Dw Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: 516446d68e6b452c83140a9cf4625619 Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ImagesOneServerTestJSON-649769668 Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_516446d68e6b452c83140a9cf4625619", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/516446d68e6b452c83140a9cf4625619"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/516446d68e6b452c83140a9cf4625619"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/516446d68e6b452c83140a9cf4625619"}]}] Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ImagesOneServerTestJSON-649769668 Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: 516446d68e6b452c83140a9cf4625619 Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-649769668 Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ImagesOneServerTestJSON-649769668-project Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 00c2308f7caf47369c442b63533253de Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ImagesOneServerTestJSON-649769668-project Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance aa828bec-416c-496b-9290-60892a56a452 could not be found. Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': 'aa828bec-416c-496b-9290-60892a56a452'} Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa828bec-416c-496b-9290-60892a56a452 could not be found. Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa828bec-416c-496b-9290-60892a56a452 could not be found. Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:14.867745 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:14.877973 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:14.877973 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:14.877973 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:14.877973 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:53:14.877973 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:53:14.877973 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa828bec-416c-496b-9290-60892a56a452 could not be found. Jun 16 14:53:14.877973 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:14.877973 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-51340465-d60c-4612-a875-052a0b639156 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] Returning 404 to user: Instance aa828bec-416c-496b-9290-60892a56a452 could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:53:14.880490 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-51340465-d60c-4612-a875-052a0b639156 tempest-ImagesOneServerTestJSON-649769668 tempest-ImagesOneServerTestJSON-649769668-project] 10.222.0.57 "GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452" status: 404 len: 111 microversion: 2.1 time: 0.145585 Jun 16 14:53:14.884102 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1471/2790] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:14 2022] GET /compute/v2.1/servers/aa828bec-416c-496b-9290-60892a56a452 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:53:15.115626 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-e35c0884-c620-409b-853e-0d514851ce76 req-d349ab5b-a3ff-413c-a57b-9262a3ff4ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d33c522d-8fb2-4c37-a15c-e1af48406b09", "tag": "ec0d2b71-c14d-45e2-a4df-8add2d7ca30f"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:15.148425 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-e35c0884-c620-409b-853e-0d514851ce76 req-d349ab5b-a3ff-413c-a57b-9262a3ff4ec4 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:15.149668 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-e35c0884-c620-409b-853e-0d514851ce76 req-d349ab5b-a3ff-413c-a57b-9262a3ff4ec4 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:15.199051 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-e35c0884-c620-409b-853e-0d514851ce76 req-d349ab5b-a3ff-413c-a57b-9262a3ff4ec4 service nova] Creating event network-changed:ec0d2b71-c14d-45e2-a4df-8add2d7ca30f for instance d33c522d-8fb2-4c37-a15c-e1af48406b09 on n-h1-836830-4 Jun 16 14:53:15.214164 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-e35c0884-c620-409b-853e-0d514851ce76 req-d349ab5b-a3ff-413c-a57b-9262a3ff4ec4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.626995 Jun 16 14:53:15.224634 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1320/2791] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:15.311779 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-f9bcc354-92e5-4ac5-bb3b-96380c798641 req-30b5d8d1-a31c-4320-825c-dede1ddc2d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930c35e3-db68-47f4-9f47-06f74b96bebf", "name": "network-vif-plugged", "status": "completed", "tag": "f7ff22c8-ceb6-4415-8bab-0960e76eef51"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:15.382546 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-f9bcc354-92e5-4ac5-bb3b-96380c798641 req-30b5d8d1-a31c-4320-825c-dede1ddc2d0e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:15.388918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-f9bcc354-92e5-4ac5-bb3b-96380c798641 req-30b5d8d1-a31c-4320-825c-dede1ddc2d0e service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:15.477477 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-f9bcc354-92e5-4ac5-bb3b-96380c798641 req-30b5d8d1-a31c-4320-825c-dede1ddc2d0e service nova] Creating event network-vif-plugged:f7ff22c8-ceb6-4415-8bab-0960e76eef51 for instance 930c35e3-db68-47f4-9f47-06f74b96bebf on n-h1-836830-4 Jun 16 14:53:15.505188 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-f9bcc354-92e5-4ac5-bb3b-96380c798641 req-30b5d8d1-a31c-4320-825c-dede1ddc2d0e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202193 Jun 16 14:53:15.514112 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1472/2792] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:15.613904 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d8cfb2e3-b6a8-4ae1-9752-9680b78f1ac4 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:15.629580 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d8cfb2e3-b6a8-4ae1-9752-9680b78f1ac4 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:15.631135 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-8890763", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "8f2bdb2a-89e7-4760-bf67-a768c01f1b49"}]}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:15.661051 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d8cfb2e3-b6a8-4ae1-9752-9680b78f1ac4 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:15.664517 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d8cfb2e3-b6a8-4ae1-9752-9680b78f1ac4 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:15.673073 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d8cfb2e3-b6a8-4ae1-9752-9680b78f1ac4 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:15.677773 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d8cfb2e3-b6a8-4ae1-9752-9680b78f1ac4 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:15.805074 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] validate_networks() for [('8f2bdb2a-89e7-4760-bf67-a768c01f1b49', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:53:16.478025 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=2 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:17.320084 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d8cfb2e3-b6a8-4ae1-9752-9680b78f1ac4 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:17.350561 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d8cfb2e3-b6a8-4ae1-9752-9680b78f1ac4 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:17.356369 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d8cfb2e3-b6a8-4ae1-9752-9680b78f1ac4 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:17.360482 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d8cfb2e3-b6a8-4ae1-9752-9680b78f1ac4 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 1.758151 Jun 16 14:53:17.362519 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1473/2793] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:15 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:53:17.372923 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1d055def-bc64-490c-8866-6888f96559b1 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:17.376240 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1d055def-bc64-490c-8866-6888f96559b1 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:17.394649 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1d055def-bc64-490c-8866-6888f96559b1 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:17.396383 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1d055def-bc64-490c-8866-6888f96559b1 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:17.400774 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1d055def-bc64-490c-8866-6888f96559b1 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:17.402150 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1d055def-bc64-490c-8866-6888f96559b1 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:17.696989 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:53:17.699352 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:53:17.700576 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:53:17.702408 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:53:17.703952 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:53:17.757920 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:17.759116 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:17.764519 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:17.765625 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:17.811981 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Getting quotas for project aa616e014da1416aa7369181bd1518e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:53:17.825249 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Getting quotas for user 4e78da3d7a6f45d7abe04bc447f7c870 and project aa616e014da1416aa7369181bd1518e5. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:53:17.857771 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:53:17.862879 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:53:17.959843 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1d055def-bc64-490c-8866-6888f96559b1 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:17.978521 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1d055def-bc64-490c-8866-6888f96559b1 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1323 microversion: 2.1 time: 0.613293 Jun 16 14:53:17.979704 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1474/2794] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:17 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1323 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:17.995235 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-7243b46c-d673-4746-857a-75a0ca407242 req-d6227ba3-b41e-4005-bce9-c71e830978d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa828bec-416c-496b-9290-60892a56a452", "name": "network-vif-deleted", "tag": "50551314-0d91-4b89-ae9d-7adae8fcf3a6"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:18.053968 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-7243b46c-d673-4746-857a-75a0ca407242 req-d6227ba3-b41e-4005-bce9-c71e830978d0 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:18.055061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-7243b46c-d673-4746-857a-75a0ca407242 req-d6227ba3-b41e-4005-bce9-c71e830978d0 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:18.085106 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-7243b46c-d673-4746-857a-75a0ca407242 req-d6227ba3-b41e-4005-bce9-c71e830978d0 service nova] Creating event network-vif-deleted:50551314-0d91-4b89-ae9d-7adae8fcf3a6 for instance aa828bec-416c-496b-9290-60892a56a452 on n-h2-836830-4 Jun 16 14:53:18.096620 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-7243b46c-d673-4746-857a-75a0ca407242 req-d6227ba3-b41e-4005-bce9-c71e830978d0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115034 Jun 16 14:53:18.111329 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1475/2795] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:18.119004 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-49e26773-f80f-4bbb-98c1-4e8524e0e4bf req-6836b4fd-8ec6-4130-98a7-54d4cee5468f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f54e74-9834-449d-8a62-2f33df36a320", "name": "network-vif-plugged", "status": "completed", "tag": "44f50a71-e68c-45a7-8b61-e0a5daa83c9b"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:18.127451 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5c0a54ac-8c4c-4049-abcd-71a39ff8dd7a tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.534230 Jun 16 14:53:18.142944 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1321/2796] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:53:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:53:18.160652 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-133022322", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2812d94b-8d16-4f39-8e38-75c97c244ce8"}], "security_groups": [{"name": "tempest-securitygroup--2099198853"}], "key_name": "tempest-keypair-1742892133", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:18.185247 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-49e26773-f80f-4bbb-98c1-4e8524e0e4bf req-6836b4fd-8ec6-4130-98a7-54d4cee5468f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:18.185561 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-49e26773-f80f-4bbb-98c1-4e8524e0e4bf req-6836b4fd-8ec6-4130-98a7-54d4cee5468f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:18.255079 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-49e26773-f80f-4bbb-98c1-4e8524e0e4bf req-6836b4fd-8ec6-4130-98a7-54d4cee5468f service nova] Creating event network-vif-plugged:44f50a71-e68c-45a7-8b61-e0a5daa83c9b for instance a6f54e74-9834-449d-8a62-2f33df36a320 on n-h2-836830-4 Jun 16 14:53:18.267746 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-49e26773-f80f-4bbb-98c1-4e8524e0e4bf req-6836b4fd-8ec6-4130-98a7-54d4cee5468f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159520 Jun 16 14:53:18.271887 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1476/2797] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:18.282853 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-981064e5-0872-43d1-948c-96adf3bdd83f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:18.285376 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-981064e5-0872-43d1-948c-96adf3bdd83f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:18.667451 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-981064e5-0872-43d1-948c-96adf3bdd83f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:18.677471 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-981064e5-0872-43d1-948c-96adf3bdd83f tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1212 microversion: 2.1 time: 0.404131 Jun 16 14:53:18.699133 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1477/2798] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:18 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1212 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:18.705619 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d2d367e8-9d17-4d6d-b57a-fc879e1f13d7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:18.718559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d2d367e8-9d17-4d6d-b57a-fc879e1f13d7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:18.754914 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d2d367e8-9d17-4d6d-b57a-fc879e1f13d7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:18.757474 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d2d367e8-9d17-4d6d-b57a-fc879e1f13d7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:18.764010 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d2d367e8-9d17-4d6d-b57a-fc879e1f13d7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:18.767252 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d2d367e8-9d17-4d6d-b57a-fc879e1f13d7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:19.853322 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] validate_networks() for [('2812d94b-8d16-4f39-8e38-75c97c244ce8', None, None, None, None, None)] {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:53:19.916479 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d2d367e8-9d17-4d6d-b57a-fc879e1f13d7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:19.963519 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d2d367e8-9d17-4d6d-b57a-fc879e1f13d7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:19.968882 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d2d367e8-9d17-4d6d-b57a-fc879e1f13d7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:19.979300 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d2d367e8-9d17-4d6d-b57a-fc879e1f13d7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 1.278259 Jun 16 14:53:19.980739 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1478/2799] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:18 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:20.002157 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-45e4d6ec-7345-40e6-9834-a81d3cf714c7 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:20.003026 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-45e4d6ec-7345-40e6-9834-a81d3cf714c7 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:20.024708 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-45e4d6ec-7345-40e6-9834-a81d3cf714c7 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:20.025166 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-45e4d6ec-7345-40e6-9834-a81d3cf714c7 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:20.027306 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-45e4d6ec-7345-40e6-9834-a81d3cf714c7 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:20.027987 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-45e4d6ec-7345-40e6-9834-a81d3cf714c7 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:20.780954 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-45e4d6ec-7345-40e6-9834-a81d3cf714c7 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:20.797783 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-45e4d6ec-7345-40e6-9834-a81d3cf714c7 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1516 microversion: 2.1 time: 0.803370 Jun 16 14:53:20.801866 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1479/2800] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:19 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1516 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:20.824090 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f01a23b4-f02d-41a6-8661-1491f295c7ce tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:20.824388 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f01a23b4-f02d-41a6-8661-1491f295c7ce tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:20.840751 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f01a23b4-f02d-41a6-8661-1491f295c7ce tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:20.842224 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f01a23b4-f02d-41a6-8661-1491f295c7ce tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:20.843629 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f01a23b4-f02d-41a6-8661-1491f295c7ce tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:20.846875 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f01a23b4-f02d-41a6-8661-1491f295c7ce tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:21.214637 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f01a23b4-f02d-41a6-8661-1491f295c7ce tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:21.238172 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f01a23b4-f02d-41a6-8661-1491f295c7ce tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1272 microversion: 2.1 time: 0.433238 Jun 16 14:53:21.243134 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1480/2801] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:20 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1272 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:21.823554 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-abb0df76-a197-49df-ae37-142713e7a856 req-f29a9ab8-2de3-4785-89c1-38386ebe877b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c202a760-9754-497a-8719-b0719e1181ef", "tag": "906e7800-0448-42ed-b7b8-0654c1b53299"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:21.852550 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-abb0df76-a197-49df-ae37-142713e7a856 req-f29a9ab8-2de3-4785-89c1-38386ebe877b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:21.855182 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-abb0df76-a197-49df-ae37-142713e7a856 req-f29a9ab8-2de3-4785-89c1-38386ebe877b service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:21.898301 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-abb0df76-a197-49df-ae37-142713e7a856 req-f29a9ab8-2de3-4785-89c1-38386ebe877b service nova] Creating event network-changed:906e7800-0448-42ed-b7b8-0654c1b53299 for instance c202a760-9754-497a-8719-b0719e1181ef on n-h1-836830-4 Jun 16 14:53:21.916044 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-abb0df76-a197-49df-ae37-142713e7a856 req-f29a9ab8-2de3-4785-89c1-38386ebe877b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.670478 Jun 16 14:53:21.921437 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1481/2802] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:21.945049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7632e66b-64d6-4f15-a00a-b780aafb3750 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:21.948119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7632e66b-64d6-4f15-a00a-b780aafb3750 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: a6f54e74-9834-449d-8a62-2f33df36a320] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:21.978953 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7632e66b-64d6-4f15-a00a-b780aafb3750 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:21.978953 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7632e66b-64d6-4f15-a00a-b780aafb3750 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:21.980401 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7632e66b-64d6-4f15-a00a-b780aafb3750 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:21.981142 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7632e66b-64d6-4f15-a00a-b780aafb3750 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:22.449415 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7632e66b-64d6-4f15-a00a-b780aafb3750 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:22.467443 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7632e66b-64d6-4f15-a00a-b780aafb3750 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320" status: 200 len: 1516 microversion: 2.1 time: 0.543047 Jun 16 14:53:22.468914 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1482/2803] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:21 2022] GET /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320 => generated 1516 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:22.474048 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1c8a104c-3a46-4d40-a727-790ab609167b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:22.487371 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-1c8a104c-3a46-4d40-a727-790ab609167b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:22.495836 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1c8a104c-3a46-4d40-a727-790ab609167b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:22.497573 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1c8a104c-3a46-4d40-a727-790ab609167b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:22.500843 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1c8a104c-3a46-4d40-a727-790ab609167b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:22.501630 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-1c8a104c-3a46-4d40-a727-790ab609167b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:23.260515 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1c8a104c-3a46-4d40-a727-790ab609167b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:23.287253 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1c8a104c-3a46-4d40-a727-790ab609167b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:23.293899 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1c8a104c-3a46-4d40-a727-790ab609167b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:23.297178 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1c8a104c-3a46-4d40-a727-790ab609167b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 0.826043 Jun 16 14:53:23.297648 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1483/2804] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:22 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:23.302819 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f1379ce8-e43a-4950-be21-85915bf9e651 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:23.305496 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f1379ce8-e43a-4950-be21-85915bf9e651 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:23.312835 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f1379ce8-e43a-4950-be21-85915bf9e651 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:23.313923 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f1379ce8-e43a-4950-be21-85915bf9e651 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:23.315420 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f1379ce8-e43a-4950-be21-85915bf9e651 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:23.327638 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f1379ce8-e43a-4950-be21-85915bf9e651 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:23.518773 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f1379ce8-e43a-4950-be21-85915bf9e651 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:23.527361 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f1379ce8-e43a-4950-be21-85915bf9e651 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1270 microversion: 2.1 time: 0.228294 Jun 16 14:53:23.531646 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1484/2805] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:23 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1270 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:23.556418 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6c795665-e800-4967-92f8-2e18f15e93bb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:23.557910 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6c795665-e800-4967-92f8-2e18f15e93bb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 9d3e4c1a-dfce-477f-b0a6-990624d387cb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:23.572512 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c795665-e800-4967-92f8-2e18f15e93bb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:23.574684 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c795665-e800-4967-92f8-2e18f15e93bb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:23.576049 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c795665-e800-4967-92f8-2e18f15e93bb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:23.582283 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6c795665-e800-4967-92f8-2e18f15e93bb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:23.944696 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6c795665-e800-4967-92f8-2e18f15e93bb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:23.963058 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:23.969612 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6c795665-e800-4967-92f8-2e18f15e93bb tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb" status: 200 len: 1517 microversion: 2.1 time: 0.434903 Jun 16 14:53:23.975958 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1485/2806] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:23 2022] GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb => generated 1517 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:24.002881 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e0d09a9f-0796-49fb-983c-85fcbe791370 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:24.003726 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e0d09a9f-0796-49fb-983c-85fcbe791370 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 9d3e4c1a-dfce-477f-b0a6-990624d387cb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:24.017718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0d09a9f-0796-49fb-983c-85fcbe791370 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:24.018936 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0d09a9f-0796-49fb-983c-85fcbe791370 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:24.021206 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0d09a9f-0796-49fb-983c-85fcbe791370 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:24.021919 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e0d09a9f-0796-49fb-983c-85fcbe791370 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:24.095033 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e0d09a9f-0796-49fb-983c-85fcbe791370 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 9d3e4c1a-dfce-477f-b0a6-990624d387cb] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:53:24.278078 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e0d09a9f-0796-49fb-983c-85fcbe791370 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb" status: 204 len: 0 microversion: 2.1 time: 0.282835 Jun 16 14:53:24.278970 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1486/2807] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:53:23 2022] DELETE /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:53:24.300776 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-f69e6741-a6df-4bb0-8e83-585461a38dea tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:24.302119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-f69e6741-a6df-4bb0-8e83-585461a38dea tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 9d3e4c1a-dfce-477f-b0a6-990624d387cb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:24.318625 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f69e6741-a6df-4bb0-8e83-585461a38dea tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:24.319919 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f69e6741-a6df-4bb0-8e83-585461a38dea tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:24.323551 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f69e6741-a6df-4bb0-8e83-585461a38dea tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:24.333711 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-f69e6741-a6df-4bb0-8e83-585461a38dea tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:24.745903 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Getting quotas for project cbb2d93a8ca24b4cb81e316025504ef5. Resources: dict_keys(['metadata_items']) {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:53:24.774651 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Getting quotas for user 67b034bd6e71471bb3653eabbd5da828 and project cbb2d93a8ca24b4cb81e316025504ef5. Resources: dict_keys(['metadata_items']) {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:53:24.806180 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-f69e6741-a6df-4bb0-8e83-585461a38dea tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:24.817603 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-f69e6741-a6df-4bb0-8e83-585461a38dea tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb" status: 200 len: 1523 microversion: 2.1 time: 0.531639 Jun 16 14:53:24.828982 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1487/2808] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:24 2022] GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb => generated 1523 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:24.835573 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-25510bdb-157f-4855-9fbd-bd8f5b0d60e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:24.836430 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-25510bdb-157f-4855-9fbd-bd8f5b0d60e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:24.845559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25510bdb-157f-4855-9fbd-bd8f5b0d60e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:24.846203 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25510bdb-157f-4855-9fbd-bd8f5b0d60e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:24.847159 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25510bdb-157f-4855-9fbd-bd8f5b0d60e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:24.847715 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-25510bdb-157f-4855-9fbd-bd8f5b0d60e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:24.856155 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:53:24.859831 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:53:24.860393 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:53:24.860846 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:53:24.865709 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:53:24.875285 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:24.906221 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:24.906996 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:24.908851 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:24.909543 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:24.943492 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Getting quotas for project cbb2d93a8ca24b4cb81e316025504ef5. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:53:24.953741 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Getting quotas for user 67b034bd6e71471bb3653eabbd5da828 and project cbb2d93a8ca24b4cb81e316025504ef5. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:53:24.991366 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:53:24.995976 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:53:25.084313 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-cec0b03c-7912-4ffa-8cf9-f7d802af0b1d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 6.939759 Jun 16 14:53:25.085385 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1322/2809] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:53:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 6942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:53:25.099112 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-4a549238-d804-4110-b8f7-79e40265fd78 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:25.100128 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-4a549238-d804-4110-b8f7-79e40265fd78 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:25.109960 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4a549238-d804-4110-b8f7-79e40265fd78 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:25.111300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4a549238-d804-4110-b8f7-79e40265fd78 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:25.113603 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4a549238-d804-4110-b8f7-79e40265fd78 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:25.114409 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-4a549238-d804-4110-b8f7-79e40265fd78 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:25.930745 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-25510bdb-157f-4855-9fbd-bd8f5b0d60e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:25.974342 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-25510bdb-157f-4855-9fbd-bd8f5b0d60e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:25.978325 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-25510bdb-157f-4855-9fbd-bd8f5b0d60e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:25.994553 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-25510bdb-157f-4855-9fbd-bd8f5b0d60e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 1.163812 Jun 16 14:53:25.996179 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1488/2810] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:24 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:26.009681 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-73bcf3a8-4b05-4e9b-b69c-3ed2536565c0 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:26.013784 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-73bcf3a8-4b05-4e9b-b69c-3ed2536565c0 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:26.368477 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-73bcf3a8-4b05-4e9b-b69c-3ed2536565c0 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b034bd6e71471bb3653eabbd5da828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb2d93a8ca24b4cb81e316025504ef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:26.377232 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-73bcf3a8-4b05-4e9b-b69c-3ed2536565c0 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d" status: 200 len: 1277 microversion: 2.1 time: 0.378228 Jun 16 14:53:26.383143 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1489/2811] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:25 2022] GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d => generated 1277 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:26.391451 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b205e872-4742-440a-814c-c010366af366 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:26.392191 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b205e872-4742-440a-814c-c010366af366 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 9d3e4c1a-dfce-477f-b0a6-990624d387cb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:26.407576 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b205e872-4742-440a-814c-c010366af366 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:26.408919 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b205e872-4742-440a-814c-c010366af366 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:26.412026 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b205e872-4742-440a-814c-c010366af366 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:26.423249 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b205e872-4742-440a-814c-c010366af366 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:26.568519 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-4a549238-d804-4110-b8f7-79e40265fd78 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:26.598275 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-4a549238-d804-4110-b8f7-79e40265fd78 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1270 microversion: 2.1 time: 1.504962 Jun 16 14:53:26.624592 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1323/2812] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:25 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1270 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:26.851772 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b205e872-4742-440a-814c-c010366af366 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:26.864637 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b205e872-4742-440a-814c-c010366af366 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb" status: 200 len: 1523 microversion: 2.1 time: 0.480176 Jun 16 14:53:26.870621 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1490/2813] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:26 2022] GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb => generated 1523 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:27.038826 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5c8f6984-5743-43d2-92cb-ef7bd51284fe tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:27.040188 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5c8f6984-5743-43d2-92cb-ef7bd51284fe tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:27.063370 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c8f6984-5743-43d2-92cb-ef7bd51284fe tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:27.064606 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c8f6984-5743-43d2-92cb-ef7bd51284fe tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:27.068959 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c8f6984-5743-43d2-92cb-ef7bd51284fe tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:27.070919 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-5c8f6984-5743-43d2-92cb-ef7bd51284fe tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:27.152899 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=50 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:27.200571 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-b0f9c20e-67c1-4884-b4a7-3acf91da0d47 req-150bf8a8-3436-4988-be43-b43ebc4a381c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c202a760-9754-497a-8719-b0719e1181ef", "name": "network-vif-deleted", "tag": "906e7800-0448-42ed-b7b8-0654c1b53299"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:27.221311 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-b0f9c20e-67c1-4884-b4a7-3acf91da0d47 req-150bf8a8-3436-4988-be43-b43ebc4a381c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:27.221901 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-b0f9c20e-67c1-4884-b4a7-3acf91da0d47 req-150bf8a8-3436-4988-be43-b43ebc4a381c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:27.268952 n-d-836830-4 devstack@n-api.service[125862]: /opt/stack/nova/nova/db/main/api.py:1842: SAWarning: Multiple rows returned with uselist=False for eagerly-loaded attribute 'Instance.extra' Jun 16 14:53:27.268952 n-d-836830-4 devstack@n-api.service[125862]: instances = query_prefix.all() Jun 16 14:53:27.280318 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-b0f9c20e-67c1-4884-b4a7-3acf91da0d47 req-150bf8a8-3436-4988-be43-b43ebc4a381c service nova] Creating event network-vif-deleted:906e7800-0448-42ed-b7b8-0654c1b53299 for instance c202a760-9754-497a-8719-b0719e1181ef on n-h1-836830-4 Jun 16 14:53:27.299583 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-b0f9c20e-67c1-4884-b4a7-3acf91da0d47 req-150bf8a8-3436-4988-be43-b43ebc4a381c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105015 Jun 16 14:53:27.305094 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1491/2814] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:27.415718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6f4bbe30-ecd5-4405-aa86-25511369fa3e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:27.420515 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6f4bbe30-ecd5-4405-aa86-25511369fa3e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:27.447104 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=96,nova_api:UPDATE=3 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:27.449446 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f4bbe30-ecd5-4405-aa86-25511369fa3e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:27.452086 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f4bbe30-ecd5-4405-aa86-25511369fa3e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:27.454360 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f4bbe30-ecd5-4405-aa86-25511369fa3e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:27.459513 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6f4bbe30-ecd5-4405-aa86-25511369fa3e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:27.797925 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6f4bbe30-ecd5-4405-aa86-25511369fa3e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b034bd6e71471bb3653eabbd5da828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb2d93a8ca24b4cb81e316025504ef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:27.819701 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6f4bbe30-ecd5-4405-aa86-25511369fa3e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d" status: 200 len: 1329 microversion: 2.1 time: 0.411573 Jun 16 14:53:27.831507 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1492/2815] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:27 2022] GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d => generated 1329 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:53:27.837247 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-127cd276-5e88-47f2-9e2f-0ceb3a68f8ab tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '.version_select at 0x7fdeff40ce50>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:27.892491 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-127cd276-5e88-47f2-9e2f-0ceb3a68f8ab tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/images/c398f977-5e1a-4a84-a2cf-8c5a198c1c6e" status: 200 len: 662 microversion: 2.1 time: 0.059393 Jun 16 14:53:27.902220 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1493/2816] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:53:27 2022] GET /compute/v2.1/images/c398f977-5e1a-4a84-a2cf-8c5a198c1c6e => generated 662 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:27.909857 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ec6b7a96-e89b-4db6-9cd4-618e4b7bbdd7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:27.910919 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ec6b7a96-e89b-4db6-9cd4-618e4b7bbdd7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:27.920470 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec6b7a96-e89b-4db6-9cd4-618e4b7bbdd7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:27.921346 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec6b7a96-e89b-4db6-9cd4-618e4b7bbdd7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:27.922680 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec6b7a96-e89b-4db6-9cd4-618e4b7bbdd7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:27.923319 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ec6b7a96-e89b-4db6-9cd4-618e4b7bbdd7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:28.082039 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ec6b7a96-e89b-4db6-9cd4-618e4b7bbdd7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:28.096796 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ec6b7a96-e89b-4db6-9cd4-618e4b7bbdd7 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1270 microversion: 2.1 time: 0.190907 Jun 16 14:53:28.097753 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1494/2817] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:27 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1270 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:28.112247 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b433b070-aa58-4e0d-aed7-930d030ae170 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:28.112936 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b433b070-aa58-4e0d-aed7-930d030ae170 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 9d3e4c1a-dfce-477f-b0a6-990624d387cb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:28.120676 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b433b070-aa58-4e0d-aed7-930d030ae170 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:28.121299 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b433b070-aa58-4e0d-aed7-930d030ae170 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:28.122211 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b433b070-aa58-4e0d-aed7-930d030ae170 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:28.122837 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b433b070-aa58-4e0d-aed7-930d030ae170 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:28.534143 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5c8f6984-5743-43d2-92cb-ef7bd51284fe tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:28.545840 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5c8f6984-5743-43d2-92cb-ef7bd51284fe tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:28.547662 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5c8f6984-5743-43d2-92cb-ef7bd51284fe tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:28.557391 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5c8f6984-5743-43d2-92cb-ef7bd51284fe tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 1.532151 Jun 16 14:53:28.561975 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1324/2818] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:27 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:28.567666 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ecb96ecb-b6b7-48b9-b490-8f1f6b0e80bd tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '.version_select at 0x7fdeff1a64c0>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:28.616836 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b433b070-aa58-4e0d-aed7-930d030ae170 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:28.629648 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b433b070-aa58-4e0d-aed7-930d030ae170 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb" status: 200 len: 1523 microversion: 2.1 time: 0.529270 Jun 16 14:53:28.631471 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1495/2819] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:28 2022] GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb => generated 1523 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:28.728027 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ecb96ecb-b6b7-48b9-b490-8f1f6b0e80bd tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/images/c398f977-5e1a-4a84-a2cf-8c5a198c1c6e" status: 200 len: 662 microversion: 2.1 time: 0.164497 Jun 16 14:53:28.729361 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1325/2820] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:53:28 2022] GET /compute/v2.1/images/c398f977-5e1a-4a84-a2cf-8c5a198c1c6e => generated 662 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:28.860803 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8f1d58e0-949b-44ba-9bd4-5a3390ed135d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:28.862860 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8f1d58e0-949b-44ba-9bd4-5a3390ed135d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:28.884660 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f1d58e0-949b-44ba-9bd4-5a3390ed135d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:28.885695 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f1d58e0-949b-44ba-9bd4-5a3390ed135d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:28.888287 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f1d58e0-949b-44ba-9bd4-5a3390ed135d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:28.889883 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8f1d58e0-949b-44ba-9bd4-5a3390ed135d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:29.096552 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8f1d58e0-949b-44ba-9bd4-5a3390ed135d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b034bd6e71471bb3653eabbd5da828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb2d93a8ca24b4cb81e316025504ef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:29.123194 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-43dff408-4ea3-4b71-a009-3bc63c0b34ea tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:29.128193 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-43dff408-4ea3-4b71-a009-3bc63c0b34ea tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:29.136255 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8f1d58e0-949b-44ba-9bd4-5a3390ed135d tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d" status: 200 len: 1335 microversion: 2.1 time: 0.300557 Jun 16 14:53:29.141812 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1496/2821] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:28 2022] GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d => generated 1335 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:29.158420 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-43dff408-4ea3-4b71-a009-3bc63c0b34ea tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:29.159437 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-43dff408-4ea3-4b71-a009-3bc63c0b34ea tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:29.160997 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-43dff408-4ea3-4b71-a009-3bc63c0b34ea tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:29.161816 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-43dff408-4ea3-4b71-a009-3bc63c0b34ea tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:29.599330 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-93057f58-9d57-4759-89d2-38f46ca9a332 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:29.603540 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-93057f58-9d57-4759-89d2-38f46ca9a332 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:29.635573 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-93057f58-9d57-4759-89d2-38f46ca9a332 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:29.637635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-93057f58-9d57-4759-89d2-38f46ca9a332 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:29.639924 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-93057f58-9d57-4759-89d2-38f46ca9a332 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:29.642833 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-93057f58-9d57-4759-89d2-38f46ca9a332 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:30.809400 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-93057f58-9d57-4759-89d2-38f46ca9a332 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:30.824688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-93057f58-9d57-4759-89d2-38f46ca9a332 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:30.837848 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-93057f58-9d57-4759-89d2-38f46ca9a332 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:30.842911 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-93057f58-9d57-4759-89d2-38f46ca9a332 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 1.251349 Jun 16 14:53:30.849684 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1497/2822] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:29 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:53:30.864871 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9b22d8b5-2170-4461-a867-e6952a2e18d2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:30.867400 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9b22d8b5-2170-4461-a867-e6952a2e18d2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 9d3e4c1a-dfce-477f-b0a6-990624d387cb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:30.893990 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9b22d8b5-2170-4461-a867-e6952a2e18d2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:30.900005 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9b22d8b5-2170-4461-a867-e6952a2e18d2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:30.902913 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9b22d8b5-2170-4461-a867-e6952a2e18d2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:30.905560 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9b22d8b5-2170-4461-a867-e6952a2e18d2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:31.117100 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-43dff408-4ea3-4b71-a009-3bc63c0b34ea tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:31.158907 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-43dff408-4ea3-4b71-a009-3bc63c0b34ea tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1312 microversion: 2.1 time: 2.045304 Jun 16 14:53:31.177256 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1326/2823] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:29 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1312 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:31.195597 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-662bbd8d-ff57-4c4c-828c-fa4b3ac9a94f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:31.196369 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-662bbd8d-ff57-4c4c-828c-fa4b3ac9a94f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:31.237725 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9b22d8b5-2170-4461-a867-e6952a2e18d2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:31.242819 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-662bbd8d-ff57-4c4c-828c-fa4b3ac9a94f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:31.243670 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-662bbd8d-ff57-4c4c-828c-fa4b3ac9a94f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:31.245105 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-662bbd8d-ff57-4c4c-828c-fa4b3ac9a94f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:31.245885 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-662bbd8d-ff57-4c4c-828c-fa4b3ac9a94f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:31.275348 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9b22d8b5-2170-4461-a867-e6952a2e18d2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb" status: 200 len: 1481 microversion: 2.1 time: 0.423387 Jun 16 14:53:31.279170 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1498/2824] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:30 2022] GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb => generated 1481 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:31.398195 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d8128ba6-1d56-4fb0-9210-8604b2190bf2 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '.version_select at 0x7fdeff414b80>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:31.490101 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d8128ba6-1d56-4fb0-9210-8604b2190bf2 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/images/83e712a6-3848-4375-96cc-6284a1f85275" status: 200 len: 662 microversion: 2.1 time: 0.097056 Jun 16 14:53:31.499752 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1499/2825] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:53:31 2022] GET /compute/v2.1/images/83e712a6-3848-4375-96cc-6284a1f85275 => generated 662 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:31.509654 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-44837cf8-1885-4ad3-8c35-8e709506ae0b tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '.version_select at 0x7fdeff3dbc10>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:31.594723 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-44837cf8-1885-4ad3-8c35-8e709506ae0b tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/images/83e712a6-3848-4375-96cc-6284a1f85275" status: 200 len: 662 microversion: 2.1 time: 0.093402 Jun 16 14:53:31.595544 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1500/2826] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:53:31 2022] GET /compute/v2.1/images/83e712a6-3848-4375-96cc-6284a1f85275 => generated 662 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:31.757742 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-6de2bd1e-59e3-4c4c-839f-75547dbdef27 req-14c68e25-a930-482f-983c-fba9ad2d4506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3e4c1a-dfce-477f-b0a6-990624d387cb", "name": "network-vif-deleted", "tag": "3deab345-0596-4db1-8cb6-ed28e95a2aa7"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:31.778349 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-6de2bd1e-59e3-4c4c-839f-75547dbdef27 req-14c68e25-a930-482f-983c-fba9ad2d4506 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:31.780073 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-6de2bd1e-59e3-4c4c-839f-75547dbdef27 req-14c68e25-a930-482f-983c-fba9ad2d4506 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:31.804856 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-6de2bd1e-59e3-4c4c-839f-75547dbdef27 req-14c68e25-a930-482f-983c-fba9ad2d4506 service nova] Creating event network-vif-deleted:3deab345-0596-4db1-8cb6-ed28e95a2aa7 for instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb on n-h2-836830-4 Jun 16 14:53:31.821288 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-6de2bd1e-59e3-4c4c-839f-75547dbdef27 req-14c68e25-a930-482f-983c-fba9ad2d4506 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067758 Jun 16 14:53:31.823032 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1501/2827] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:53:31.883609 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-7c1f0ecc-e662-40c4-b637-ce26a3ef73b7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:31.884577 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-7c1f0ecc-e662-40c4-b637-ce26a3ef73b7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:31.904670 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7c1f0ecc-e662-40c4-b637-ce26a3ef73b7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:31.905751 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7c1f0ecc-e662-40c4-b637-ce26a3ef73b7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:31.907006 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7c1f0ecc-e662-40c4-b637-ce26a3ef73b7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:31.907718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-7c1f0ecc-e662-40c4-b637-ce26a3ef73b7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:32.239710 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-662bbd8d-ff57-4c4c-828c-fa4b3ac9a94f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b034bd6e71471bb3653eabbd5da828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb2d93a8ca24b4cb81e316025504ef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:32.249499 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-662bbd8d-ff57-4c4c-828c-fa4b3ac9a94f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d" status: 200 len: 1403 microversion: 2.1 time: 1.064921 Jun 16 14:53:32.252604 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1327/2828] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:31 2022] GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d => generated 1403 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:32.264983 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-7a57b5e7-0110-4497-86d4-2bc5b69189c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:32.266907 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-7a57b5e7-0110-4497-86d4-2bc5b69189c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:32.274143 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a57b5e7-0110-4497-86d4-2bc5b69189c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:32.276158 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a57b5e7-0110-4497-86d4-2bc5b69189c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:32.277603 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a57b5e7-0110-4497-86d4-2bc5b69189c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:32.278260 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-7a57b5e7-0110-4497-86d4-2bc5b69189c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:32.674779 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-7a57b5e7-0110-4497-86d4-2bc5b69189c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:32.696607 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-7a57b5e7-0110-4497-86d4-2bc5b69189c0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1312 microversion: 2.1 time: 0.439301 Jun 16 14:53:32.705751 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1328/2829] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:32 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1312 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:32.720404 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c2b9d3d7-2c43-4679-bce4-f5a7949dca84 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:32.721049 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-c2b9d3d7-2c43-4679-bce4-f5a7949dca84 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 9d3e4c1a-dfce-477f-b0a6-990624d387cb] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:32.741759 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c2b9d3d7-2c43-4679-bce4-f5a7949dca84 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:32.743551 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c2b9d3d7-2c43-4679-bce4-f5a7949dca84 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:32.744742 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c2b9d3d7-2c43-4679-bce4-f5a7949dca84 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:32.747145 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-c2b9d3d7-2c43-4679-bce4-f5a7949dca84 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:32.777407 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-c2b9d3d7-2c43-4679-bce4-f5a7949dca84 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] HTTP exception thrown: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c2b9d3d7-2c43-4679-bce4-f5a7949dca84 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Request method failure captured: Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb HTTP/1.1 Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0OivVftuMT4fWjf7lHTJ023UG8jbsasJncBydH6aTqjoU4BNjTSSJ1Xva4OMO0PAM11RP2Wz65pJnEFMDDVD96zApDHY2itiValHUQyGn4bHK_199kZAxuVWWT_8_REYAyzrrutrdDsosiJqjFqV6fJdkzNH9puAeaMbmfd-7fbxPM Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa0ce43c5ac64864b458514ebdc5ad1a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa0ce43c5ac64864b458514ebdc5ad1a"}]}] Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 2f53e4d9a56c47089527b650611fa453 Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '9d3e4c1a-dfce-477f-b0a6-990624d387cb'} Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:32.780817 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:32.785977 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:32.785977 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:32.785977 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:32.785977 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:53:32.785977 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:53:32.785977 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. Jun 16 14:53:32.785977 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:32.787940 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-c2b9d3d7-2c43-4679-bce4-f5a7949dca84 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Returning 404 to user: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:53:32.789009 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-c2b9d3d7-2c43-4679-bce4-f5a7949dca84 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb" status: 404 len: 111 microversion: 2.1 time: 0.082232 Jun 16 14:53:32.789901 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1329/2830] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:32 2022] GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:53:32.830241 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1b29dfc2-debb-42ab-948a-21527ef5a2b3 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:32.871324 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1b29dfc2-debb-42ab-948a-21527ef5a2b3 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:32.874158 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1b29dfc2-debb-42ab-948a-21527ef5a2b3 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a'} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:53:32.902957 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b29dfc2-debb-42ab-948a-21527ef5a2b3 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:32.911243 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b29dfc2-debb-42ab-948a-21527ef5a2b3 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:32.916941 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b29dfc2-debb-42ab-948a-21527ef5a2b3 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:32.921214 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1b29dfc2-debb-42ab-948a-21527ef5a2b3 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:32.995308 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7c1f0ecc-e662-40c4-b637-ce26a3ef73b7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:33.039166 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7c1f0ecc-e662-40c4-b637-ce26a3ef73b7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:33.049438 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-7c1f0ecc-e662-40c4-b637-ce26a3ef73b7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:33.054252 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-7c1f0ecc-e662-40c4-b637-ce26a3ef73b7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 1.175763 Jun 16 14:53:33.059194 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1502/2831] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:31 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:53:33.090786 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1b29dfc2-debb-42ab-948a-21527ef5a2b3 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.289202 Jun 16 14:53:33.093448 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1330/2832] 10.222.0.57 () {58 vars in 1229 bytes} [Thu Jun 16 14:53:32 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:53:33.113120 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-18859d22-73fd-4d03-98b5-989b4b201963 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-18859d22-73fd-4d03-98b5-989b4b201963 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Request method failure captured: Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0OivVftuMT4fWjf7lHTJ023UG8jbsasJncBydH6aTqjoU4BNjTSSJ1Xva4OMO0PAM11RP2Wz65pJnEFMDDVD96zApDHY2itiValHUQyGn4bHK_199kZAxuVWWT_8_REYAyzrrutrdDsosiJqjFqV6fJdkzNH9puAeaMbmfd-7fbxPM Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa0ce43c5ac64864b458514ebdc5ad1a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa0ce43c5ac64864b458514ebdc5ad1a"}]}] Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 2f53e4d9a56c47089527b650611fa453 Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: action_args: {} Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi '2011/01/01' Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 16 14:53:33.122411 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:53:33.127117 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:53:33.127117 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:53:33.127117 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:53:33.127117 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 16 14:53:33.127117 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:33.127117 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:33.127117 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:33.127117 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:33.127117 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:33.127117 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:33.127117 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:53:33.127117 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:53:33.127117 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 16 14:53:33.127117 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:33.127117 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-18859d22-73fd-4d03-98b5-989b4b201963 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:53:33.141162 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-18859d22-73fd-4d03-98b5-989b4b201963 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.032593 Jun 16 14:53:33.150868 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1503/2833] 10.222.0.57 () {58 vars in 1181 bytes} [Thu Jun 16 14:53:33 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:53:33.171163 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-86c3c3dc-b4c4-4a35-846b-258d3652ea5b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:33.207529 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-86c3c3dc-b4c4-4a35-846b-258d3652ea5b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:33.211051 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-86c3c3dc-b4c4-4a35-846b-258d3652ea5b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Searching by: {'deleted': False, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a'} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:53:33.234631 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-86c3c3dc-b4c4-4a35-846b-258d3652ea5b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:33.235641 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-86c3c3dc-b4c4-4a35-846b-258d3652ea5b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:33.237803 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-86c3c3dc-b4c4-4a35-846b-258d3652ea5b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:33.238763 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-86c3c3dc-b4c4-4a35-846b-258d3652ea5b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:33.283408 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0824b08f-6855-40d0-a734-3e7bbbe2261a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:33.298274 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0824b08f-6855-40d0-a734-3e7bbbe2261a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:33.369671 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0824b08f-6855-40d0-a734-3e7bbbe2261a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:33.376821 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0824b08f-6855-40d0-a734-3e7bbbe2261a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:33.383205 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0824b08f-6855-40d0-a734-3e7bbbe2261a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:33.389332 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0824b08f-6855-40d0-a734-3e7bbbe2261a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:33.441024 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.multi_cell_list [None req-86c3c3dc-b4c4-4a35-846b-258d3652ea5b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:53:33.523452 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-86c3c3dc-b4c4-4a35-846b-258d3652ea5b tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.366521 Jun 16 14:53:33.525742 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1331/2834] 10.222.0.57 () {58 vars in 1124 bytes} [Thu Jun 16 14:53:33 2022] GET /compute/v2.1/servers => generated 683 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:33.537031 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-defebdb2-2c6b-41ee-aef5-ef63967f990e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:33.545572 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-defebdb2-2c6b-41ee-aef5-ef63967f990e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:33.554511 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.compute.servers [None req-defebdb2-2c6b-41ee-aef5-ef63967f990e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Removing options 'limit' from query {{(pid=125863) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 16 14:53:33.556678 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-defebdb2-2c6b-41ee-aef5-ef63967f990e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Searching by: {'deleted': False, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a'} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:53:33.572635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-defebdb2-2c6b-41ee-aef5-ef63967f990e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:33.573095 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-defebdb2-2c6b-41ee-aef5-ef63967f990e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:33.577353 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-defebdb2-2c6b-41ee-aef5-ef63967f990e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:33.578863 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-defebdb2-2c6b-41ee-aef5-ef63967f990e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:33.675232 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.multi_cell_list [None req-defebdb2-2c6b-41ee-aef5-ef63967f990e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=125863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:53:33.727764 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-defebdb2-2c6b-41ee-aef5-ef63967f990e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.194474 Jun 16 14:53:33.729179 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1332/2835] 10.222.0.57 () {58 vars in 1143 bytes} [Thu Jun 16 14:53:33 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:53:33.739715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-fc4122ae-102e-41ca-8a7a-57c383601160 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:33.741525 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-fc4122ae-102e-41ca-8a7a-57c383601160 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:33.753056 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fc4122ae-102e-41ca-8a7a-57c383601160 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:33.753725 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fc4122ae-102e-41ca-8a7a-57c383601160 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:33.755105 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fc4122ae-102e-41ca-8a7a-57c383601160 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:33.755894 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-fc4122ae-102e-41ca-8a7a-57c383601160 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:34.052362 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0824b08f-6855-40d0-a734-3e7bbbe2261a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b034bd6e71471bb3653eabbd5da828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb2d93a8ca24b4cb81e316025504ef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:34.065034 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0824b08f-6855-40d0-a734-3e7bbbe2261a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d" status: 200 len: 1403 microversion: 2.1 time: 0.798610 Jun 16 14:53:34.070208 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1504/2836] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:33 2022] GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d => generated 1403 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:34.092364 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b5463182-cd88-4948-a0e0-bace17d03719 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b5463182-cd88-4948-a0e0-bace17d03719 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Request method failure captured: Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0OivVftuMT4fWjf7lHTJ023UG8jbsasJncBydH6aTqjoU4BNjTSSJ1Xva4OMO0PAM11RP2Wz65pJnEFMDDVD96zApDHY2itiValHUQyGn4bHK_199kZAxuVWWT_8_REYAyzrrutrdDsosiJqjFqV6fJdkzNH9puAeaMbmfd-7fbxPM Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa0ce43c5ac64864b458514ebdc5ad1a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa0ce43c5ac64864b458514ebdc5ad1a"}]}] Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 2f53e4d9a56c47089527b650611fa453 Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: action_args: {} Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi '-1' Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 16 14:53:34.096086 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 16 14:53:34.101396 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:53:34.101396 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:53:34.101396 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:53:34.101396 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:53:34.101396 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 16 14:53:34.101396 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:34.101396 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:34.101396 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:34.101396 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:34.101396 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:34.101396 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:34.101396 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:53:34.101396 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:53:34.101396 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 16 14:53:34.101396 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:34.104131 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b5463182-cd88-4948-a0e0-bace17d03719 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:53:34.105313 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b5463182-cd88-4948-a0e0-bace17d03719 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.032068 Jun 16 14:53:34.113552 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1505/2837] 10.222.0.57 () {58 vars in 1141 bytes} [Thu Jun 16 14:53:34 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:53:34.129061 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-631e1129-7922-497f-993e-91f4f05be29d tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '.version_select at 0x7fdeff4371f0>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:34.237080 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-631e1129-7922-497f-993e-91f4f05be29d tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/images/26250d8c-6308-4782-9971-270a0b14a37d" status: 200 len: 661 microversion: 2.1 time: 0.121991 Jun 16 14:53:34.237688 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1506/2838] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:53:34 2022] GET /compute/v2.1/images/26250d8c-6308-4782-9971-270a0b14a37d => generated 661 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:34.284276 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-d7cc1376-636c-46d0-bee5-9cf3a8cdc4e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:34.285208 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-d7cc1376-636c-46d0-bee5-9cf3a8cdc4e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:34.335076 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d7cc1376-636c-46d0-bee5-9cf3a8cdc4e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:34.336173 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d7cc1376-636c-46d0-bee5-9cf3a8cdc4e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:34.338687 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d7cc1376-636c-46d0-bee5-9cf3a8cdc4e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:34.344185 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-d7cc1376-636c-46d0-bee5-9cf3a8cdc4e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:34.653549 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-fc4122ae-102e-41ca-8a7a-57c383601160 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:34.716008 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-fc4122ae-102e-41ca-8a7a-57c383601160 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1312 microversion: 2.1 time: 0.984234 Jun 16 14:53:34.725675 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1333/2839] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:33 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1312 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:34.740772 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-73534f52-27d5-4fe9-8aa1-cd55a203c285 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-73534f52-27d5-4fe9-8aa1-cd55a203c285 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Request method failure captured: Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0OivVftuMT4fWjf7lHTJ023UG8jbsasJncBydH6aTqjoU4BNjTSSJ1Xva4OMO0PAM11RP2Wz65pJnEFMDDVD96zApDHY2itiValHUQyGn4bHK_199kZAxuVWWT_8_REYAyzrrutrdDsosiJqjFqV6fJdkzNH9puAeaMbmfd-7fbxPM Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa0ce43c5ac64864b458514ebdc5ad1a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa0ce43c5ac64864b458514ebdc5ad1a"}]}] Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 2f53e4d9a56c47089527b650611fa453 Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: action_args: {} Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi 'testing' Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 16 14:53:34.745826 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 16 14:53:34.758047 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:53:34.758047 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:53:34.758047 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:53:34.758047 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:53:34.758047 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 16 14:53:34.758047 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:34.758047 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:34.758047 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:34.758047 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:34.758047 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:34.758047 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:34.758047 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:53:34.758047 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:53:34.758047 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 16 14:53:34.758047 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:34.761273 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-73534f52-27d5-4fe9-8aa1-cd55a203c285 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:53:34.762506 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-73534f52-27d5-4fe9-8aa1-cd55a203c285 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.033848 Jun 16 14:53:34.765040 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1334/2840] 10.222.0.57 () {58 vars in 1151 bytes} [Thu Jun 16 14:53:34 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:53:34.776662 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-9c48afd6-da6e-4a45-b4bf-59f4256c6e6c tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '.version_select at 0x7fdeff293280>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:34.863250 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-9c48afd6-da6e-4a45-b4bf-59f4256c6e6c tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/images/26250d8c-6308-4782-9971-270a0b14a37d" status: 200 len: 661 microversion: 2.1 time: 0.091193 Jun 16 14:53:34.866555 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1335/2841] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jun 16 14:53:34 2022] GET /compute/v2.1/images/26250d8c-6308-4782-9971-270a0b14a37d => generated 661 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:34.895513 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-5bb47ee1-2497-4a4e-984d-427c78dc40f2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:34.910136 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-5bb47ee1-2497-4a4e-984d-427c78dc40f2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:34.918768 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-5bb47ee1-2497-4a4e-984d-427c78dc40f2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a'} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:53:34.931842 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.compute.servers [None req-5bb47ee1-2497-4a4e-984d-427c78dc40f2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Flavor 'non_existing_flavor' could not be found {{(pid=125863) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jun 16 14:53:34.949557 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-5bb47ee1-2497-4a4e-984d-427c78dc40f2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.080976 Jun 16 14:53:34.952551 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1336/2842] 10.222.0.57 () {58 vars in 1177 bytes} [Thu Jun 16 14:53:34 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:53:34.973016 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-477cc417-c9c2-4a50-bfa3-946a04fcc16f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:35.005064 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-477cc417-c9c2-4a50-bfa3-946a04fcc16f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:35.017404 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-477cc417-c9c2-4a50-bfa3-946a04fcc16f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a'} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:53:35.024029 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=24 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:35.036171 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-477cc417-c9c2-4a50-bfa3-946a04fcc16f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:35.037068 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-477cc417-c9c2-4a50-bfa3-946a04fcc16f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:35.041604 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-477cc417-c9c2-4a50-bfa3-946a04fcc16f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:35.043791 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-477cc417-c9c2-4a50-bfa3-946a04fcc16f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:35.069076 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d7cc1376-636c-46d0-bee5-9cf3a8cdc4e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:35.132370 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d7cc1376-636c-46d0-bee5-9cf3a8cdc4e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:35.141071 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-d7cc1376-636c-46d0-bee5-9cf3a8cdc4e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:35.144860 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-d7cc1376-636c-46d0-bee5-9cf3a8cdc4e1 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 0.905703 Jun 16 14:53:35.151372 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1507/2843] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:34 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:35.180559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-85795577-1613-47ec-9050-df3708b9c39f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:35.183916 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-85795577-1613-47ec-9050-df3708b9c39f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:35.235289 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85795577-1613-47ec-9050-df3708b9c39f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:35.236498 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85795577-1613-47ec-9050-df3708b9c39f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:35.238259 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85795577-1613-47ec-9050-df3708b9c39f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:35.239406 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-85795577-1613-47ec-9050-df3708b9c39f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:35.302876 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-477cc417-c9c2-4a50-bfa3-946a04fcc16f tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.341299 Jun 16 14:53:35.304196 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1337/2844] 10.222.0.57 () {58 vars in 1173 bytes} [Thu Jun 16 14:53:34 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:53:35.309629 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1544135223", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:35.387759 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.network.neutron [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] validate_networks() for None {{(pid=125863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:53:35.718045 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-85795577-1613-47ec-9050-df3708b9c39f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b034bd6e71471bb3653eabbd5da828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb2d93a8ca24b4cb81e316025504ef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:35.748140 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-85795577-1613-47ec-9050-df3708b9c39f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d" status: 200 len: 1403 microversion: 2.1 time: 0.591989 Jun 16 14:53:35.749394 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1508/2845] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:35 2022] GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d => generated 1403 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:35.766264 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0cd9c85f-8296-44fb-a45d-3e41e3a41de0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:35.784459 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0cd9c85f-8296-44fb-a45d-3e41e3a41de0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:35.786079 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0cd9c85f-8296-44fb-a45d-3e41e3a41de0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a'} {{(pid=125862) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:53:35.802843 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0cd9c85f-8296-44fb-a45d-3e41e3a41de0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:35.803936 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0cd9c85f-8296-44fb-a45d-3e41e3a41de0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:35.805790 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0cd9c85f-8296-44fb-a45d-3e41e3a41de0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:35.806644 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0cd9c85f-8296-44fb-a45d-3e41e3a41de0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:36.072884 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:36.077213 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0cd9c85f-8296-44fb-a45d-3e41e3a41de0 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.325083 Jun 16 14:53:36.078290 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1509/2846] 10.222.0.57 () {58 vars in 1183 bytes} [Thu Jun 16 14:53:35 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:53:36.090059 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5cc9cdde-50a2-46d0-a8d6-61cbfbdc9c60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:36.093153 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5cc9cdde-50a2-46d0-a8d6-61cbfbdc9c60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:36.099869 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5cc9cdde-50a2-46d0-a8d6-61cbfbdc9c60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:36.100333 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5cc9cdde-50a2-46d0-a8d6-61cbfbdc9c60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:36.101156 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5cc9cdde-50a2-46d0-a8d6-61cbfbdc9c60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:36.101609 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5cc9cdde-50a2-46d0-a8d6-61cbfbdc9c60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:36.376711 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=4 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:36.881829 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Flavor limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:53:36.882477 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Image limits 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:53:36.883451 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Flavor pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:53:36.884087 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Image pref 0:0:0 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:53:36.885723 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.virt.hardware [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:53:36.911142 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:36.914972 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:36.918613 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:36.920601 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:36.980042 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Getting quotas for project 9325ace35c70494dbb105ac05953a2c4. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:53:37.001355 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.quota [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Getting quotas for user 314a6622e5ee4a16b1e58b39f7337a93 and project 9325ace35c70494dbb105ac05953a2c4. Resources: {'ram', 'cores', 'instances'} {{(pid=125863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:53:37.055004 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Going to run 1 instances... {{(pid=125863) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:53:37.063614 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] [instance: 3914e05b-3b09-44ab-942a-07adfa6bb80d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:53:37.245185 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-07af40ce-7d47-47a1-94da-a0a2c7f3a826 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.932346 Jun 16 14:53:37.250946 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1338/2847] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:53:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:53:37.284111 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6cf2613e-b95a-42c1-b61c-035764f3e70d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:37.314669 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6cf2613e-b95a-42c1-b61c-035764f3e70d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:37.319497 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6cf2613e-b95a-42c1-b61c-035764f3e70d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Searching by: {'deleted': False, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a'} {{(pid=125863) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:53:37.354119 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6cf2613e-b95a-42c1-b61c-035764f3e70d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:37.355619 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6cf2613e-b95a-42c1-b61c-035764f3e70d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:37.360299 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6cf2613e-b95a-42c1-b61c-035764f3e70d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:37.361040 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6cf2613e-b95a-42c1-b61c-035764f3e70d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:37.375882 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-5cc9cdde-50a2-46d0-a8d6-61cbfbdc9c60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:37.459293 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5cc9cdde-50a2-46d0-a8d6-61cbfbdc9c60 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1312 microversion: 2.1 time: 1.379528 Jun 16 14:53:37.481720 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1510/2848] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:36 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1312 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:37.503123 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-07d02159-ab21-4a1e-9b89-c364af3f2dbc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:37.506885 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-07d02159-ab21-4a1e-9b89-c364af3f2dbc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:37.533776 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07d02159-ab21-4a1e-9b89-c364af3f2dbc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:37.534251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07d02159-ab21-4a1e-9b89-c364af3f2dbc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:37.535135 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07d02159-ab21-4a1e-9b89-c364af3f2dbc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:37.539616 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.multi_cell_list [None req-6cf2613e-b95a-42c1-b61c-035764f3e70d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:53:37.540863 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-07d02159-ab21-4a1e-9b89-c364af3f2dbc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:37.734152 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6cf2613e-b95a-42c1-b61c-035764f3e70d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:37.753539 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6cf2613e-b95a-42c1-b61c-035764f3e70d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:37.754240 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6cf2613e-b95a-42c1-b61c-035764f3e70d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:38.823129 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6cf2613e-b95a-42c1-b61c-035764f3e70d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 1.567870 Jun 16 14:53:38.824585 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1339/2849] 10.222.0.57 () {58 vars in 1145 bytes} [Thu Jun 16 14:53:37 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:38.860316 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-5f10a3e9-9239-4f1c-a410-73dbe77e9aad req-c76cf488-16d4-4b18-aa02-7e44ea97d1ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b60391-d177-456e-8049-97f1686d904d", "tag": "c801a814-f346-4c3b-a6e2-f695c535d5f1"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:38.906889 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-5f10a3e9-9239-4f1c-a410-73dbe77e9aad req-c76cf488-16d4-4b18-aa02-7e44ea97d1ef service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:38.907715 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-5f10a3e9-9239-4f1c-a410-73dbe77e9aad req-c76cf488-16d4-4b18-aa02-7e44ea97d1ef service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:39.445662 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-5f10a3e9-9239-4f1c-a410-73dbe77e9aad req-c76cf488-16d4-4b18-aa02-7e44ea97d1ef service nova] Creating event network-changed:c801a814-f346-4c3b-a6e2-f695c535d5f1 for instance d6b60391-d177-456e-8049-97f1686d904d on n-h1-836830-4 Jun 16 14:53:39.453962 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-5f10a3e9-9239-4f1c-a410-73dbe77e9aad req-c76cf488-16d4-4b18-aa02-7e44ea97d1ef service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.626280 Jun 16 14:53:39.455228 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1340/2850] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:39.461365 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-bb297819-ce06-469b-9bfc-222416a9a93c tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:39.462197 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-bb297819-ce06-469b-9bfc-222416a9a93c tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:39.474788 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb297819-ce06-469b-9bfc-222416a9a93c tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:39.475312 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb297819-ce06-469b-9bfc-222416a9a93c tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:39.476144 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb297819-ce06-469b-9bfc-222416a9a93c tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:39.476596 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-bb297819-ce06-469b-9bfc-222416a9a93c tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:40.092560 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-07d02159-ab21-4a1e-9b89-c364af3f2dbc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:40.113903 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-07d02159-ab21-4a1e-9b89-c364af3f2dbc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:40.119588 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-07d02159-ab21-4a1e-9b89-c364af3f2dbc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:40.124935 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-07d02159-ab21-4a1e-9b89-c364af3f2dbc tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 2.641016 Jun 16 14:53:40.127690 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1511/2851] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:37 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 2645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:40.140422 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-6a356844-67ab-4fbb-aa76-d7fbec810959 req-98508e68-b2c3-4fb0-96a7-2cf7ae308d52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9299dbd5-e00b-490f-baf8-0ea004f15515", "tag": "d6f76e12-e550-40ea-b0a6-57d36ca110cc"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:40.160209 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-6a356844-67ab-4fbb-aa76-d7fbec810959 req-98508e68-b2c3-4fb0-96a7-2cf7ae308d52 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:40.161603 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-6a356844-67ab-4fbb-aa76-d7fbec810959 req-98508e68-b2c3-4fb0-96a7-2cf7ae308d52 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:40.195016 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-6a356844-67ab-4fbb-aa76-d7fbec810959 req-98508e68-b2c3-4fb0-96a7-2cf7ae308d52 service nova] Creating event network-changed:d6f76e12-e550-40ea-b0a6-57d36ca110cc for instance 9299dbd5-e00b-490f-baf8-0ea004f15515 on n-h2-836830-4 Jun 16 14:53:40.207969 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-6a356844-67ab-4fbb-aa76-d7fbec810959 req-98508e68-b2c3-4fb0-96a7-2cf7ae308d52 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076583 Jun 16 14:53:40.209337 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1512/2852] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:40.221162 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1485206422", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452"}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:40.348882 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] validate_networks() for None {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:53:40.432290 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-bb297819-ce06-469b-9bfc-222416a9a93c tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b034bd6e71471bb3653eabbd5da828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb2d93a8ca24b4cb81e316025504ef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:40.452237 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-bb297819-ce06-469b-9bfc-222416a9a93c tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d" status: 200 len: 1403 microversion: 2.1 time: 0.994344 Jun 16 14:53:40.467304 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1341/2853] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:39 2022] GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d => generated 1403 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:40.479483 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e521a674-1a74-475f-928e-cd75dd91acba tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:40.480689 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e521a674-1a74-475f-928e-cd75dd91acba tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:40.494300 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e521a674-1a74-475f-928e-cd75dd91acba tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:40.494860 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e521a674-1a74-475f-928e-cd75dd91acba tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:40.496323 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e521a674-1a74-475f-928e-cd75dd91acba tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:40.497130 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e521a674-1a74-475f-928e-cd75dd91acba tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:40.854237 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:53:40.855182 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:53:40.856144 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:53:40.856449 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:53:40.856942 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:53:40.868954 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:40.869827 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:40.870918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:40.871560 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:40.895682 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Getting quotas for project 9325ace35c70494dbb105ac05953a2c4. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:53:40.902262 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Getting quotas for user 314a6622e5ee4a16b1e58b39f7337a93 and project 9325ace35c70494dbb105ac05953a2c4. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:53:40.919888 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:53:40.923070 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] [instance: 75464c3d-3cec-437c-a079-8ae97ca44345] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:53:41.002538 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-5b441a79-9c4a-4bfe-b2d3-893fd26c2dc4 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790435 Jun 16 14:53:41.007266 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1513/2854] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:53:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:53:41.015099 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-1cdd72a0-e79f-4c1b-a9f5-13b0b21d2c93 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:41.021592 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-1cdd72a0-e79f-4c1b-a9f5-13b0b21d2c93 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:41.023272 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-1cdd72a0-e79f-4c1b-a9f5-13b0b21d2c93 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013716 Jun 16 14:53:41.024919 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1514/2855] 10.222.0.57 () {58 vars in 1177 bytes} [Thu Jun 16 14:53:41 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 14:53:41.056550 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-70ad948e-e91b-4b1a-952d-a5491c4061f5 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:41.062318 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-70ad948e-e91b-4b1a-952d-a5491c4061f5 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] [instance: 75464c3d-3cec-437c-a079-8ae97ca44345] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:41.160183 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-70ad948e-e91b-4b1a-952d-a5491c4061f5 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a6622e5ee4a16b1e58b39f7337a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9325ace35c70494dbb105ac05953a2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:41.170297 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-70ad948e-e91b-4b1a-952d-a5491c4061f5 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345" status: 200 len: 1218 microversion: 2.1 time: 0.143817 Jun 16 14:53:41.172987 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1515/2856] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:41 2022] GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345 => generated 1218 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:41.178258 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-4001a8ea-be1c-4b0d-a89f-75f4b03729c6 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:41.190023 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-4001a8ea-be1c-4b0d-a89f-75f4b03729c6 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:41.191261 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-4001a8ea-be1c-4b0d-a89f-75f4b03729c6 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Searching by: {'deleted': False, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a'} {{(pid=125862) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 14:53:41.198830 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4001a8ea-be1c-4b0d-a89f-75f4b03729c6 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:41.200354 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4001a8ea-be1c-4b0d-a89f-75f4b03729c6 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:41.201507 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4001a8ea-be1c-4b0d-a89f-75f4b03729c6 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:41.202328 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-4001a8ea-be1c-4b0d-a89f-75f4b03729c6 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:41.241933 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.multi_cell_list [None req-4001a8ea-be1c-4b0d-a89f-75f4b03729c6 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 14:53:41.297502 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-4001a8ea-be1c-4b0d-a89f-75f4b03729c6 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.122118 Jun 16 14:53:41.298911 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1516/2857] 10.222.0.57 () {58 vars in 1124 bytes} [Thu Jun 16 14:53:41 2022] GET /compute/v2.1/servers => generated 683 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:41.304864 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-104d0676-59ba-44b8-8ae4-72def145d73b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:41.305748 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-104d0676-59ba-44b8-8ae4-72def145d73b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:41.315442 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-104d0676-59ba-44b8-8ae4-72def145d73b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:41.316228 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-104d0676-59ba-44b8-8ae4-72def145d73b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:41.317369 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-104d0676-59ba-44b8-8ae4-72def145d73b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:41.317991 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-104d0676-59ba-44b8-8ae4-72def145d73b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:41.810420 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-104d0676-59ba-44b8-8ae4-72def145d73b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:41.838185 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-104d0676-59ba-44b8-8ae4-72def145d73b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:41.851137 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-104d0676-59ba-44b8-8ae4-72def145d73b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:41.853649 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-104d0676-59ba-44b8-8ae4-72def145d73b tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 0.552686 Jun 16 14:53:41.854780 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1517/2858] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:41 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:41.880271 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-e521a674-1a74-475f-928e-cd75dd91acba tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:41.881034 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-62ebd635-e864-46ef-b878-fcc99546faee tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:41.882222 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-62ebd635-e864-46ef-b878-fcc99546faee tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 9d3e4c1a-dfce-477f-b0a6-990624d387cb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:41.890757 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e521a674-1a74-475f-928e-cd75dd91acba tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1312 microversion: 2.1 time: 1.421741 Jun 16 14:53:41.891620 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1342/2859] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:40 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1312 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:41.901715 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-62ebd635-e864-46ef-b878-fcc99546faee tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:41.901715 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-62ebd635-e864-46ef-b878-fcc99546faee tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:41.901715 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-62ebd635-e864-46ef-b878-fcc99546faee tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:41.901715 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-62ebd635-e864-46ef-b878-fcc99546faee tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:41.913285 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-477cdf98-5b5f-4f7f-a529-26fd10a779a2 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:41.914235 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-477cdf98-5b5f-4f7f-a529-26fd10a779a2 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:41.922795 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-477cdf98-5b5f-4f7f-a529-26fd10a779a2 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:41.924505 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-477cdf98-5b5f-4f7f-a529-26fd10a779a2 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:41.925854 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-477cdf98-5b5f-4f7f-a529-26fd10a779a2 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:41.926618 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-477cdf98-5b5f-4f7f-a529-26fd10a779a2 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:41.954371 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-62ebd635-e864-46ef-b878-fcc99546faee tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] HTTP exception thrown: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-62ebd635-e864-46ef-b878-fcc99546faee tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Request method failure captured: Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: request: DELETE /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb HTTP/1.1 Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0OivVftuMT4fWjf7lHTJ023UG8jbsasJncBydH6aTqjoU4BNjTSSJ1Xva4OMO0PAM11RP2Wz65pJnEFMDDVD96zApDHY2itiValHUQyGn4bHK_199kZAxuVWWT_8_REYAyzrrutrdDsosiJqjFqV6fJdkzNH9puAeaMbmfd-7fbxPM Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa0ce43c5ac64864b458514ebdc5ad1a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa0ce43c5ac64864b458514ebdc5ad1a"}]}] Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 2f53e4d9a56c47089527b650611fa453 Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '9d3e4c1a-dfce-477f-b0a6-990624d387cb'} Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:53:41.961326 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:53:41.970196 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. Jun 16 14:53:41.970196 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:41.970196 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:41.970196 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:41.970196 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:41.970196 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:41.970196 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:41.970196 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:53:41.970196 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:53:41.970196 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. Jun 16 14:53:41.970196 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:41.970196 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-62ebd635-e864-46ef-b878-fcc99546faee tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Returning 404 to user: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:53:41.970196 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-62ebd635-e864-46ef-b878-fcc99546faee tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb" status: 404 len: 111 microversion: 2.1 time: 0.094399 Jun 16 14:53:41.972342 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1518/2860] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:53:41 2022] DELETE /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:53:41.985395 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c36db94d-f0fa-4b1b-a631-808d06008baa tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:41.986595 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c36db94d-f0fa-4b1b-a631-808d06008baa tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: a6f54e74-9834-449d-8a62-2f33df36a320] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:42.005526 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c36db94d-f0fa-4b1b-a631-808d06008baa tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:42.006028 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c36db94d-f0fa-4b1b-a631-808d06008baa tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:42.007080 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c36db94d-f0fa-4b1b-a631-808d06008baa tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:42.008559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c36db94d-f0fa-4b1b-a631-808d06008baa tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:42.072723 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c36db94d-f0fa-4b1b-a631-808d06008baa tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: a6f54e74-9834-449d-8a62-2f33df36a320] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:53:42.318774 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c36db94d-f0fa-4b1b-a631-808d06008baa tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320" status: 204 len: 0 microversion: 2.1 time: 0.345998 Jun 16 14:53:42.319617 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1519/2861] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:53:41 2022] DELETE /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:53:42.329664 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-73d39aa9-acba-4a43-848e-d43bc5515ba8 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:42.330632 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-73d39aa9-acba-4a43-848e-d43bc5515ba8 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] [instance: 75464c3d-3cec-437c-a079-8ae97ca44345] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:42.340937 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-73d39aa9-acba-4a43-848e-d43bc5515ba8 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:42.342251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-73d39aa9-acba-4a43-848e-d43bc5515ba8 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:42.343503 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-73d39aa9-acba-4a43-848e-d43bc5515ba8 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:42.344128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-73d39aa9-acba-4a43-848e-d43bc5515ba8 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:42.630962 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-73d39aa9-acba-4a43-848e-d43bc5515ba8 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a6622e5ee4a16b1e58b39f7337a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9325ace35c70494dbb105ac05953a2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:42.642416 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-73d39aa9-acba-4a43-848e-d43bc5515ba8 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345" status: 200 len: 1222 microversion: 2.1 time: 0.321189 Jun 16 14:53:42.652359 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1520/2862] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:42 2022] GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345 => generated 1222 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:42.663309 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3d53bf56-f6e8-49fc-a026-492d09f01a65 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:42.665704 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3d53bf56-f6e8-49fc-a026-492d09f01a65 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:42.677461 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d53bf56-f6e8-49fc-a026-492d09f01a65 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:42.678098 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d53bf56-f6e8-49fc-a026-492d09f01a65 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:42.679146 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d53bf56-f6e8-49fc-a026-492d09f01a65 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:42.682790 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3d53bf56-f6e8-49fc-a026-492d09f01a65 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:42.747991 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3d53bf56-f6e8-49fc-a026-492d09f01a65 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Going to try to terminate instance {{(pid=125862) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:53:43.014818 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3d53bf56-f6e8-49fc-a026-492d09f01a65 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "DELETE /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 204 len: 0 microversion: 2.1 time: 0.359258 Jun 16 14:53:43.020575 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1521/2863] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:53:42 2022] DELETE /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:53:43.039288 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ed1401be-6d53-44c0-b045-9de3f4a2b71c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:43.043962 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ed1401be-6d53-44c0-b045-9de3f4a2b71c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:43.060514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ed1401be-6d53-44c0-b045-9de3f4a2b71c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:43.060990 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ed1401be-6d53-44c0-b045-9de3f4a2b71c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:43.061942 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ed1401be-6d53-44c0-b045-9de3f4a2b71c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:43.062873 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ed1401be-6d53-44c0-b045-9de3f4a2b71c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:43.063820 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-477cdf98-5b5f-4f7f-a529-26fd10a779a2 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b034bd6e71471bb3653eabbd5da828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb2d93a8ca24b4cb81e316025504ef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:43.077401 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-477cdf98-5b5f-4f7f-a529-26fd10a779a2 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d" status: 200 len: 1403 microversion: 2.1 time: 1.169680 Jun 16 14:53:43.106989 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1343/2864] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:41 2022] GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d => generated 1403 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:43.112157 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-052d292c-05c2-4a86-a93d-f8f425190959 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:43.113093 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-052d292c-05c2-4a86-a93d-f8f425190959 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:43.125120 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-052d292c-05c2-4a86-a93d-f8f425190959 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:43.125768 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-052d292c-05c2-4a86-a93d-f8f425190959 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:43.126848 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-052d292c-05c2-4a86-a93d-f8f425190959 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:43.129222 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-052d292c-05c2-4a86-a93d-f8f425190959 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:43.650635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ed1401be-6d53-44c0-b045-9de3f4a2b71c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:43.700635 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ed1401be-6d53-44c0-b045-9de3f4a2b71c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:43.708064 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ed1401be-6d53-44c0-b045-9de3f4a2b71c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:43.710904 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ed1401be-6d53-44c0-b045-9de3f4a2b71c tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 0.692475 Jun 16 14:53:43.716975 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1522/2865] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:43 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:43.734134 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-01015a5c-24b8-4044-99bd-4b1c7037662d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:43.735288 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-01015a5c-24b8-4044-99bd-4b1c7037662d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 9d3e4c1a-dfce-477f-b0a6-990624d387cb] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:43.754336 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01015a5c-24b8-4044-99bd-4b1c7037662d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:43.755171 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01015a5c-24b8-4044-99bd-4b1c7037662d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:43.756197 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01015a5c-24b8-4044-99bd-4b1c7037662d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:43.756926 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-01015a5c-24b8-4044-99bd-4b1c7037662d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:43.789175 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.wsgi [None req-01015a5c-24b8-4044-99bd-4b1c7037662d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] HTTP exception thrown: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-01015a5c-24b8-4044-99bd-4b1c7037662d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Request method failure captured: Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: request: GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb HTTP/1.1 Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: Accept: application/json Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: Accept-Encoding: identity Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: Connection: close Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: Content-Length: 0 Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: Content-Type: application/json Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: Host: 10.222.0.57 Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: Openstack-System-Scope: None Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: User-Agent: python-urllib3/1.26.9 Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-Auth-Token: gAAAAABiq0OivVftuMT4fWjf7lHTJ023UG8jbsasJncBydH6aTqjoU4BNjTSSJ1Xva4OMO0PAM11RP2Wz65pJnEFMDDVD96zApDHY2itiValHUQyGn4bHK_199kZAxuVWWT_8_REYAyzrrutrdDsosiJqjFqV6fJdkzNH9puAeaMbmfd-7fbxPM Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Id: None Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-Domain-Name: None Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-Identity-Status: Confirmed Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-Is-Admin-Project: True Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Id: default Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Domain-Name: Default Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-Project-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-Role: member,reader Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-Roles: member,reader Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa0ce43c5ac64864b458514ebdc5ad1a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa0ce43c5ac64864b458514ebdc5ad1a"}]}] Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-User: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Id: default Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-User-Domain-Name: Default Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-User-Id: 2f53e4d9a56c47089527b650611fa453 Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: X-User-Name: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: method: > Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: exception: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: action_args: {'id': '9d3e4c1a-dfce-477f-b0a6-990624d387cb'} Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:43.796652 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:43.801643 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:43.801643 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:43.801643 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:43.801643 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:53:43.801643 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:53:43.801643 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. Jun 16 14:53:43.801643 n-d-836830-4 devstack@n-api.service[125862]: ERROR nova.api.openstack.wsgi Jun 16 14:53:43.810886 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-01015a5c-24b8-4044-99bd-4b1c7037662d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Returning 404 to user: Instance 9d3e4c1a-dfce-477f-b0a6-990624d387cb could not be found. {{(pid=125862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:53:43.812168 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-01015a5c-24b8-4044-99bd-4b1c7037662d tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb" status: 404 len: 111 microversion: 2.1 time: 0.089237 Jun 16 14:53:43.812953 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1523/2866] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:43 2022] GET /compute/v2.1/servers/9d3e4c1a-dfce-477f-b0a6-990624d387cb => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:53:43.827832 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-e1159b11-065c-4c79-a0d3-8b893f2b19d2 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:43.828829 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-e1159b11-065c-4c79-a0d3-8b893f2b19d2 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] [instance: 75464c3d-3cec-437c-a079-8ae97ca44345] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:43.844374 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e1159b11-065c-4c79-a0d3-8b893f2b19d2 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:43.845268 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e1159b11-065c-4c79-a0d3-8b893f2b19d2 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:43.848911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e1159b11-065c-4c79-a0d3-8b893f2b19d2 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:43.849593 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-e1159b11-065c-4c79-a0d3-8b893f2b19d2 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:44.062180 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-e1159b11-065c-4c79-a0d3-8b893f2b19d2 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a6622e5ee4a16b1e58b39f7337a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9325ace35c70494dbb105ac05953a2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:44.071745 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-e1159b11-065c-4c79-a0d3-8b893f2b19d2 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345" status: 200 len: 1214 microversion: 2.1 time: 0.257302 Jun 16 14:53:44.072570 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1524/2867] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:43 2022] GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345 => generated 1214 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:44.106227 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-75195853-8c55-4bfe-9340-fcde510c053e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:44.106227 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-75195853-8c55-4bfe-9340-fcde510c053e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: a6f54e74-9834-449d-8a62-2f33df36a320] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:44.133149 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-75195853-8c55-4bfe-9340-fcde510c053e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:44.134039 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-75195853-8c55-4bfe-9340-fcde510c053e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:44.135247 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-75195853-8c55-4bfe-9340-fcde510c053e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:44.135621 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-75195853-8c55-4bfe-9340-fcde510c053e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:44.509351 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-75195853-8c55-4bfe-9340-fcde510c053e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:44.519387 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-75195853-8c55-4bfe-9340-fcde510c053e tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320" status: 200 len: 1522 microversion: 2.1 time: 0.426940 Jun 16 14:53:44.532470 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1525/2868] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:44 2022] GET /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320 => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:44.538904 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-8e661ace-68d5-461b-b1a9-02d100f8ae3a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:44.539530 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-8e661ace-68d5-461b-b1a9-02d100f8ae3a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:44.559993 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8e661ace-68d5-461b-b1a9-02d100f8ae3a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:44.563116 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8e661ace-68d5-461b-b1a9-02d100f8ae3a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:44.564575 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8e661ace-68d5-461b-b1a9-02d100f8ae3a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:44.570312 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-052d292c-05c2-4a86-a93d-f8f425190959 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:44.583223 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-8e661ace-68d5-461b-b1a9-02d100f8ae3a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:44.592175 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-052d292c-05c2-4a86-a93d-f8f425190959 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1312 microversion: 2.1 time: 1.474837 Jun 16 14:53:44.592863 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1344/2869] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:43 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1312 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:44.804336 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-8b6acd7b-babb-42ea-9694-6b5810bd2d74 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:44.809811 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-8b6acd7b-babb-42ea-9694-6b5810bd2d74 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:44.902713 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8b6acd7b-babb-42ea-9694-6b5810bd2d74 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:44.903228 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8b6acd7b-babb-42ea-9694-6b5810bd2d74 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:44.904921 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8b6acd7b-babb-42ea-9694-6b5810bd2d74 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:44.905384 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-8b6acd7b-babb-42ea-9694-6b5810bd2d74 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:45.147965 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-8e661ace-68d5-461b-b1a9-02d100f8ae3a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b034bd6e71471bb3653eabbd5da828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb2d93a8ca24b4cb81e316025504ef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:45.162347 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-8e661ace-68d5-461b-b1a9-02d100f8ae3a tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d" status: 200 len: 1403 microversion: 2.1 time: 0.628264 Jun 16 14:53:45.163423 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1526/2870] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:44 2022] GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d => generated 1403 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:45.180867 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-398fa3be-b742-4cc6-b6f5-ca8d55889e8d tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:45.184242 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-398fa3be-b742-4cc6-b6f5-ca8d55889e8d tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] [instance: 75464c3d-3cec-437c-a079-8ae97ca44345] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:45.197340 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-398fa3be-b742-4cc6-b6f5-ca8d55889e8d tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:45.205177 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-398fa3be-b742-4cc6-b6f5-ca8d55889e8d tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:45.208653 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-398fa3be-b742-4cc6-b6f5-ca8d55889e8d tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:45.209433 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-398fa3be-b742-4cc6-b6f5-ca8d55889e8d tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:45.249765 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:45.421016 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-398fa3be-b742-4cc6-b6f5-ca8d55889e8d tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a6622e5ee4a16b1e58b39f7337a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9325ace35c70494dbb105ac05953a2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:45.436838 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-398fa3be-b742-4cc6-b6f5-ca8d55889e8d tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345" status: 200 len: 1276 microversion: 2.1 time: 0.262378 Jun 16 14:53:45.437466 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1527/2871] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:45 2022] GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345 => generated 1276 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:45.537913 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-0fef2925-e640-4467-83e4-e79ec5cb07cf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:45.538595 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-0fef2925-e640-4467-83e4-e79ec5cb07cf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: a6f54e74-9834-449d-8a62-2f33df36a320] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:45.554706 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0fef2925-e640-4467-83e4-e79ec5cb07cf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:45.556433 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0fef2925-e640-4467-83e4-e79ec5cb07cf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:45.557503 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0fef2925-e640-4467-83e4-e79ec5cb07cf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:45.559136 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-0fef2925-e640-4467-83e4-e79ec5cb07cf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:46.032938 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-0fef2925-e640-4467-83e4-e79ec5cb07cf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:46.054142 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-0fef2925-e640-4467-83e4-e79ec5cb07cf tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320" status: 200 len: 1522 microversion: 2.1 time: 0.520633 Jun 16 14:53:46.058144 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1528/2872] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:45 2022] GET /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:46.069499 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-40f0b18e-48ad-4c82-baad-6a39cb729749 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:46.075926 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-40f0b18e-48ad-4c82-baad-6a39cb729749 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:46.094016 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-40f0b18e-48ad-4c82-baad-6a39cb729749 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:46.094590 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-40f0b18e-48ad-4c82-baad-6a39cb729749 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:46.095591 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-40f0b18e-48ad-4c82-baad-6a39cb729749 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:46.096360 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-40f0b18e-48ad-4c82-baad-6a39cb729749 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:46.601929 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-40f0b18e-48ad-4c82-baad-6a39cb729749 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:46.625102 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-40f0b18e-48ad-4c82-baad-6a39cb729749 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1312 microversion: 2.1 time: 0.564795 Jun 16 14:53:46.626980 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1529/2873] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:46 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1312 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:46.639528 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-313a32c9-79e4-4bd3-913f-e574159cac40 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:46.641739 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-313a32c9-79e4-4bd3-913f-e574159cac40 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:46.655688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-313a32c9-79e4-4bd3-913f-e574159cac40 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:46.656900 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-313a32c9-79e4-4bd3-913f-e574159cac40 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:46.658809 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-313a32c9-79e4-4bd3-913f-e574159cac40 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:46.660016 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-313a32c9-79e4-4bd3-913f-e574159cac40 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:47.013921 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-313a32c9-79e4-4bd3-913f-e574159cac40 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b034bd6e71471bb3653eabbd5da828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb2d93a8ca24b4cb81e316025504ef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:47.039648 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-313a32c9-79e4-4bd3-913f-e574159cac40 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d" status: 200 len: 1403 microversion: 2.1 time: 0.410135 Jun 16 14:53:47.054594 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1530/2874] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:46 2022] GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d => generated 1403 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:47.072801 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-15204ef3-f550-4138-b0b1-2dbd83a40cff tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:47.074106 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-15204ef3-f550-4138-b0b1-2dbd83a40cff tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] [instance: 75464c3d-3cec-437c-a079-8ae97ca44345] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:47.084816 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-15204ef3-f550-4138-b0b1-2dbd83a40cff tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:47.089862 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-15204ef3-f550-4138-b0b1-2dbd83a40cff tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:47.091854 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-15204ef3-f550-4138-b0b1-2dbd83a40cff tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:47.092781 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-15204ef3-f550-4138-b0b1-2dbd83a40cff tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:47.189980 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-15204ef3-f550-4138-b0b1-2dbd83a40cff tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a6622e5ee4a16b1e58b39f7337a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9325ace35c70494dbb105ac05953a2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:47.198709 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-15204ef3-f550-4138-b0b1-2dbd83a40cff tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345" status: 200 len: 1276 microversion: 2.1 time: 0.142032 Jun 16 14:53:47.199590 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1531/2875] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:47 2022] GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:47.205867 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-c6f79dc3-5159-45fd-aa80-5d0be77d6f02 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:47.206535 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-c6f79dc3-5159-45fd-aa80-5d0be77d6f02 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: a6f54e74-9834-449d-8a62-2f33df36a320] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:47.214969 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c6f79dc3-5159-45fd-aa80-5d0be77d6f02 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:47.215658 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c6f79dc3-5159-45fd-aa80-5d0be77d6f02 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:47.221951 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c6f79dc3-5159-45fd-aa80-5d0be77d6f02 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:47.223226 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-c6f79dc3-5159-45fd-aa80-5d0be77d6f02 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:47.392755 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=16 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:47.437212 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-c6f79dc3-5159-45fd-aa80-5d0be77d6f02 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:47.452855 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-c6f79dc3-5159-45fd-aa80-5d0be77d6f02 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320" status: 200 len: 1522 microversion: 2.1 time: 0.251222 Jun 16 14:53:47.455208 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1532/2876] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:47 2022] GET /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:47.653417 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ad739e07-6e20-416e-9db7-a70085a25c8e tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:47.654661 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ad739e07-6e20-416e-9db7-a70085a25c8e tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:47.709576 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ad739e07-6e20-416e-9db7-a70085a25c8e tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:47.711703 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ad739e07-6e20-416e-9db7-a70085a25c8e tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:47.721788 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ad739e07-6e20-416e-9db7-a70085a25c8e tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:47.723098 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell0:SELECT=8 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:47.727782 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ad739e07-6e20-416e-9db7-a70085a25c8e tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:48.199119 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ad739e07-6e20-416e-9db7-a70085a25c8e tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:48.214999 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ad739e07-6e20-416e-9db7-a70085a25c8e tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1312 microversion: 2.1 time: 0.573651 Jun 16 14:53:48.231800 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1533/2877] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:47 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1312 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:48.242685 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-abe8fd16-e1eb-479c-9c51-df834fca1c5f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:48.244218 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-abe8fd16-e1eb-479c-9c51-df834fca1c5f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:48.259531 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-abe8fd16-e1eb-479c-9c51-df834fca1c5f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:48.260606 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-abe8fd16-e1eb-479c-9c51-df834fca1c5f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:48.262128 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-abe8fd16-e1eb-479c-9c51-df834fca1c5f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:48.263373 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-abe8fd16-e1eb-479c-9c51-df834fca1c5f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:48.602864 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-abe8fd16-e1eb-479c-9c51-df834fca1c5f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b034bd6e71471bb3653eabbd5da828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb2d93a8ca24b4cb81e316025504ef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:48.633643 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-abe8fd16-e1eb-479c-9c51-df834fca1c5f tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d" status: 200 len: 1403 microversion: 2.1 time: 0.393691 Jun 16 14:53:48.637231 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1534/2878] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:48 2022] GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d => generated 1403 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:48.656084 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-825374fa-afd8-4f63-9692-30883fd073eb tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:48.657177 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-825374fa-afd8-4f63-9692-30883fd073eb tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] [instance: 75464c3d-3cec-437c-a079-8ae97ca44345] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:48.681151 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:48.693765 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-825374fa-afd8-4f63-9692-30883fd073eb tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:48.695209 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-825374fa-afd8-4f63-9692-30883fd073eb tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:48.697050 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-825374fa-afd8-4f63-9692-30883fd073eb tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:48.698154 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-825374fa-afd8-4f63-9692-30883fd073eb tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:48.897000 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8b6acd7b-babb-42ea-9694-6b5810bd2d74 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:48.944403 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8b6acd7b-babb-42ea-9694-6b5810bd2d74 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:48.947845 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-8b6acd7b-babb-42ea-9694-6b5810bd2d74 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:48.950022 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-8b6acd7b-babb-42ea-9694-6b5810bd2d74 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 4.199448 Jun 16 14:53:48.955293 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1345/2879] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:44 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 4206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:48.973458 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-06345f4d-aaf2-4280-8be6-2cf87ad084b7 req-207223db-dc03-4f27-b7a8-224a1491f1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b60391-d177-456e-8049-97f1686d904d", "name": "network-vif-plugged", "status": "completed", "tag": "c801a814-f346-4c3b-a6e2-f695c535d5f1"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:48.985157 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-825374fa-afd8-4f63-9692-30883fd073eb tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a6622e5ee4a16b1e58b39f7337a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9325ace35c70494dbb105ac05953a2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:49.022101 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-06345f4d-aaf2-4280-8be6-2cf87ad084b7 req-207223db-dc03-4f27-b7a8-224a1491f1ed service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:49.023394 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-06345f4d-aaf2-4280-8be6-2cf87ad084b7 req-207223db-dc03-4f27-b7a8-224a1491f1ed service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:49.041562 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-825374fa-afd8-4f63-9692-30883fd073eb tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345" status: 200 len: 1276 microversion: 2.1 time: 0.399965 Jun 16 14:53:49.051931 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1535/2880] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:48 2022] GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345 => generated 1276 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:49.064380 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9e6baf61-8567-49ba-b58d-9d81db241ef5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:49.065513 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9e6baf61-8567-49ba-b58d-9d81db241ef5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: a6f54e74-9834-449d-8a62-2f33df36a320] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:49.092323 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9e6baf61-8567-49ba-b58d-9d81db241ef5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:49.092323 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9e6baf61-8567-49ba-b58d-9d81db241ef5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:49.092661 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-06345f4d-aaf2-4280-8be6-2cf87ad084b7 req-207223db-dc03-4f27-b7a8-224a1491f1ed service nova] Creating event network-vif-plugged:c801a814-f346-4c3b-a6e2-f695c535d5f1 for instance d6b60391-d177-456e-8049-97f1686d904d on n-h1-836830-4 Jun 16 14:53:49.092847 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9e6baf61-8567-49ba-b58d-9d81db241ef5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:49.093418 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9e6baf61-8567-49ba-b58d-9d81db241ef5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:49.119637 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-06345f4d-aaf2-4280-8be6-2cf87ad084b7 req-207223db-dc03-4f27-b7a8-224a1491f1ed service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161403 Jun 16 14:53:49.126160 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1346/2881] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:49.255135 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-3abcb743-5b90-48b9-bb1c-2b958fd899d5 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:49.259427 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-3abcb743-5b90-48b9-bb1c-2b958fd899d5 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:49.310477 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3abcb743-5b90-48b9-bb1c-2b958fd899d5 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:49.311959 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3abcb743-5b90-48b9-bb1c-2b958fd899d5 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:49.314015 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3abcb743-5b90-48b9-bb1c-2b958fd899d5 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:49.315448 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-3abcb743-5b90-48b9-bb1c-2b958fd899d5 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:49.383448 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_cell1:SELECT=100 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:49.577732 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-9e6baf61-8567-49ba-b58d-9d81db241ef5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:49.608815 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9e6baf61-8567-49ba-b58d-9d81db241ef5 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320" status: 200 len: 1522 microversion: 2.1 time: 0.554794 Jun 16 14:53:49.609890 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1536/2882] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:49 2022] GET /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320 => generated 1522 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:49.674015 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-be8f97dd-ecd2-4a2a-8f77-d97622d304a3 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:49.680326 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-be8f97dd-ecd2-4a2a-8f77-d97622d304a3 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:49.711245 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be8f97dd-ecd2-4a2a-8f77-d97622d304a3 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:49.712372 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be8f97dd-ecd2-4a2a-8f77-d97622d304a3 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:49.719511 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be8f97dd-ecd2-4a2a-8f77-d97622d304a3 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:49.723688 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-be8f97dd-ecd2-4a2a-8f77-d97622d304a3 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:50.130568 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-be8f97dd-ecd2-4a2a-8f77-d97622d304a3 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b034bd6e71471bb3653eabbd5da828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb2d93a8ca24b4cb81e316025504ef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:50.159241 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-be8f97dd-ecd2-4a2a-8f77-d97622d304a3 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d" status: 200 len: 1403 microversion: 2.1 time: 0.494174 Jun 16 14:53:50.163399 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1537/2883] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:49 2022] GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d => generated 1403 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:50.179864 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-2554c920-cefd-4655-bcd3-aed436c10509 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:50.180841 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-2554c920-cefd-4655-bcd3-aed436c10509 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:50.205537 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2554c920-cefd-4655-bcd3-aed436c10509 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:50.206324 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2554c920-cefd-4655-bcd3-aed436c10509 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:50.208204 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2554c920-cefd-4655-bcd3-aed436c10509 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:50.209295 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-2554c920-cefd-4655-bcd3-aed436c10509 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:50.760627 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2554c920-cefd-4655-bcd3-aed436c10509 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:50.773686 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2554c920-cefd-4655-bcd3-aed436c10509 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:50.779862 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-2554c920-cefd-4655-bcd3-aed436c10509 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:50.782684 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-2554c920-cefd-4655-bcd3-aed436c10509 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 0.617100 Jun 16 14:53:50.795504 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1538/2884] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:50 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:50.804567 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b938079b-15b6-4908-b045-dfdec4d52d90 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:50.805486 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b938079b-15b6-4908-b045-dfdec4d52d90 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] [instance: 75464c3d-3cec-437c-a079-8ae97ca44345] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:50.814208 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b938079b-15b6-4908-b045-dfdec4d52d90 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:50.814709 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b938079b-15b6-4908-b045-dfdec4d52d90 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:50.815514 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b938079b-15b6-4908-b045-dfdec4d52d90 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:50.816427 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b938079b-15b6-4908-b045-dfdec4d52d90 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:50.904078 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b938079b-15b6-4908-b045-dfdec4d52d90 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a6622e5ee4a16b1e58b39f7337a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9325ace35c70494dbb105ac05953a2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:50.913770 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b938079b-15b6-4908-b045-dfdec4d52d90 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345" status: 200 len: 1276 microversion: 2.1 time: 0.116547 Jun 16 14:53:50.914285 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1539/2885] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:50 2022] GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345 => generated 1276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:50.928321 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-6d36d56c-48d5-45c8-a39b-5a6fad0edca8 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:50.929326 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-6d36d56c-48d5-45c8-a39b-5a6fad0edca8 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: a6f54e74-9834-449d-8a62-2f33df36a320] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:50.951251 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d36d56c-48d5-45c8-a39b-5a6fad0edca8 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:50.952057 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d36d56c-48d5-45c8-a39b-5a6fad0edca8 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:50.952185 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-3abcb743-5b90-48b9-bb1c-2b958fd899d5 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:50.955805 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d36d56c-48d5-45c8-a39b-5a6fad0edca8 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:50.957471 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-6d36d56c-48d5-45c8-a39b-5a6fad0edca8 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:50.968989 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-3abcb743-5b90-48b9-bb1c-2b958fd899d5 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1312 microversion: 2.1 time: 1.723102 Jun 16 14:53:50.980040 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1347/2886] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:49 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1312 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:53:51.052938 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-6d36d56c-48d5-45c8-a39b-5a6fad0edca8 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:51.065504 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-6d36d56c-48d5-45c8-a39b-5a6fad0edca8 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320" status: 200 len: 1480 microversion: 2.1 time: 0.149701 Jun 16 14:53:51.066942 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1540/2887] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:50 2022] GET /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320 => generated 1480 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:51.101859 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-affac27a-89a6-4fba-a3d5-3866e1d0f9af req-c710617a-fac0-4ac2-9f1c-cf44b1b70c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f54e74-9834-449d-8a62-2f33df36a320", "name": "network-vif-deleted", "tag": "44f50a71-e68c-45a7-8b61-e0a5daa83c9b"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:51.113350 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-affac27a-89a6-4fba-a3d5-3866e1d0f9af req-c710617a-fac0-4ac2-9f1c-cf44b1b70c99 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:51.114262 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-affac27a-89a6-4fba-a3d5-3866e1d0f9af req-c710617a-fac0-4ac2-9f1c-cf44b1b70c99 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:51.130526 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-affac27a-89a6-4fba-a3d5-3866e1d0f9af req-c710617a-fac0-4ac2-9f1c-cf44b1b70c99 service nova] Creating event network-vif-deleted:44f50a71-e68c-45a7-8b61-e0a5daa83c9b for instance a6f54e74-9834-449d-8a62-2f33df36a320 on n-h2-836830-4 Jun 16 14:53:51.138001 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-affac27a-89a6-4fba-a3d5-3866e1d0f9af req-c710617a-fac0-4ac2-9f1c-cf44b1b70c99 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039121 Jun 16 14:53:51.139369 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1348/2888] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:51.152671 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-f91ef6a8-160f-40a8-9132-ec7246388097 req-6490f013-5c20-4adc-be4e-62c772d2087f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9299dbd5-e00b-490f-baf8-0ea004f15515", "name": "network-vif-plugged", "status": "completed", "tag": "d6f76e12-e550-40ea-b0a6-57d36ca110cc"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:51.164624 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-f91ef6a8-160f-40a8-9132-ec7246388097 req-6490f013-5c20-4adc-be4e-62c772d2087f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:51.165500 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-f91ef6a8-160f-40a8-9132-ec7246388097 req-6490f013-5c20-4adc-be4e-62c772d2087f service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:51.172267 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=8 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:51.190337 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-f91ef6a8-160f-40a8-9132-ec7246388097 req-6490f013-5c20-4adc-be4e-62c772d2087f service nova] Creating event network-vif-plugged:d6f76e12-e550-40ea-b0a6-57d36ca110cc for instance 9299dbd5-e00b-490f-baf8-0ea004f15515 on n-h2-836830-4 Jun 16 14:53:51.192276 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-57af3906-7c8d-4e75-b390-300165d18447 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:51.193005 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-57af3906-7c8d-4e75-b390-300165d18447 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:51.205422 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57af3906-7c8d-4e75-b390-300165d18447 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:51.206638 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57af3906-7c8d-4e75-b390-300165d18447 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:51.210956 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57af3906-7c8d-4e75-b390-300165d18447 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:51.213656 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-57af3906-7c8d-4e75-b390-300165d18447 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:51.226701 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=6 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:51.238034 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-f91ef6a8-160f-40a8-9132-ec7246388097 req-6490f013-5c20-4adc-be4e-62c772d2087f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089319 Jun 16 14:53:51.239657 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1541/2889] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:51.814356 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b572c3fa-8a22-4959-b9fe-57ccc84af6a6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:51.818280 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b572c3fa-8a22-4959-b9fe-57ccc84af6a6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:51.834783 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b572c3fa-8a22-4959-b9fe-57ccc84af6a6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:51.835718 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b572c3fa-8a22-4959-b9fe-57ccc84af6a6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:51.837227 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b572c3fa-8a22-4959-b9fe-57ccc84af6a6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:51.838125 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b572c3fa-8a22-4959-b9fe-57ccc84af6a6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:52.183776 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b572c3fa-8a22-4959-b9fe-57ccc84af6a6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:52.201952 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b572c3fa-8a22-4959-b9fe-57ccc84af6a6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:52.205704 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b572c3fa-8a22-4959-b9fe-57ccc84af6a6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:52.208786 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b572c3fa-8a22-4959-b9fe-57ccc84af6a6 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 0.408008 Jun 16 14:53:52.223239 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1542/2890] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:51 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:52.241852 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a1be9b89-b833-4e38-a275-0fdbd87ce0fd tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:52.243496 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a1be9b89-b833-4e38-a275-0fdbd87ce0fd tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] [instance: 75464c3d-3cec-437c-a079-8ae97ca44345] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:52.264414 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a1be9b89-b833-4e38-a275-0fdbd87ce0fd tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:52.265812 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a1be9b89-b833-4e38-a275-0fdbd87ce0fd tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:52.267674 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a1be9b89-b833-4e38-a275-0fdbd87ce0fd tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:52.268651 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a1be9b89-b833-4e38-a275-0fdbd87ce0fd tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:52.401444 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-57af3906-7c8d-4e75-b390-300165d18447 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b034bd6e71471bb3653eabbd5da828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb2d93a8ca24b4cb81e316025504ef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:52.416951 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-a1be9b89-b833-4e38-a275-0fdbd87ce0fd tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a6622e5ee4a16b1e58b39f7337a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9325ace35c70494dbb105ac05953a2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:52.431583 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a1be9b89-b833-4e38-a275-0fdbd87ce0fd tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345" status: 200 len: 1276 microversion: 2.1 time: 0.206012 Jun 16 14:53:52.431911 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-57af3906-7c8d-4e75-b390-300165d18447 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d" status: 200 len: 1403 microversion: 2.1 time: 1.243826 Jun 16 14:53:52.434044 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1543/2891] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:52 2022] GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345 => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:52.446713 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-067a664d-afac-4a56-810f-7e9421cf1742 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:52.448649 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-067a664d-afac-4a56-810f-7e9421cf1742 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:52.451036 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1349/2892] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:51 2022] GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d => generated 1403 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:52.466346 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-067a664d-afac-4a56-810f-7e9421cf1742 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:52.466971 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-02f761a4-a464-4f1a-b8b2-8232dddefd38 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:52.467549 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-02f761a4-a464-4f1a-b8b2-8232dddefd38 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: a6f54e74-9834-449d-8a62-2f33df36a320] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:52.468695 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-067a664d-afac-4a56-810f-7e9421cf1742 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:52.471051 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-067a664d-afac-4a56-810f-7e9421cf1742 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:52.472127 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-067a664d-afac-4a56-810f-7e9421cf1742 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:52.474865 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-02f761a4-a464-4f1a-b8b2-8232dddefd38 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:52.475510 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-02f761a4-a464-4f1a-b8b2-8232dddefd38 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:52.476433 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-02f761a4-a464-4f1a-b8b2-8232dddefd38 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:52.476988 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-02f761a4-a464-4f1a-b8b2-8232dddefd38 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:52.504164 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-02f761a4-a464-4f1a-b8b2-8232dddefd38 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] HTTP exception thrown: Instance a6f54e74-9834-449d-8a62-2f33df36a320 could not be found. Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-02f761a4-a464-4f1a-b8b2-8232dddefd38 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Request method failure captured: Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320 HTTP/1.1 Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0OivVftuMT4fWjf7lHTJ023UG8jbsasJncBydH6aTqjoU4BNjTSSJ1Xva4OMO0PAM11RP2Wz65pJnEFMDDVD96zApDHY2itiValHUQyGn4bHK_199kZAxuVWWT_8_REYAyzrrutrdDsosiJqjFqV6fJdkzNH9puAeaMbmfd-7fbxPM Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa0ce43c5ac64864b458514ebdc5ad1a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa0ce43c5ac64864b458514ebdc5ad1a"}]}] Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 2f53e4d9a56c47089527b650611fa453 Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance a6f54e74-9834-449d-8a62-2f33df36a320 could not be found. Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': 'a6f54e74-9834-449d-8a62-2f33df36a320'} Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f54e74-9834-449d-8a62-2f33df36a320 could not be found. Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f54e74-9834-449d-8a62-2f33df36a320 could not be found. Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:52.510590 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:52.514914 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:52.514914 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:52.514914 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:52.514914 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:53:52.514914 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:53:52.514914 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f54e74-9834-449d-8a62-2f33df36a320 could not be found. Jun 16 14:53:52.514914 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:52.516923 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-02f761a4-a464-4f1a-b8b2-8232dddefd38 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Returning 404 to user: Instance a6f54e74-9834-449d-8a62-2f33df36a320 could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:53:52.518097 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-02f761a4-a464-4f1a-b8b2-8232dddefd38 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320" status: 404 len: 111 microversion: 2.1 time: 0.065725 Jun 16 14:53:52.522600 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1350/2893] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:52 2022] GET /compute/v2.1/servers/a6f54e74-9834-449d-8a62-2f33df36a320 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:53:52.533372 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ed9da6a7-ab6c-4088-9f8e-9d365865db91 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:52.557576 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ed9da6a7-ab6c-4088-9f8e-9d365865db91 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:52.577762 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ed9da6a7-ab6c-4088-9f8e-9d365865db91 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:52.578839 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ed9da6a7-ab6c-4088-9f8e-9d365865db91 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:52.580050 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ed9da6a7-ab6c-4088-9f8e-9d365865db91 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:52.580820 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ed9da6a7-ab6c-4088-9f8e-9d365865db91 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:52.712592 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-067a664d-afac-4a56-810f-7e9421cf1742 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:52.720312 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell1:SELECT=100 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:52.746274 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-067a664d-afac-4a56-810f-7e9421cf1742 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1312 microversion: 2.1 time: 0.308133 Jun 16 14:53:52.748118 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1544/2894] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:52 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1312 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:52.917457 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ed9da6a7-ab6c-4088-9f8e-9d365865db91 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f53e4d9a56c47089527b650611fa453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0ce43c5ac64864b458514ebdc5ad1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:52.932465 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ed9da6a7-ab6c-4088-9f8e-9d365865db91 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 200 len: 1308 microversion: 2.1 time: 0.402952 Jun 16 14:53:52.933445 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1351/2895] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:52 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:53.248117 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-98378088-841f-47b4-b987-b7888c90b541 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:53.250055 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-98378088-841f-47b4-b987-b7888c90b541 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:53.262182 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98378088-841f-47b4-b987-b7888c90b541 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:53.263828 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98378088-841f-47b4-b987-b7888c90b541 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:53.266346 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98378088-841f-47b4-b987-b7888c90b541 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:53.267853 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-98378088-841f-47b4-b987-b7888c90b541 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:53.285431 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-c4400d88-7cca-4b6f-aeef-7fc8def7fe55 req-f9d1d6b1-4188-4261-b27f-e782e74ddea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930c35e3-db68-47f4-9f47-06f74b96bebf", "name": "network-vif-deleted", "tag": "f7ff22c8-ceb6-4415-8bab-0960e76eef51"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:53.303415 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-c4400d88-7cca-4b6f-aeef-7fc8def7fe55 req-f9d1d6b1-4188-4261-b27f-e782e74ddea0 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:53.304108 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-c4400d88-7cca-4b6f-aeef-7fc8def7fe55 req-f9d1d6b1-4188-4261-b27f-e782e74ddea0 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:53.331954 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-c4400d88-7cca-4b6f-aeef-7fc8def7fe55 req-f9d1d6b1-4188-4261-b27f-e782e74ddea0 service nova] Creating event network-vif-deleted:f7ff22c8-ceb6-4415-8bab-0960e76eef51 for instance 930c35e3-db68-47f4-9f47-06f74b96bebf on n-h1-836830-4 Jun 16 14:53:53.342719 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-c4400d88-7cca-4b6f-aeef-7fc8def7fe55 req-f9d1d6b1-4188-4261-b27f-e782e74ddea0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058715 Jun 16 14:53:53.344839 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1352/2896] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:53:53.475117 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-6970329e-d4b1-4f29-a2b6-b2310f0d402e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:53.476398 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-6970329e-d4b1-4f29-a2b6-b2310f0d402e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:53.506793 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6970329e-d4b1-4f29-a2b6-b2310f0d402e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:53.507680 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6970329e-d4b1-4f29-a2b6-b2310f0d402e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:53.509191 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6970329e-d4b1-4f29-a2b6-b2310f0d402e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:53.509987 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-6970329e-d4b1-4f29-a2b6-b2310f0d402e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:53.604536 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-98378088-841f-47b4-b987-b7888c90b541 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:53.640096 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-98378088-841f-47b4-b987-b7888c90b541 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:53.655651 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-98378088-841f-47b4-b987-b7888c90b541 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:53.658530 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-98378088-841f-47b4-b987-b7888c90b541 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 0.417695 Jun 16 14:53:53.659910 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1545/2897] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:53 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:53.670201 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-3839dc3b-472e-4211-a549-91dab1a35125 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:53.682918 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-3839dc3b-472e-4211-a549-91dab1a35125 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] [instance: 75464c3d-3cec-437c-a079-8ae97ca44345] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:53.723738 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3839dc3b-472e-4211-a549-91dab1a35125 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:53.726926 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3839dc3b-472e-4211-a549-91dab1a35125 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:53.729285 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3839dc3b-472e-4211-a549-91dab1a35125 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:53.732802 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-3839dc3b-472e-4211-a549-91dab1a35125 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:53.896500 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-3839dc3b-472e-4211-a549-91dab1a35125 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a6622e5ee4a16b1e58b39f7337a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9325ace35c70494dbb105ac05953a2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:53.907195 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-3839dc3b-472e-4211-a549-91dab1a35125 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345" status: 200 len: 1276 microversion: 2.1 time: 0.245436 Jun 16 14:53:53.918737 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1546/2898] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:53 2022] GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345 => generated 1276 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:53.925712 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-bc8b32e3-d6ba-4b1e-9c4b-06fcdfdbf1d0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:53.926994 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-bc8b32e3-d6ba-4b1e-9c4b-06fcdfdbf1d0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:53.936665 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bc8b32e3-d6ba-4b1e-9c4b-06fcdfdbf1d0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:53.937618 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bc8b32e3-d6ba-4b1e-9c4b-06fcdfdbf1d0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:53.939853 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bc8b32e3-d6ba-4b1e-9c4b-06fcdfdbf1d0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:53.940328 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-bc8b32e3-d6ba-4b1e-9c4b-06fcdfdbf1d0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:54.207213 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-6970329e-d4b1-4f29-a2b6-b2310f0d402e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67b034bd6e71471bb3653eabbd5da828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb2d93a8ca24b4cb81e316025504ef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:54.223483 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-6970329e-d4b1-4f29-a2b6-b2310f0d402e tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d" status: 200 len: 1590 microversion: 2.1 time: 0.759075 Jun 16 14:53:54.225315 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1353/2899] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:53 2022] GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d => generated 1590 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:53:54.237508 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-809c7e55-1ff6-44de-a881-a8cc2ce91eb2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:54.239635 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-809c7e55-1ff6-44de-a881-a8cc2ce91eb2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] [instance: 930c35e3-db68-47f4-9f47-06f74b96bebf] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:54.262822 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-809c7e55-1ff6-44de-a881-a8cc2ce91eb2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:54.264071 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-809c7e55-1ff6-44de-a881-a8cc2ce91eb2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:54.265480 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-809c7e55-1ff6-44de-a881-a8cc2ce91eb2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:54.271634 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-809c7e55-1ff6-44de-a881-a8cc2ce91eb2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:54.303087 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.wsgi [None req-809c7e55-1ff6-44de-a881-a8cc2ce91eb2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] HTTP exception thrown: Instance 930c35e3-db68-47f4-9f47-06f74b96bebf could not be found. Jun 16 14:53:54.305123 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-bc8b32e3-d6ba-4b1e-9c4b-06fcdfdbf1d0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-809c7e55-1ff6-44de-a881-a8cc2ce91eb2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Request method failure captured: Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: request: GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf HTTP/1.1 Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: Accept: application/json Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: Accept-Encoding: identity Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: Connection: close Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: Content-Length: 0 Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: Content-Type: application/json Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: Host: 10.222.0.57 Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: Openstack-System-Scope: None Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: User-Agent: python-urllib3/1.26.9 Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-Auth-Token: gAAAAABiq0OivVftuMT4fWjf7lHTJ023UG8jbsasJncBydH6aTqjoU4BNjTSSJ1Xva4OMO0PAM11RP2Wz65pJnEFMDDVD96zApDHY2itiValHUQyGn4bHK_199kZAxuVWWT_8_REYAyzrrutrdDsosiJqjFqV6fJdkzNH9puAeaMbmfd-7fbxPM Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Id: None Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-Domain-Name: None Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-Identity-Status: Confirmed Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-Is-Admin-Project: True Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Id: default Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Domain-Name: Default Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-Project-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-Role: member,reader Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-Roles: member,reader Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa0ce43c5ac64864b458514ebdc5ad1a", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa0ce43c5ac64864b458514ebdc5ad1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa0ce43c5ac64864b458514ebdc5ad1a"}]}] Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Id: aa0ce43c5ac64864b458514ebdc5ad1a Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1784267226 Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-User: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Id: default Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-User-Domain-Name: Default Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-User-Id: 2f53e4d9a56c47089527b650611fa453 Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: X-User-Name: tempest-ListServersNegativeTestJSON-1784267226-project Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: method: > Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: exception: Instance 930c35e3-db68-47f4-9f47-06f74b96bebf could not be found. Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: action_args: {'id': '930c35e3-db68-47f4-9f47-06f74b96bebf'} Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 930c35e3-db68-47f4-9f47-06f74b96bebf could not be found. Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 930c35e3-db68-47f4-9f47-06f74b96bebf could not be found. Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:53:54.306070 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:54.311206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:53:54.311206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:53:54.311206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:53:54.311206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:53:54.311206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:53:54.311206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 930c35e3-db68-47f4-9f47-06f74b96bebf could not be found. Jun 16 14:53:54.311206 n-d-836830-4 devstack@n-api.service[125863]: ERROR nova.api.openstack.wsgi Jun 16 14:53:54.314657 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-809c7e55-1ff6-44de-a881-a8cc2ce91eb2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] Returning 404 to user: Instance 930c35e3-db68-47f4-9f47-06f74b96bebf could not be found. {{(pid=125863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:53:54.315710 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-809c7e55-1ff6-44de-a881-a8cc2ce91eb2 tempest-ListServersNegativeTestJSON-1784267226 tempest-ListServersNegativeTestJSON-1784267226-project] 10.222.0.57 "GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf" status: 404 len: 111 microversion: 2.1 time: 0.087559 Jun 16 14:53:54.324050 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1354/2900] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:54 2022] GET /compute/v2.1/servers/930c35e3-db68-47f4-9f47-06f74b96bebf => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:53:54.339314 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-bc8b32e3-d6ba-4b1e-9c4b-06fcdfdbf1d0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1499 microversion: 2.1 time: 0.418124 Jun 16 14:53:54.340471 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1547/2901] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:53 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1499 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:54.356784 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-dbd32399-7e54-44f8-98f2-b19aaf1090d8 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:54.357549 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-dbd32399-7e54-44f8-98f2-b19aaf1090d8 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] [instance: d6b60391-d177-456e-8049-97f1686d904d] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:54.365329 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dbd32399-7e54-44f8-98f2-b19aaf1090d8 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:54.366093 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-9483e455-f3fe-4859-b5e5-434ef7c3f083 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:54.366600 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dbd32399-7e54-44f8-98f2-b19aaf1090d8 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:54.367592 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dbd32399-7e54-44f8-98f2-b19aaf1090d8 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:54.368236 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-dbd32399-7e54-44f8-98f2-b19aaf1090d8 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:54.370184 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-9483e455-f3fe-4859-b5e5-434ef7c3f083 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:54.411950 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9483e455-f3fe-4859-b5e5-434ef7c3f083 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:54.412439 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9483e455-f3fe-4859-b5e5-434ef7c3f083 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:54.413559 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9483e455-f3fe-4859-b5e5-434ef7c3f083 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:54.414014 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-9483e455-f3fe-4859-b5e5-434ef7c3f083 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:54.554159 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-9483e455-f3fe-4859-b5e5-434ef7c3f083 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "POST /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515/action" status: 202 len: 0 microversion: 2.1 time: 0.194844 Jun 16 14:53:54.561421 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1548/2902] 10.222.0.57 () {60 vars in 1277 bytes} [Thu Jun 16 14:53:54 2022] POST /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:53:54.593660 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-160ebb0d-e6a0-4f5d-9abf-d0d377f0c809 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:54.599551 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-160ebb0d-e6a0-4f5d-9abf-d0d377f0c809 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:54.623303 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-160ebb0d-e6a0-4f5d-9abf-d0d377f0c809 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:54.626818 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-160ebb0d-e6a0-4f5d-9abf-d0d377f0c809 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:54.628448 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-160ebb0d-e6a0-4f5d-9abf-d0d377f0c809 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:54.632247 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-160ebb0d-e6a0-4f5d-9abf-d0d377f0c809 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:54.963727 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-dbd32399-7e54-44f8-98f2-b19aaf1090d8 tempest-ServersTestManualDisk-1069503222 tempest-ServersTestManualDisk-1069503222-project] 10.222.0.57 "GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.630025 Jun 16 14:53:54.972510 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1355/2903] 10.222.0.57 () {58 vars in 1274 bytes} [Thu Jun 16 14:53:54 2022] GET /compute/v2.1/servers/d6b60391-d177-456e-8049-97f1686d904d/os-interface => generated 284 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:53:54.999268 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-1e9418ca-142f-4798-9823-981fccd770f7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:55.001737 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-1e9418ca-142f-4798-9823-981fccd770f7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:55.020190 n-d-836830-4 devstack@n-api.service[125863]: DEBUG dbcounter [-] [125863] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=125863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:53:55.036813 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1e9418ca-142f-4798-9823-981fccd770f7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:55.037391 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1e9418ca-142f-4798-9823-981fccd770f7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:55.039064 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1e9418ca-142f-4798-9823-981fccd770f7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:55.039725 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-1e9418ca-142f-4798-9823-981fccd770f7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:55.196221 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-160ebb0d-e6a0-4f5d-9abf-d0d377f0c809 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:55.227391 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-160ebb0d-e6a0-4f5d-9abf-d0d377f0c809 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1504 microversion: 2.1 time: 0.656496 Jun 16 14:53:55.229163 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1549/2904] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:54 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1504 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:55.239551 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-ac5f4d56-f4bc-49de-bcb4-c2ca31ba8f64 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:55.240508 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-ac5f4d56-f4bc-49de-bcb4-c2ca31ba8f64 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] [instance: 75464c3d-3cec-437c-a079-8ae97ca44345] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:55.251820 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac5f4d56-f4bc-49de-bcb4-c2ca31ba8f64 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:55.252594 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac5f4d56-f4bc-49de-bcb4-c2ca31ba8f64 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:55.254186 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac5f4d56-f4bc-49de-bcb4-c2ca31ba8f64 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:55.255024 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-ac5f4d56-f4bc-49de-bcb4-c2ca31ba8f64 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:55.623911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-ac5f4d56-f4bc-49de-bcb4-c2ca31ba8f64 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a6622e5ee4a16b1e58b39f7337a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9325ace35c70494dbb105ac05953a2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:55.646241 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-ac5f4d56-f4bc-49de-bcb4-c2ca31ba8f64 tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345" status: 200 len: 1318 microversion: 2.1 time: 0.408625 Jun 16 14:53:55.647694 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1550/2905] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:55 2022] GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:56.248711 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-495c9f15-9b28-4019-85db-7643bb9c5909 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:56.248711 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-495c9f15-9b28-4019-85db-7643bb9c5909 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:56.269113 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-495c9f15-9b28-4019-85db-7643bb9c5909 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:56.269590 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-495c9f15-9b28-4019-85db-7643bb9c5909 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:56.270786 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-495c9f15-9b28-4019-85db-7643bb9c5909 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:56.271066 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-495c9f15-9b28-4019-85db-7643bb9c5909 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:57.039240 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-495c9f15-9b28-4019-85db-7643bb9c5909 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:57.054518 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-495c9f15-9b28-4019-85db-7643bb9c5909 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1484 microversion: 2.1 time: 0.811315 Jun 16 14:53:57.076074 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1551/2906] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:56 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1484 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:53:57.124178 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-b16bb99a-3129-4066-ba7d-f9c6941564ea tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Calling method '>' {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:57.125662 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-b16bb99a-3129-4066-ba7d-f9c6941564ea tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] [instance: 75464c3d-3cec-437c-a079-8ae97ca44345] Fetching instance by UUID {{(pid=125862) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:57.166188 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b16bb99a-3129-4066-ba7d-f9c6941564ea tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:57.167094 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b16bb99a-3129-4066-ba7d-f9c6941564ea tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:57.168936 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b16bb99a-3129-4066-ba7d-f9c6941564ea tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:57.170850 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-b16bb99a-3129-4066-ba7d-f9c6941564ea tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:57.200894 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1e9418ca-142f-4798-9823-981fccd770f7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:57.231541 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1e9418ca-142f-4798-9823-981fccd770f7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:57.233638 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-1e9418ca-142f-4798-9823-981fccd770f7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:57.245423 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-1e9418ca-142f-4798-9823-981fccd770f7 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 2.269252 Jun 16 14:53:57.246529 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1356/2907] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:54 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 2273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:53:57.273122 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-e77c4d53-b792-4d84-bf71-95fb20e8a982 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:57.279060 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e77c4d53-b792-4d84-bf71-95fb20e8a982 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:57.291021 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e77c4d53-b792-4d84-bf71-95fb20e8a982 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:57.292023 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e77c4d53-b792-4d84-bf71-95fb20e8a982 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:57.293256 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e77c4d53-b792-4d84-bf71-95fb20e8a982 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:57.296919 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-e77c4d53-b792-4d84-bf71-95fb20e8a982 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:57.370898 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-e77c4d53-b792-4d84-bf71-95fb20e8a982 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Going to try to terminate instance {{(pid=125863) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:53:57.603260 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-e77c4d53-b792-4d84-bf71-95fb20e8a982 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 204 len: 0 microversion: 2.1 time: 0.352945 Jun 16 14:53:57.611443 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1357/2908] 10.222.0.57 () {58 vars in 1238 bytes} [Thu Jun 16 14:53:57 2022] DELETE /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:53:57.633103 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-ba71682e-2201-4a49-a993-23136c690ad0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:57.634216 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-ba71682e-2201-4a49-a993-23136c690ad0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] [instance: 9299dbd5-e00b-490f-baf8-0ea004f15515] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:57.646712 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ba71682e-2201-4a49-a993-23136c690ad0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:57.656162 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ba71682e-2201-4a49-a993-23136c690ad0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:57.657529 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ba71682e-2201-4a49-a993-23136c690ad0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:57.658257 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-ba71682e-2201-4a49-a993-23136c690ad0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:58.281712 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-ba71682e-2201-4a49-a993-23136c690ad0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e78da3d7a6f45d7abe04bc447f7c870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa616e014da1416aa7369181bd1518e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:58.301209 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-ba71682e-2201-4a49-a993-23136c690ad0 tempest-DeleteServersTestJSON-31158303 tempest-DeleteServersTestJSON-31158303-project] 10.222.0.57 "GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515" status: 200 len: 1490 microversion: 2.1 time: 0.671993 Jun 16 14:53:58.302484 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1358/2909] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:57 2022] GET /compute/v2.1/servers/9299dbd5-e00b-490f-baf8-0ea004f15515 => generated 1490 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:58.308442 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [None req-228f2a33-6308-46f9-90b2-7089b559af76 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Calling method '>' {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:53:58.309913 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.compute.api [None req-228f2a33-6308-46f9-90b2-7089b559af76 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] [instance: d33c522d-8fb2-4c37-a15c-e1af48406b09] Fetching instance by UUID {{(pid=125863) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:53:58.317785 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-228f2a33-6308-46f9-90b2-7089b559af76 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:58.319046 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-228f2a33-6308-46f9-90b2-7089b559af76 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:58.320135 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-228f2a33-6308-46f9-90b2-7089b559af76 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:53:58.320827 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [None req-228f2a33-6308-46f9-90b2-7089b559af76 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:53:58.531109 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.policy [None req-b16bb99a-3129-4066-ba7d-f9c6941564ea tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314a6622e5ee4a16b1e58b39f7337a93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9325ace35c70494dbb105ac05953a2c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125862) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:53:58.541862 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-b16bb99a-3129-4066-ba7d-f9c6941564ea tempest-ListImageFiltersTestJSON-1519705235 tempest-ListImageFiltersTestJSON-1519705235-project] 10.222.0.57 "GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345" status: 200 len: 1318 microversion: 2.1 time: 1.440092 Jun 16 14:53:58.549392 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1552/2910] 10.222.0.57 () {58 vars in 1235 bytes} [Thu Jun 16 14:53:57 2022] GET /compute/v2.1/servers/75464c3d-3cec-437c-a079-8ae97ca44345 => generated 1318 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:53:59.128199 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-27990852", "imageRef": "3c5b2063-0858-477e-a4dd-6736a4c60e42", "flavorRef": "452", "networks": [{"uuid": "dcedaafc-7911-430c-af07-985407397755"}]}} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:53:59.205284 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.network.neutron [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] validate_networks() for [('dcedaafc-7911-430c-af07-985407397755', None, None, None, None, None)] {{(pid=125862) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:54:00.049923 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-228f2a33-6308-46f9-90b2-7089b559af76 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:54:00.072396 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-228f2a33-6308-46f9-90b2-7089b559af76 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:54:00.078280 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.policy [None req-228f2a33-6308-46f9-90b2-7089b559af76 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da61853d328c45e0866fadeaf3835430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abae3327830f4896a0897723567e2374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125863) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:54:00.080681 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [None req-228f2a33-6308-46f9-90b2-7089b559af76 tempest-TaggedBootDevicesTest-766471088 tempest-TaggedBootDevicesTest-766471088-project] 10.222.0.57 "GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09" status: 200 len: 1878 microversion: 2.32 time: 1.776717 Jun 16 14:54:00.083663 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1359/2911] 10.222.0.57 () {60 vars in 1276 bytes} [Thu Jun 16 14:53:58 2022] GET /compute/v2.1/servers/d33c522d-8fb2-4c37-a15c-e1af48406b09 => generated 1878 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:54:00.140715 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] Flavor limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:54:00.141214 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] Image limits 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:54:00.141638 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] Flavor pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:54:00.142063 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] Image pref 0:0:0 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:54:00.142517 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.virt.hardware [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:54:00.155965 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:54:00.156784 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:54:00.157983 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:54:00.159812 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:54:00.202648 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] Getting quotas for project ca3f51a9af524b93af5bd5274c2e7a6c. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:54:00.213035 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.quota [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] Getting quotas for user a703fa59fe984657a3d5be866f35e1a9 and project ca3f51a9af524b93af5bd5274c2e7a6c. Resources: {'ram', 'cores', 'instances'} {{(pid=125862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:54:00.249329 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] Going to run 1 instances... {{(pid=125862) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:54:00.252225 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.compute.api [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] [instance: a1a2ffbf-3a46-46a4-b1aa-8a0defadb64c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c5b2063-0858-477e-a4dd-6736a4c60e42',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:54:00.314048 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [None req-a8dc4d14-e1ba-42f2-91a3-f256c68c1eb3 tempest-FloatingIPsAssociationTestJSON-1174437875 tempest-FloatingIPsAssociationTestJSON-1174437875-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.762650 Jun 16 14:54:00.315077 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1553/2912] 10.222.0.57 () {60 vars in 1146 bytes} [Thu Jun 16 14:53:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:54:00.463665 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-bbeba6bd-39c2-4494-b952-9e5e1251f73e req-bd94196d-91b9-4c0b-9f90-ecf27fe102f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3914e05b-3b09-44ab-942a-07adfa6bb80d", "tag": "ea0da10a-13f7-4be8-8a9c-10dbd3075cc9"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:54:00.485904 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-bbeba6bd-39c2-4494-b952-9e5e1251f73e req-bd94196d-91b9-4c0b-9f90-ecf27fe102f0 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:54:00.486470 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-bbeba6bd-39c2-4494-b952-9e5e1251f73e req-bd94196d-91b9-4c0b-9f90-ecf27fe102f0 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:54:00.516630 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-bbeba6bd-39c2-4494-b952-9e5e1251f73e req-bd94196d-91b9-4c0b-9f90-ecf27fe102f0 service nova] Creating event network-changed:ea0da10a-13f7-4be8-8a9c-10dbd3075cc9 for instance 3914e05b-3b09-44ab-942a-07adfa6bb80d on n-h2-836830-4 Jun 16 14:54:00.530585 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-bbeba6bd-39c2-4494-b952-9e5e1251f73e req-bd94196d-91b9-4c0b-9f90-ecf27fe102f0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072098 Jun 16 14:54:00.531968 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1360/2913] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:54:02.773260 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-7ba55af7-f6ec-47ab-b46e-966670dbd7f1 req-70199a3d-57f8-477f-8f6f-91e5dae52313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75464c3d-3cec-437c-a079-8ae97ca44345", "tag": "4f7e9078-c638-47ec-92f5-e20f1cb91645"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:54:02.800911 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-7ba55af7-f6ec-47ab-b46e-966670dbd7f1 req-70199a3d-57f8-477f-8f6f-91e5dae52313 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:54:02.801568 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-7ba55af7-f6ec-47ab-b46e-966670dbd7f1 req-70199a3d-57f8-477f-8f6f-91e5dae52313 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:54:02.832016 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-7ba55af7-f6ec-47ab-b46e-966670dbd7f1 req-70199a3d-57f8-477f-8f6f-91e5dae52313 service nova] Creating event network-changed:4f7e9078-c638-47ec-92f5-e20f1cb91645 for instance 75464c3d-3cec-437c-a079-8ae97ca44345 on n-h2-836830-4 Jun 16 14:54:02.852571 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-7ba55af7-f6ec-47ab-b46e-966670dbd7f1 req-70199a3d-57f8-477f-8f6f-91e5dae52313 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085756 Jun 16 14:54:02.858714 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1554/2914] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:54:04.966763 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-61bad9ad-6929-4991-a93f-2116a6436785 req-4da16bed-542d-42b9-9f6d-3a683845c999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b60391-d177-456e-8049-97f1686d904d", "tag": "c801a814-f346-4c3b-a6e2-f695c535d5f1"}, {"server_uuid": "9299dbd5-e00b-490f-baf8-0ea004f15515", "name": "network-vif-deleted", "tag": "d6f76e12-e550-40ea-b0a6-57d36ca110cc"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:54:04.978420 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-61bad9ad-6929-4991-a93f-2116a6436785 req-4da16bed-542d-42b9-9f6d-3a683845c999 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:54:04.978924 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-61bad9ad-6929-4991-a93f-2116a6436785 req-4da16bed-542d-42b9-9f6d-3a683845c999 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:54:04.997412 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-61bad9ad-6929-4991-a93f-2116a6436785 req-4da16bed-542d-42b9-9f6d-3a683845c999 service nova] Creating event network-changed:c801a814-f346-4c3b-a6e2-f695c535d5f1 for instance d6b60391-d177-456e-8049-97f1686d904d on n-h1-836830-4 Jun 16 14:54:04.998770 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-61bad9ad-6929-4991-a93f-2116a6436785 req-4da16bed-542d-42b9-9f6d-3a683845c999 service nova] Creating event network-vif-deleted:d6f76e12-e550-40ea-b0a6-57d36ca110cc for instance 9299dbd5-e00b-490f-baf8-0ea004f15515 on n-h2-836830-4 Jun 16 14:54:05.009989 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-61bad9ad-6929-4991-a93f-2116a6436785 req-4da16bed-542d-42b9-9f6d-3a683845c999 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048905 Jun 16 14:54:05.011282 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1361/2915] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:54:05.764306 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-734a8b0c-45ec-47f4-a862-2b67e2f108fc req-ddc2a478-7f11-4785-a9b3-d3639d15871c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d33c522d-8fb2-4c37-a15c-e1af48406b09", "name": "network-vif-plugged", "status": "completed", "tag": "06d3d87e-c24d-4c54-959e-05ab2fe4500b"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:54:05.795596 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-734a8b0c-45ec-47f4-a862-2b67e2f108fc req-ddc2a478-7f11-4785-a9b3-d3639d15871c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:54:05.796162 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-734a8b0c-45ec-47f4-a862-2b67e2f108fc req-ddc2a478-7f11-4785-a9b3-d3639d15871c service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:54:05.834439 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-734a8b0c-45ec-47f4-a862-2b67e2f108fc req-ddc2a478-7f11-4785-a9b3-d3639d15871c service nova] Creating event network-vif-plugged:06d3d87e-c24d-4c54-959e-05ab2fe4500b for instance d33c522d-8fb2-4c37-a15c-e1af48406b09 on n-h1-836830-4 Jun 16 14:54:05.844168 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-734a8b0c-45ec-47f4-a862-2b67e2f108fc req-ddc2a478-7f11-4785-a9b3-d3639d15871c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085457 Jun 16 14:54:05.845518 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1555/2916] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:54:07.519032 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-63a35ccb-b5f2-422e-9b5f-fe961c858613 req-82f868d2-c916-4087-a381-b63f177b8efb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1a2ffbf-3a46-46a4-b1aa-8a0defadb64c", "tag": "fe3b6106-e0f9-4527-be8f-0c45e8424579"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:54:07.538406 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-63a35ccb-b5f2-422e-9b5f-fe961c858613 req-82f868d2-c916-4087-a381-b63f177b8efb service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:54:07.540074 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-63a35ccb-b5f2-422e-9b5f-fe961c858613 req-82f868d2-c916-4087-a381-b63f177b8efb service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:54:07.568547 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-63a35ccb-b5f2-422e-9b5f-fe961c858613 req-82f868d2-c916-4087-a381-b63f177b8efb service nova] Creating event network-changed:fe3b6106-e0f9-4527-be8f-0c45e8424579 for instance a1a2ffbf-3a46-46a4-b1aa-8a0defadb64c on n-h1-836830-4 Jun 16 14:54:07.574524 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-63a35ccb-b5f2-422e-9b5f-fe961c858613 req-82f868d2-c916-4087-a381-b63f177b8efb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060855 Jun 16 14:54:07.576337 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1362/2917] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:54:07.904236 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-2e00484c-cd8f-402a-bc0a-34ea21dda504 req-97019e42-ac53-4655-a028-2c53a3892219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d33c522d-8fb2-4c37-a15c-e1af48406b09", "name": "network-vif-plugged", "status": "completed", "tag": "b11d7310-a550-44b5-aba3-1d27cb9e167a"}, {"server_uuid": "d33c522d-8fb2-4c37-a15c-e1af48406b09", "name": "network-vif-plugged", "status": "completed", "tag": "59215472-4985-4b78-b577-83b9797bacb4"}, {"server_uuid": "3914e05b-3b09-44ab-942a-07adfa6bb80d", "name": "network-vif-plugged", "status": "completed", "tag": "ea0da10a-13f7-4be8-8a9c-10dbd3075cc9"}, {"server_uuid": "d33c522d-8fb2-4c37-a15c-e1af48406b09", "name": "network-vif-plugged", "status": "completed", "tag": "ec0d2b71-c14d-45e2-a4df-8add2d7ca30f"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:54:07.926435 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-2e00484c-cd8f-402a-bc0a-34ea21dda504 req-97019e42-ac53-4655-a028-2c53a3892219 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:54:07.927250 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-2e00484c-cd8f-402a-bc0a-34ea21dda504 req-97019e42-ac53-4655-a028-2c53a3892219 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:54:07.957144 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-2e00484c-cd8f-402a-bc0a-34ea21dda504 req-97019e42-ac53-4655-a028-2c53a3892219 service nova] Creating event network-vif-plugged:b11d7310-a550-44b5-aba3-1d27cb9e167a for instance d33c522d-8fb2-4c37-a15c-e1af48406b09 on n-h1-836830-4 Jun 16 14:54:07.957780 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-2e00484c-cd8f-402a-bc0a-34ea21dda504 req-97019e42-ac53-4655-a028-2c53a3892219 service nova] Creating event network-vif-plugged:59215472-4985-4b78-b577-83b9797bacb4 for instance d33c522d-8fb2-4c37-a15c-e1af48406b09 on n-h1-836830-4 Jun 16 14:54:07.959084 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-2e00484c-cd8f-402a-bc0a-34ea21dda504 req-97019e42-ac53-4655-a028-2c53a3892219 service nova] Creating event network-vif-plugged:ea0da10a-13f7-4be8-8a9c-10dbd3075cc9 for instance 3914e05b-3b09-44ab-942a-07adfa6bb80d on n-h2-836830-4 Jun 16 14:54:07.960069 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-2e00484c-cd8f-402a-bc0a-34ea21dda504 req-97019e42-ac53-4655-a028-2c53a3892219 service nova] Creating event network-vif-plugged:ec0d2b71-c14d-45e2-a4df-8add2d7ca30f for instance d33c522d-8fb2-4c37-a15c-e1af48406b09 on n-h1-836830-4 Jun 16 14:54:07.977100 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-2e00484c-cd8f-402a-bc0a-34ea21dda504 req-97019e42-ac53-4655-a028-2c53a3892219 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.083473 Jun 16 14:54:07.977748 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1556/2918] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:54:10.002008 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-662aef1a-c7ab-4c81-9ace-6fd1dcb244db req-5b778289-e8fb-47b1-8721-d6a793d2e3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d33c522d-8fb2-4c37-a15c-e1af48406b09", "name": "network-vif-plugged", "status": "completed", "tag": "02831d3d-c073-4baa-972f-887b4ac2e4eb"}, {"server_uuid": "d33c522d-8fb2-4c37-a15c-e1af48406b09", "name": "network-vif-plugged", "status": "completed", "tag": "59329a00-c78e-4af9-81f7-04ede23e4f24"}, {"server_uuid": "d33c522d-8fb2-4c37-a15c-e1af48406b09", "name": "network-vif-plugged", "status": "completed", "tag": "fb5abd93-9e7b-4e99-abcb-6470f0c9ec14"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:54:10.011867 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-662aef1a-c7ab-4c81-9ace-6fd1dcb244db req-5b778289-e8fb-47b1-8721-d6a793d2e3f7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:54:10.012859 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-662aef1a-c7ab-4c81-9ace-6fd1dcb244db req-5b778289-e8fb-47b1-8721-d6a793d2e3f7 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:54:10.026540 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-662aef1a-c7ab-4c81-9ace-6fd1dcb244db req-5b778289-e8fb-47b1-8721-d6a793d2e3f7 service nova] Creating event network-vif-plugged:02831d3d-c073-4baa-972f-887b4ac2e4eb for instance d33c522d-8fb2-4c37-a15c-e1af48406b09 on n-h1-836830-4 Jun 16 14:54:10.027163 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-662aef1a-c7ab-4c81-9ace-6fd1dcb244db req-5b778289-e8fb-47b1-8721-d6a793d2e3f7 service nova] Creating event network-vif-plugged:59329a00-c78e-4af9-81f7-04ede23e4f24 for instance d33c522d-8fb2-4c37-a15c-e1af48406b09 on n-h1-836830-4 Jun 16 14:54:10.028134 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-662aef1a-c7ab-4c81-9ace-6fd1dcb244db req-5b778289-e8fb-47b1-8721-d6a793d2e3f7 service nova] Creating event network-vif-plugged:fb5abd93-9e7b-4e99-abcb-6470f0c9ec14 for instance d33c522d-8fb2-4c37-a15c-e1af48406b09 on n-h1-836830-4 Jun 16 14:54:10.035623 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-662aef1a-c7ab-4c81-9ace-6fd1dcb244db req-5b778289-e8fb-47b1-8721-d6a793d2e3f7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039666 Jun 16 14:54:10.036340 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1363/2919] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:54:12.052192 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=2 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:12.053095 n-d-836830-4 devstack@n-api.service[125862]: DEBUG dbcounter [-] [125862] Writing DB stats nova_cell0:SELECT=6 {{(pid=125862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:12.057783 n-d-836830-4 devstack@n-api.service[125862]: DEBUG nova.api.openstack.wsgi [req-3578cd3b-21f1-4c19-adb6-a94a144d9714 req-92f0df74-b864-4d98-8ff4-551824a6b735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75464c3d-3cec-437c-a079-8ae97ca44345", "name": "network-vif-plugged", "status": "completed", "tag": "4f7e9078-c638-47ec-92f5-e20f1cb91645"}]} {{(pid=125862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:54:12.072215 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3578cd3b-21f1-4c19-adb6-a94a144d9714 req-92f0df74-b864-4d98-8ff4-551824a6b735 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:54:12.072684 n-d-836830-4 devstack@n-api.service[125862]: DEBUG oslo_concurrency.lockutils [req-3578cd3b-21f1-4c19-adb6-a94a144d9714 req-92f0df74-b864-4d98-8ff4-551824a6b735 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:54:12.087029 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.compute.server_external_events [req-3578cd3b-21f1-4c19-adb6-a94a144d9714 req-92f0df74-b864-4d98-8ff4-551824a6b735 service nova] Creating event network-vif-plugged:4f7e9078-c638-47ec-92f5-e20f1cb91645 for instance 75464c3d-3cec-437c-a079-8ae97ca44345 on n-h2-836830-4 Jun 16 14:54:12.093790 n-d-836830-4 devstack@n-api.service[125862]: INFO nova.api.openstack.requestlog [req-3578cd3b-21f1-4c19-adb6-a94a144d9714 req-92f0df74-b864-4d98-8ff4-551824a6b735 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043168 Jun 16 14:54:12.094630 n-d-836830-4 devstack@n-api.service[125862]: [pid: 125862|app: 0|req: 1557/2920] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:54:15.412061 n-d-836830-4 devstack@n-api.service[125863]: DEBUG nova.api.openstack.wsgi [req-0ef49f55-0e93-4eeb-8a3f-63fad3a4c840 req-45d015ca-0316-45b4-8180-b01386319080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1a2ffbf-3a46-46a4-b1aa-8a0defadb64c", "name": "network-vif-plugged", "status": "completed", "tag": "fe3b6106-e0f9-4527-be8f-0c45e8424579"}]} {{(pid=125863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:54:15.424394 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-0ef49f55-0e93-4eeb-8a3f-63fad3a4c840 req-45d015ca-0316-45b4-8180-b01386319080 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:54:15.424907 n-d-836830-4 devstack@n-api.service[125863]: DEBUG oslo_concurrency.lockutils [req-0ef49f55-0e93-4eeb-8a3f-63fad3a4c840 req-45d015ca-0316-45b4-8180-b01386319080 service nova] Lock "5f79e34c-a163-4b02-a0e0-fa1420b72299" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:54:15.439251 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.compute.server_external_events [req-0ef49f55-0e93-4eeb-8a3f-63fad3a4c840 req-45d015ca-0316-45b4-8180-b01386319080 service nova] Creating event network-vif-plugged:fe3b6106-e0f9-4527-be8f-0c45e8424579 for instance a1a2ffbf-3a46-46a4-b1aa-8a0defadb64c on n-h1-836830-4 Jun 16 14:54:15.444726 n-d-836830-4 devstack@n-api.service[125863]: INFO nova.api.openstack.requestlog [req-0ef49f55-0e93-4eeb-8a3f-63fad3a4c840 req-45d015ca-0316-45b4-8180-b01386319080 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036775 Jun 16 14:54:15.445655 n-d-836830-4 devstack@n-api.service[125863]: [pid: 125863|app: 0|req: 1364/2921] 10.222.0.57 () {64 vars in 1317 bytes} [Thu Jun 16 14:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:56:28.835664 n-d-836830-4 devstack@n-api.service[125863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 14:56:28.836619 n-d-836830-4 devstack@n-api.service[125863]: Thu Jun 16 14:56:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 14:56:28.900681 n-d-836830-4 devstack@n-api.service[125863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 14:56:28.900921 n-d-836830-4 devstack@n-api.service[125863]: Thu Jun 16 14:56:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 14:56:29.049871 n-d-836830-4 devstack@n-api.service[125862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 14:56:29.050793 n-d-836830-4 devstack@n-api.service[125862]: Thu Jun 16 14:56:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 14:56:29.151320 n-d-836830-4 devstack@n-api.service[125862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 14:56:29.151589 n-d-836830-4 devstack@n-api.service[125862]: Thu Jun 16 14:56:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 14:56:55.869581 n-d-836830-4 devstack@n-api.service[125863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 14:56:55.870150 n-d-836830-4 devstack@n-api.service[125863]: Thu Jun 16 14:56:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 14:57:08.262865 n-d-836830-4 devstack@n-api.service[125862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 14:57:08.263616 n-d-836830-4 devstack@n-api.service[125862]: Thu Jun 16 14:57:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 14:59:48.845932 n-d-836830-4 devstack@n-api.service[125863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 14:59:48.846694 n-d-836830-4 devstack@n-api.service[125863]: Thu Jun 16 14:59:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 14:59:48.911566 n-d-836830-4 devstack@n-api.service[125863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 14:59:48.911840 n-d-836830-4 devstack@n-api.service[125863]: Thu Jun 16 14:59:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 14:59:49.061057 n-d-836830-4 devstack@n-api.service[125862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 14:59:49.061736 n-d-836830-4 devstack@n-api.service[125862]: Thu Jun 16 14:59:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 14:59:49.161372 n-d-836830-4 devstack@n-api.service[125862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 14:59:49.161654 n-d-836830-4 devstack@n-api.service[125862]: Thu Jun 16 14:59:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:00:15.880910 n-d-836830-4 devstack@n-api.service[125863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:00:15.881794 n-d-836830-4 devstack@n-api.service[125863]: Thu Jun 16 15:00:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:00:28.273788 n-d-836830-4 devstack@n-api.service[125862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:00:28.274548 n-d-836830-4 devstack@n-api.service[125862]: Thu Jun 16 15:00:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!